00000001:02000400:0.0F:1789635093.433218:0:3296:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1789635109.462959:0:3517:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1789635111.047042:0:3579:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 599 MB/s 00000001:01000000:2.0:1789635111.304026:0:3579:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 887 MB/s 00000001:01000000:0.0:1789635111.553703:0:3579:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 6203 MB/s 00000020:02000000:0.0:1789635112.195045:0:3609:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_ga8a99f2 00000400:02000000:2.0:1789635112.936326:0:3624:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.120@tcp [8/256/0/180] 00008000:02000000:1.0F:1789635115.999554:0:3773:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1789635168.203928:0:5741:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing load_modules_local 00000020:01000004:3.0F:1789635180.470561:0:6491:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789635180.470575:0:6491:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1789635180.470576:0:6491:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789635180.470722:0:6491:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000003bfd7196 00000080:02000400:3.0:1789635180.470732:0:6491:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1789635180.477164:0:6491:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1789635180.477176:0:6491:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789635180.477209:0:6491:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000105aa8da) 00000020:00000080:3.0:1789635180.477227:0:6491:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789635180.540782:0:6491:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789635180.540863:0:6491:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1789635180.564825:0:6491:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789635180.565100:0:6491:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789635180.565108:0:6491:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789635180.565120:0:6491:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb0c3a59caa40e9fd 00000020:01000004:3.0:1789635180.565126:0:6491:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1789635180.565130:0:6491:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789635180.565134:0:6491:0:(tgt_mount.c:101:server_register_mount()) register mount 000000003bfd7196 from MGS 00000020:01000004:3.0:1789635180.565138:0:6491:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789635180.565147:0:6491:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000043f32fe) 00000020:00000080:3.0:1789635180.565157:0:6491:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789635180.565212:0:6491:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003bfd7196 from MGS, refs=2 00080000:01000000:3.0:1789635180.565218:0:6491:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789635180.565236:0:6491:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb0c3a59caa40ea0b 00000100:00100000:3.0:1789635180.565340:0:6491:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789635180.565542:0:6491:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789635180.565548:0:6491:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789635180.566908:0:6491:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789635180.566921:0:6491:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789635180.567654:0:6491:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789635180.567854:0:6491:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789635180.567860:0:6491:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789635180.570065:0:6491:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789635180.570077:0:6491:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789635180.571420:0:6491:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789635180.571433:0:6491:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789635180.572289:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635180.572293:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635180.572294:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635180.572827:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635180.572830:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635180.572831:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635180.573295:0:6491:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789635180.580630:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1789635180.824059:0:6491:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3274 MB/s 00000001:01000000:2.0:1789635181.074242:0:6491:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2619 MB/s 00000001:01000000:2.0:1789635181.323953:0:6491:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 479 MB/s 00000001:01000000:3.0:1789635181.576246:0:6491:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 769 MB/s 00080000:10000000:0.0:1789635181.583223:0:6491:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:0.0:1789635181.592037:0:6491:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1789635181.592784:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789635181.592832:0:6491:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789635181.592870:0:6491:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1789635181.593019:0:6491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789635181.593040:0:6491:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789635181.593393:0:6491:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789635181.593830:0:6491:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789635181.593837:0:6491:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789635181.599858:0:6491:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789635181.599871:0:6491:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789635181.602629:0:6491:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789635181.602643:0:6491:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789635181.603369:0:6491:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789635181.603390:0:6491:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.120@tcp' 00000020:01000004:1.0:1789635181.603392:0:6491:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789635181.603488:0:6491:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.120@tcp (typ=mgc) 00000020:00000080:1.0:1789635181.603507:0:6491:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.120@tcp (00000000c78c51fa) 00000020:00000080:1.0:1789635181.603524:0:6491:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789635181.603669:0:6491:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006821ac62@MGC192.168.203.120@tcp: add connection 192.168.203.120@tcp at head 00010000:00010000:1.0:1789635181.603818:0:6491:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.120@tcp-0 is initialized 00000040:01000000:1.0:1789635181.603824:0:6491:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 1 is initialized 00000100:00080000:3.0:1789635181.604106:0:6510:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1789635181.610842:0:6512:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789635181.610893:0:6491:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.120@tcp (uuid 6356ed01-c755-4f9e-b839-20feb7c3f098) 00000020:00000080:1.0:1789635181.610914:0:6491:0:(genops.c:1384:class_connect()) connect: client 6356ed01-c755-4f9e-b839-20feb7c3f098, cookie 0xb0c3a59caa40ea19 00000100:00080000:1.0:1789635181.610925:0:6491:0:(import.c:545:import_select_connection()) MGC192.168.203.120@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789635181.610933:0:6491:0:(import.c:666:import_select_connection()) MGC192.168.203.120@tcp: import 000000006821ac62 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1789635181.610976:0:6491:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000095591951 x1876568427200640/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789635181.610995:0:6491:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 6356ed01-c755-4f9e-b839-20feb7c3f098->MGS 00000020:01000004:1.0:1789635181.611014:0:6491:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789635181.611019:0:6491:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789635181.611031:0:6491:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000d9b52c1e) 00000020:00000080:1.0:1789635181.611042:0:6491:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789635181.611838:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000095591951 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6356ed01-c755-4f9e-b839-20feb7c3f098:3639:1876568427200640:0@lo:250: 00000100:00100000:0.0:1789635181.611920:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635181.611983:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427200640 00000100:00100000:0.0:1789635181.611991:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427200640 00000100:00100000:0.0:1789635181.612028:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789635181.612034:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008be32e3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3639:x1876568427200640:12345-0@lo:250: 00010000:00080000:0.0:1789635181.612056:0:6506:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 6356ed01-c755-4f9e-b839-20feb7c3f098@0@lo t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:0.0:1789635181.612077:0:6506:0:(genops.c:1384:class_connect()) connect: client 6356ed01-c755-4f9e-b839-20feb7c3f098, cookie 0xb0c3a59caa40ea27 00000100:00080000:0.0:1789635181.612215:0:6506:0:(import.c:65:import_set_state_nolock()) 00000000ed2a7cfd : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789635181.612261:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008be32e3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+5:3639:x1876568427200640:12345-0@lo:250: Request processed in 225us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635181.612268:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789635181.612302:0:3639:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.120@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789635181.612310:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.120@tcp: connect to target with instance 0 00000100:00080000:0.0:1789635181.612316:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.120@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789635181.612330:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789635181.612333:0:3639:0:(import.c:65:import_set_state_nolock()) 000000006821ac62 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789635181.612336:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789635181.612342:0:3639:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789635181.612346:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000095591951 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6356ed01-c755-4f9e-b839-20feb7c3f098:3639:1876568427200640:0@lo:250: 00010000:00010000:2.0:1789635181.612985:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635181.632397:0:6491:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789635181.632640:0:6491:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789635181.632646:0:6491:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789635181.634759:0:6491:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789635181.634770:0:6491:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789635181.642414:0:6491:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789635181.642426:0:6491:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789635181.649079:0:6491:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789635181.649523:0:6491:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789635181.649530:0:6491:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789635181.651620:0:6491:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789635181.651635:0:6491:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789635181.702967:0:6491:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789635181.703148:0:6491:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789635181.703155:0:6491:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789635181.712551:0:6491:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789635181.712575:0:6491:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789635181.714004:0:6491:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789635181.714187:0:6491:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789635181.714193:0:6491:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789635181.716403:0:6491:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789635181.716484:0:6491:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789635181.717514:0:6491:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789635181.717761:0:6491:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789635181.717766:0:6491:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789635181.718377:0:6491:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789635181.718384:0:6491:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789635181.719316:0:6491:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789635181.719558:0:6491:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789635181.719564:0:6491:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789635181.720482:0:6491:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789635181.720490:0:6491:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789635181.744831:0:6491:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789635181.745030:0:6491:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789635181.745037:0:6491:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789635181.747024:0:6491:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789635181.747037:0:6491:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789635181.748041:0:6491:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789635181.748050:0:6491:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789635181.749302:0:6491:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789635181.749338:0:6491:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1789635181.749344:0:6491:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789635181.749512:0:6491:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789635181.749543:0:6491:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.120@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1789635181.749547:0:6491:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789635181.749549:0:6491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789635181.749550:0:6491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789635181.749551:0:6491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789635181.749552:0:6491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789635181.749552:0:6491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789635181.749554:0:6491:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789635181.749555:0:6491:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789635181.749556:0:6491:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789635181.749557:0:6491:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789635181.749563:0:6491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789635181.749564:0:6491:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789635181.749566:0:6491:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1789635181.749568:0:6491:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789635181.749569:0:6491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789635181.749570:0:6491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789635181.749571:0:6491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789635181.749572:0:6491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789635181.749572:0:6491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789635181.749573:0:6491:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789635181.749574:0:6491:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789635181.749575:0:6491:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789635181.749576:0:6491:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789635181.749577:0:6491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789635181.749577:0:6491:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789635181.749929:0:6491:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789635181.749947:0:6491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006343abb2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:6491:1876568427200768:0@lo:253: 00000100:00100000:2.0:1789635181.750024:0:6491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635181.750123:0:6491:0:(client.c:2716:ptlrpc_set_wait()) set 0000000063a966e6 going to sleep for 11 seconds 00000100:00100000:3.0:1789635181.750211:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427200768 00000100:00100000:3.0:1789635181.750219:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427200768 00000100:00100000:3.0:1789635181.750299:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789635181.750308:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e995f888 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+5:6491:x1876568427200768:12345-0@lo:253: 20000000:01000000:3.0:1789635181.750361:0:6509:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789635181.750364:0:6509:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1789635181.750965:0:6530:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789635181.751018:0:6509:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1789635181.751284:0:6509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789635181.752379:0:6531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1789635181.752563:0:6509:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789635181.752566:0:6509:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1789635181.752571:0:6509:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1789635181.752574:0:6509:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1789635181.752584:0:6509:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1789635181.752920:0:6509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789635181.753120:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1789635181.753133:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789635181.753148:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1789635181.753161:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1789635181.753186:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1789635181.753236:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1789635181.753250:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1789635181.753263:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1789635181.753267:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1789635181.753278:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1789635181.753282:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1789635181.753292:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1789635181.753304:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1789635181.753342:0:6509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789635181.753347:0:6509:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1789635181.753354:0:6509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789635181.753449:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1789635181.753458:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789635181.753471:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1789635181.753485:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1789635181.753498:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1789635181.753506:0:6509:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1789635181.753529:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1789635181.753535:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789635181.753546:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1789635181.753559:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1789635181.753571:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1789635181.753579:0:6509:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1789635181.754249:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1789635181.754262:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1789635181.754274:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1789635181.754301:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1789635181.754370:0:6509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1789635181.754388:0:6509:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789635181.754394:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1789635181.755123:0:6532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1789635181.755295:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1789635181.755316:0:6509:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.120@tcp for mdt 20000000:01000000:1.0:1789635181.755330:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.120@tcp (null) (null) (null) 00000040:00080000:1.0:1789635181.755356:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1789635181.755363:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789635181.755374:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1789635181.755378:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.120@tcp (null) (null) 00000040:00080000:1.0:1789635181.755389:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1789635181.755395:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1789635181.755406:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1789635181.755434:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1789635181.755460:0:6509:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789635181.755463:0:6509:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789635181.755467:0:6509:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789635181.755518:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789635181.755520:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789635181.756045:0:6533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1789635181.756201:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1789635181.756224:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1789635181.756240:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1789635181.756251:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789635181.756258:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789635181.756571:0:6534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1789635181.756856:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1789635181.756878:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1789635181.756893:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:3.0:1789635181.756905:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789635181.756907:0:6509:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1789635181.756912:0:6509:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789635181.756915:0:6509:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789635181.756920:0:6509:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1789635181.756925:0:6509:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1789635181.757378:0:6535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1789635181.757516:0:6509:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1789635181.769141:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1789635181.769177:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1789635181.769192:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1789635181.769212:0:6509:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789635181.769234:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001cc1e762/0xb0c3a59caa40ea2e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635181.769248:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001cc1e762/0xb0c3a59caa40ea2e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635181.769257:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001cc1e762/0xb0c3a59caa40ea2e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635181.769262:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001cc1e762/0xb0c3a59caa40ea2e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635181.769284:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001cc1e762/0xb0c3a59caa40ea2e lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635181.769290:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001cc1e762/0xb0c3a59caa40ea2e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635181.769295:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001cc1e762 already unused, calling callback (0000000034729756) 00010000:00010000:1.0:1789635181.769297:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001cc1e762/0xb0c3a59caa40ea2e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635181.769304:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001cc1e762/0xb0c3a59caa40ea2e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635181.769314:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001cc1e762/0xb0c3a59caa40ea2e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635181.769333:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001cc1e762/0xb0c3a59caa40ea2e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635181.769339:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001cc1e762/0xb0c3a59caa40ea2e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789635181.769358:0:6509:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789635181.781274:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e995f888 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+5:6491:x1876568427200768:12345-0@lo:253: Request processed in 30959us (31242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635181.781294:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789635181.781423:0:6491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006343abb2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:6491:1876568427200768:0@lo:253: 10000000:01000000:2.0:1789635181.781438:0:6491:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789635181.781441:0:6491:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789635181.781443:0:6491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789635181.781444:0:6491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789635181.781446:0:6491:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1789635181.781447:0:6491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789635181.781448:0:6491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789635181.781449:0:6491:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789635181.781450:0:6491:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789635181.781451:0:6491:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789635181.781453:0:6491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789635181.781454:0:6491:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789635181.781471:0:6491:0:(tgt_mount.c:101:server_register_mount()) register mount 000000003bfd7196 from lustre-MDT0000 10000000:01000000:2.0:1789635181.781501:0:6491:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789635181.781504:0:6491:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789635181.781509:0:6491:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d057ae4b380 10000000:01000000:2.0:1789635181.781513:0:6491:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789635181.781527:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d057ae4b380 from 1 10000000:01000000:2.0:1789635181.781529:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789635181.781572:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 000000008929988d/0xb0c3a59caa40ea35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635181.781583:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 000000008929988d/0xb0c3a59caa40ea35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635181.781592:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 000000008929988d/0xb0c3a59caa40ea35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635181.781635:0:6491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006343abb2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:6491:1876568427200896:0@lo:101: 00000100:00100000:2.0:1789635181.781670:0:6491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635181.781720:0:6491:0:(client.c:2716:ptlrpc_set_wait()) set 0000000074ae0d08 going to sleep for 11 seconds 00000100:00100000:1.0:1789635181.781941:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427200896 00000100:00100000:1.0:1789635181.781948:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427200896 00000100:00100000:1.0:1789635181.781977:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789635181.781985:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eed41478 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+5:6491:x1876568427200896:12345-0@lo:101: 00010000:00010000:1.0:1789635181.782004:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635181.782017:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a3282caf/0xb0c3a59caa40ea3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ea35 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635181.782038:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a3282caf/0xb0c3a59caa40ea3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ea35 expref: 6 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635181.782047:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a3282caf/0xb0c3a59caa40ea3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ea35 expref: 6 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635181.782055:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a3282caf, rc 0) 00000100:00100000:1.0:1789635181.782107:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eed41478 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+6:6491:x1876568427200896:12345-0@lo:101: Request processed in 123us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635181.782114:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789635181.782215:0:6491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006343abb2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:6491:1876568427200896:0@lo:101: 00010000:00010000:2.0:1789635181.782226:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 000000008929988d/0xb0c3a59caa40ea35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ea3c expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635181.782234:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 000000008929988d/0xb0c3a59caa40ea35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ea3c expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635181.782279:0:6491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006343abb2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:6491:1876568427201024:0@lo:501: 00000100:00100000:2.0:1789635181.782304:0:6491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635181.782351:0:6491:0:(client.c:2716:ptlrpc_set_wait()) set 0000000074ae0d08 going to sleep for 11 seconds 00000100:00100000:1.0:1789635181.782458:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427201024 00000100:00100000:1.0:1789635181.782464:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427201024 00000100:00100000:1.0:1789635181.782497:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789635181.782503:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bb30c94e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+6:6491:x1876568427201024:12345-0@lo:501: 00000100:00100000:1.0:1789635181.782583:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bb30c94e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+6:6491:x1876568427201024:12345-0@lo:501: Request processed in 80us (278us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789635181.782590:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789635181.782682:0:6491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006343abb2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:6491:1876568427201024:0@lo:501: 10000000:01000000:0.0:1789635181.782707:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789635181.782733:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 000000008929988d/0xb0c3a59caa40ea35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ea3c expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635181.782741:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 000000008929988d/0xb0c3a59caa40ea35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ea3c expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635181.782747:0:6491:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d0558960000 10000000:01000000:0.0:1789635181.782752:0:6491:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789635181.782755:0:6491:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d0558960000 10000000:01000000:0.0:1789635181.782758:0:6491:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789635181.782760:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d0558960000 from 1 10000000:01000000:0.0:1789635181.782763:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789635181.782790:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 00000000a2fc433b/0xb0c3a59caa40ea43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635181.782797:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 00000000a2fc433b/0xb0c3a59caa40ea43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635181.782804:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 00000000a2fc433b/0xb0c3a59caa40ea43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635181.782815:0:6491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ef1aa31e pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:6491:1876568427201152:0@lo:101: 00000100:00100000:0.0:1789635181.782843:0:6491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635181.782864:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427201152 00000100:00100000:0.0:1789635181.782869:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427201152 00000100:00100000:0.0:1789635181.782892:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789635181.782897:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e8a1a3ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+6:6491:x1876568427201152:12345-0@lo:101: 00010000:00010000:0.0:1789635181.782905:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635181.782915:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002bd3816c/0xb0c3a59caa40ea4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ea43 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635181.782947:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002bd3816c/0xb0c3a59caa40ea4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ea43 expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635181.782955:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002bd3816c/0xb0c3a59caa40ea4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ea43 expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635181.782962:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002bd3816c, rc 0) 00000100:00100000:0.0:1789635181.782987:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e8a1a3ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+7:6491:x1876568427201152:12345-0@lo:101: Request processed in 91us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635181.782993:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789635181.783024:0:6491:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d273b1f going to sleep for 11 seconds 00000100:00100000:0.0:1789635181.783038:0:6491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ef1aa31e pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:6491:1876568427201152:0@lo:101: 00010000:00010000:0.0:1789635181.783047:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 00000000a2fc433b/0xb0c3a59caa40ea43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ea4a expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635181.783055:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 00000000a2fc433b/0xb0c3a59caa40ea43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ea4a expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635181.783066:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789635181.783069:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 00000000a2fc433b/0xb0c3a59caa40ea43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ea4a expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635181.783074:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 00000000a2fc433b/0xb0c3a59caa40ea43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ea4a expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635181.783080:0:6491:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789635181.783084:0:6491:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789635181.783088:0:6491:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d0558960000 10000000:01000000:0.0:1789635181.783095:0:6491:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789635181.783098:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789635181.783100:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789635181.783114:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 0000000079a2551d/0xb0c3a59caa40ea51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635181.783121:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 0000000079a2551d/0xb0c3a59caa40ea51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635181.783127:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 0000000079a2551d/0xb0c3a59caa40ea51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635181.783138:0:6491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ef1aa31e pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:6491:1876568427201280:0@lo:101: 00000100:00100000:0.0:1789635181.783162:0:6491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635181.783182:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427201280 00000100:00100000:0.0:1789635181.783186:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427201280 00000100:00100000:0.0:1789635181.783206:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789635181.783211:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000096b2fd42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+7:6491:x1876568427201280:12345-0@lo:101: 00010000:00010000:0.0:1789635181.783218:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635181.783224:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c2c2797e/0xb0c3a59caa40ea58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ea51 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635181.783236:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c2c2797e/0xb0c3a59caa40ea58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ea51 expref: 8 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635181.783243:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c2c2797e/0xb0c3a59caa40ea58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ea51 expref: 8 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635181.783249:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c2c2797e, rc 0) 00000100:00100000:0.0:1789635181.783272:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000096b2fd42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+8:6491:x1876568427201280:12345-0@lo:101: Request processed in 62us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635181.783282:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789635181.783326:0:6491:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d273b1f going to sleep for 11 seconds 00000100:00100000:0.0:1789635181.783339:0:6491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ef1aa31e pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:6491:1876568427201280:0@lo:101: 00010000:00010000:0.0:1789635181.783348:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 0000000079a2551d/0xb0c3a59caa40ea51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ea58 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635181.783355:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 0000000079a2551d/0xb0c3a59caa40ea51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ea58 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635181.783445:0:6491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ef1aa31e pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:6491:1876568427201408:0@lo:501: 00000100:00100000:0.0:1789635181.783471:0:6491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635181.783492:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427201408 00000100:00100000:0.0:1789635181.783496:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427201408 00000100:00100000:0.0:1789635181.783518:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789635181.783523:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6a3e39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+8:6491:x1876568427201408:12345-0@lo:501: 00000100:00100000:0.0:1789635181.783640:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6a3e39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+9:6491:x1876568427201408:12345-0@lo:501: Request processed in 116us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635181.783646:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789635181.783672:0:6491:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d273b1f going to sleep for 11 seconds 00000100:00100000:0.0:1789635181.783684:0:6491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ef1aa31e pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:6491:1876568427201408:0@lo:501: 00000100:00100000:0.0:1789635181.783709:0:6491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ef1aa31e pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:6491:1876568427201536:0@lo:503: 00000100:00100000:0.0:1789635181.783744:0:6491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635181.783764:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427201536 00000100:00100000:0.0:1789635181.783768:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427201536 00000100:00100000:0.0:1789635181.783788:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789635181.783792:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000069eb61bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+9:6491:x1876568427201536:12345-0@lo:503: 00000100:00100000:0.0:1789635181.783866:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000069eb61bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+9:6491:x1876568427201536:12345-0@lo:503: Request processed in 73us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635181.783872:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789635181.783904:0:6491:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d273b1f going to sleep for 11 seconds 00000100:00100000:0.0:1789635181.783916:0:6491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ef1aa31e pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:6491:1876568427201536:0@lo:503: 00000100:00100000:2.0:1789635181.784771:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000fbfdc4a pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:6536:1876568427201664:0@lo:502: 00000100:00100000:2.0:1789635181.784820:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635181.784846:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c6acdf64 going to sleep for 11 seconds 00000100:00100000:0.0:1789635181.784908:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427201664 00000100:00100000:0.0:1789635181.784914:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427201664 00000100:00100000:0.0:1789635181.784944:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789635181.784950:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001b46e90c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+9:6536:x1876568427201664:12345-0@lo:502: 00000100:00100000:0.0:1789635181.785080:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001b46e90c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+9:6536:x1876568427201664:12345-0@lo:502: Request processed in 130us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635181.785087:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789635181.790740:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000fbfdc4a pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:6536:1876568427201664:0@lo:502: 00000020:01000000:2.0:1789635181.790821:0:6536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789635181.790833:0:6536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635181.790835:0:6536:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789635181.790840:0:6536:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789635181.790843:0:6536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789635181.790871:0:6536:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000d7ede5bd) 00000020:00000080:2.0:1789635181.790890:0:6536:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789635181.790897:0:6536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789635181.791038:0:6536:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789635181.791045:0:6536:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb0c3a59caa40ea66 00000020:00000080:2.0:1789635181.791259:0:6536:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789635181.791264:0:6536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789635181.791268:0:6536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635181.791270:0:6536:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789635181.791272:0:6536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789635181.791276:0:6536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635181.791278:0:6536:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789635181.791281:0:6536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789635181.791288:0:6536:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000ac9125df) 00000020:00000080:2.0:1789635181.791297:0:6536:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789635181.791301:0:6536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789635181.791302:0:6536:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789635181.792536:0:6536:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789635181.792558:0:6536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789635181.792763:0:6536:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003bfd7196 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789635181.792780:0:6536:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000009e104e74) 00000020:00000080:2.0:1789635181.792807:0:6536:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789635181.792874:0:6536:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789635181.792880:0:6536:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb0c3a59caa40ea7b 00000020:00000080:2.0:1789635181.792997:0:6536:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789635181.793003:0:6536:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789635181.793006:0:6536:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xb0c3a59caa40ea82 00080000:01000000:2.0:1789635181.793011:0:6536:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789635181.793020:0:6536:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb0c3a59caa40ea89 00080000:10000000:2.0:1789635181.794970:0:6536:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1789635181.795173:0:6536:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1789635181.802569:0:6536:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1789635181.912379:0:6536:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1789635181.912764:0:6536:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1789635181.919500:0:6536:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1789635181.920061:0:6536:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789635181.929329:0:6536:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000005179661b) 00000020:00000080:1.0:1789635181.929349:0:6536:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789635181.929424:0:6536:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789635181.929430:0:6536:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb0c3a59caa40ea97 00000020:00000080:1.0:1789635181.930710:0:6536:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1789635181.931450:0:6536:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1789635181.945923:0:6536:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1789635181.948686:0:6536:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1789635181.950850:0:6536:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1789635181.952857:0:6536:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1789635181.955283:0:6536:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1789635181.959961:0:6536:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xb0c3a59caa40ea9e 00000020:00000080:2.0:1789635181.960558:0:6536:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789635181.960570:0:6536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789635181.960577:0:6536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635181.960579:0:6536:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789635181.960582:0:6536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789635181.960586:0:6536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635181.960588:0:6536:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789635181.960728:0:6536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789635181.960730:0:6536:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789635181.960734:0:6536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789635181.960736:0:6536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635181.960738:0:6536:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789635181.960740:0:6536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789635181.960745:0:6536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635181.960747:0:6536:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789635181.960751:0:6536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789635181.960790:0:6536:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1789635181.960843:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000fbfdc4a pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:6536:1876568427201792:0@lo:502: 00000100:00100000:2.0:1789635181.960918:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635181.960973:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set 000000001d1a507f going to sleep for 11 seconds 00000100:00100000:1.0:1789635181.961031:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427201792 00000100:00100000:1.0:1789635181.961039:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427201792 00000100:00100000:1.0:1789635181.961078:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789635181.961087:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000087231b5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+9:6536:x1876568427201792:12345-0@lo:502: 00000100:00100000:1.0:1789635181.961206:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000087231b5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+9:6536:x1876568427201792:12345-0@lo:502: Request processed in 121us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635181.961214:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789635181.961465:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000fbfdc4a pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:6536:1876568427201792:0@lo:502: 00000020:01000000:2.0:1789635181.961497:0:6536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789635181.961501:0:6536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635181.961503:0:6536:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1789635181.961506:0:6536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1789635181.961693:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1789635181.961714:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789635181.961727:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 0000000079a2551d/0xb0c3a59caa40ea51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ea58 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635181.961736:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 0000000079a2551d/0xb0c3a59caa40ea51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ea58 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635181.961756:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d0558960000 from 1 10000000:01000000:1.0:1789635181.961759:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789635181.961787:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 00000000785530c2/0xb0c3a59caa40eaa5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635181.961795:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 00000000785530c2/0xb0c3a59caa40eaa5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635181.961803:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 00000000785530c2/0xb0c3a59caa40eaa5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635181.961815:0:6491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000969b03cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:6491:1876568427201920:0@lo:101: 00000100:00100000:1.0:1789635181.961844:0:6491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635181.961869:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427201920 00000100:00100000:1.0:1789635181.961879:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427201920 00000100:00100000:1.0:1789635181.961904:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789635181.961910:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000453a2f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+9:6491:x1876568427201920:12345-0@lo:101: 00010000:00010000:1.0:1789635181.961920:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635181.961931:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000328d38f1/0xb0c3a59caa40eaac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40eaa5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635181.961952:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000328d38f1/0xb0c3a59caa40eaac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40eaa5 expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635181.961960:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000328d38f1/0xb0c3a59caa40eaac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40eaa5 expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635181.961967:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000328d38f1, rc 0) 00000100:00100000:1.0:1789635181.961989:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000453a2f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+10:6491:x1876568427201920:12345-0@lo:101: Request processed in 80us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635181.961995:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789635181.962028:0:6491:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d6c72ab2 going to sleep for 11 seconds 00000100:00100000:1.0:1789635181.962040:0:6491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000969b03cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:6491:1876568427201920:0@lo:101: 00010000:00010000:1.0:1789635181.962050:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 00000000785530c2/0xb0c3a59caa40eaa5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40eaac expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635181.962057:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 00000000785530c2/0xb0c3a59caa40eaa5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40eaac expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635181.963041:0:6491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000969b03cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:6491:1876568427202048:0@lo:256: 00000100:00100000:1.0:1789635181.964150:0:6491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635181.964264:0:6491:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d6c72ab2 going to sleep for 11 seconds 00000100:00100000:2.0:1789635181.968978:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427202048 00000100:00100000:2.0:1789635181.968994:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427202048 00000100:00100000:2.0:1789635181.969040:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789635181.969049:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001b53e0dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+10:6491:x1876568427202048:12345-0@lo:256: 20000000:01000000:2.0:1789635181.969073:0:6509:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789635181.969078:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789635181.969203:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001b53e0dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+10:6491:x1876568427202048:12345-0@lo:256: Request processed in 155us (5056us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635181.969210:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789635181.969273:0:6491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000969b03cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:6491:1876568427202048:0@lo:256: 10000000:01000000:0.0:1789635181.969890:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789635181.969917:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 00000000785530c2/0xb0c3a59caa40eaa5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40eaac expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635181.969929:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 00000000785530c2/0xb0c3a59caa40eaa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40eaac expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635181.969937:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0558960000 from 1 10000000:01000000:0.0:1789635181.969940:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789635181.969973:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 00000000d149d74f/0xb0c3a59caa40eab3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635181.969981:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 00000000d149d74f/0xb0c3a59caa40eab3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635181.970005:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 00000000d149d74f/0xb0c3a59caa40eab3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635181.970024:0:6491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ef1aa31e pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:6491:1876568427202176:0@lo:101: 00000100:00100000:0.0:1789635181.970078:0:6491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635181.970123:0:6491:0:(client.c:2716:ptlrpc_set_wait()) set 0000000050a82461 going to sleep for 11 seconds 00000100:00100000:2.0:1789635181.970191:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427202176 00000100:00100000:2.0:1789635181.970198:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427202176 00000100:00100000:2.0:1789635181.970242:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789635181.970252:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009a20e328 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+10:6491:x1876568427202176:12345-0@lo:101: 00010000:00010000:2.0:1789635181.970264:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635181.970280:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000443756f2/0xb0c3a59caa40eaba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40eab3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635181.970300:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000443756f2/0xb0c3a59caa40eaba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40eab3 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635181.970329:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000443756f2/0xb0c3a59caa40eaba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40eab3 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635181.970338:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000443756f2, rc 0) 00000100:00100000:2.0:1789635181.970378:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009a20e328 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+11:6491:x1876568427202176:12345-0@lo:101: Request processed in 129us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635181.970392:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789635181.970461:0:6491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ef1aa31e pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:6491:1876568427202176:0@lo:101: 00010000:00010000:0.0:1789635181.970473:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 00000000d149d74f/0xb0c3a59caa40eab3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40eaba expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635181.970482:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 00000000d149d74f/0xb0c3a59caa40eab3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40eaba expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635181.970534:0:6491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ef1aa31e pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:6491:1876568427202304:0@lo:501: 00000100:00100000:0.0:1789635181.970557:0:6491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635181.970656:0:6491:0:(client.c:2716:ptlrpc_set_wait()) set 0000000050a82461 going to sleep for 11 seconds 00000100:00100000:1.0:1789635181.973895:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427202304 00000100:00100000:1.0:1789635181.973925:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427202304 00000100:00100000:1.0:1789635181.973984:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789635181.973994:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b9c62092 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+11:6491:x1876568427202304:12345-0@lo:501: 00000100:00100000:1.0:1789635181.974397:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b9c62092 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+11:6491:x1876568427202304:12345-0@lo:501: Request processed in 404us (3838us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635181.974414:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789635181.977028:0:6491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ef1aa31e pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:6491:1876568427202304:0@lo:501: 00000100:00100000:0.0:1789635181.977289:0:6491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ef1aa31e pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:6491:1876568427202432:0@lo:503: 00000100:00100000:0.0:1789635181.977371:0:6491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635181.977528:0:6491:0:(client.c:2716:ptlrpc_set_wait()) set 0000000050a82461 going to sleep for 11 seconds 00000100:00100000:3.0:1789635181.977951:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427202432 00000100:00100000:3.0:1789635181.977959:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427202432 00000100:00100000:3.0:1789635181.978009:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789635181.978016:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c623e1c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+11:6491:x1876568427202432:12345-0@lo:503: 00000040:00080000:3.0:1789635181.978081:0:6509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789635181.978145:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c623e1c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+11:6491:x1876568427202432:12345-0@lo:503: Request processed in 129us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635181.978153:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789635181.978722:0:6491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ef1aa31e pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:6491:1876568427202432:0@lo:503: 00000040:00080000:0.0:1789635181.979782:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1789635181.983930:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1789635181.983964:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789635181.983986:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 00000000d149d74f/0xb0c3a59caa40eab3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40eaba expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635181.983999:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 00000000d149d74f/0xb0c3a59caa40eab3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40eaba expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635181.984221:0:6491:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789635181.984224:0:6491:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d0558960000 10000000:01000000:1.0:1789635181.984227:0:6491:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d0558960000 10000000:01000000:1.0:1789635181.984231:0:6491:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789635181.984236:0:6491:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d0558960000 from 1 10000000:01000000:1.0:1789635181.984239:0:6491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789635181.984270:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 0000000043fb7bce/0xb0c3a59caa40eac1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635181.984278:0:6491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 0000000043fb7bce/0xb0c3a59caa40eac1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635181.984288:0:6491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 0000000043fb7bce/0xb0c3a59caa40eac1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635181.984307:0:6491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002c7a7574 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:6491:1876568427202560:0@lo:101: 00000100:00100000:1.0:1789635181.984477:0:6491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635181.984560:0:6491:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c3d9987 going to sleep for 11 seconds 00000100:00100000:2.0:1789635181.990768:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427202560 00000100:00100000:2.0:1789635181.990784:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427202560 00000100:00100000:2.0:1789635181.990844:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789635181.990853:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002b5a6673 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+11:6491:x1876568427202560:12345-0@lo:101: 00010000:00010000:2.0:1789635181.990870:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635181.990888:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009a612eab/0xb0c3a59caa40eac8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40eac1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635181.990915:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009a612eab/0xb0c3a59caa40eac8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40eac1 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635181.990926:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009a612eab/0xb0c3a59caa40eac8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40eac1 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635181.990934:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009a612eab, rc 0) 00000100:00100000:2.0:1789635181.991105:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002b5a6673 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+12:6491:x1876568427202560:12345-0@lo:101: Request processed in 253us (6628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635181.991113:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789635181.993008:0:6491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002c7a7574 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:6491:1876568427202560:0@lo:101: 00010000:00010000:1.0:1789635181.993047:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 0000000043fb7bce/0xb0c3a59caa40eac1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40eac8 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635181.993058:0:6491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 0000000043fb7bce/0xb0c3a59caa40eac1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40eac8 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635181.993140:0:6491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002c7a7574 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:6491:1876568427202688:0@lo:501: 00000100:00100000:1.0:1789635181.993190:0:6491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635181.993232:0:6491:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c3d9987 going to sleep for 11 seconds 00000100:00100000:2.0:1789635181.994052:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427202688 00000100:00100000:2.0:1789635181.994061:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427202688 00000100:00100000:2.0:1789635181.994113:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789635181.994120:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000035ca02a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+12:6491:x1876568427202688:12345-0@lo:501: 00000100:00100000:2.0:1789635181.994394:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000035ca02a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+12:6491:x1876568427202688:12345-0@lo:501: Request processed in 272us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635181.994411:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789635181.994994:0:6491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002c7a7574 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:6491:1876568427202688:0@lo:501: 00000100:00100000:0.0:1789635181.995047:0:6491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ef1aa31e pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:6491:1876568427202816:0@lo:503: 00000100:00100000:0.0:1789635181.995106:0:6491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635181.995139:0:6491:0:(client.c:2716:ptlrpc_set_wait()) set 0000000050a82461 going to sleep for 11 seconds 00000100:00100000:2.0:1789635181.995627:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427202816 00000100:00100000:2.0:1789635181.995635:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427202816 00000100:00100000:2.0:1789635181.995680:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789635181.995686:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001a5870c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+12:6491:x1876568427202816:12345-0@lo:503: 00000100:00100000:2.0:1789635181.995786:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001a5870c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+12:6491:x1876568427202816:12345-0@lo:503: Request processed in 100us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635181.995793:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789635181.995924:0:6491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ef1aa31e pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:6491:1876568427202816:0@lo:503: 00000100:00100000:3.0:1789635181.996770:0:6541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000023772bc6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:6541:1876568427202944:0@lo:502: 00000100:00100000:3.0:1789635181.996830:0:6541:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635181.996902:0:6541:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b89fd130 going to sleep for 11 seconds 00000100:00100000:2.0:1789635181.996944:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427202944 00000100:00100000:2.0:1789635181.996951:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427202944 00000100:00100000:2.0:1789635181.997022:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789635181.997030:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003af26941 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+12:6541:x1876568427202944:12345-0@lo:502: 00000100:00100000:2.0:1789635181.997142:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003af26941 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+12:6541:x1876568427202944:12345-0@lo:502: Request processed in 114us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635181.997150:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789635181.997217:0:6541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000023772bc6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:6541:1876568427202944:0@lo:502: 00000020:01000004:0.0:1789635181.997271:0:6541:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789635181.997289:0:6541:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000006285dd3c) 00000020:00000080:0.0:1789635181.997305:0:6541:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1789635181.997388:0:6541:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003bfd7196 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789635181.997393:0:6541:0:(tgt_mount.c:187:server_put_mount()) put mount 000000003bfd7196 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789635181.997395:0:6541:0:(obd_mount.c:710:lustre_put_lsi()) put 000000003bfd7196 4 00010000:00080000:0.0:1789635181.997431:0:6541:0:(ldlm_lib.c:102:import_set_conn()) imp 000000007e19d1f5@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.120@tcp at head 00010000:00010000:0.0:1789635181.999156:0:6541:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1789635181.999355:0:6541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789635181.999390:0:6541:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789635181.999402:0:6541:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xb0c3a59caa40ead6 00000100:00080000:0.0:1789635181.999410:0:6541:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789635181.999419:0:6541:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000007e19d1f5 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1789635181.999449:0:6541:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ef1aa31e x1876568427203072/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789635181.999491:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ef1aa31e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876568427203072:0@lo:38: 00000100:00100000:0.0:1789635181.999548:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789635181.999628:0:6541:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789635182.001951:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427203072 00000100:00100000:3.0:1789635182.001966:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427203072 00000100:00100000:3.0:1789635182.002009:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789635182.002016:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000039b2c95a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1876568427203072:12345-0@lo:38: 00000100:00100000:3.0:1789635182.002133:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000039b2c95a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1876568427203072:12345-0@lo:38: Request processed in 116us (2585us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789635182.002140:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789635182.002188:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789635182.002194:0:3639:0:(import.c:65:import_set_state_nolock()) 000000007e19d1f5 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789635182.002198:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789635182.002200:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ef1aa31e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876568427203072:0@lo:38: 00000100:00100000:0.0:1789635182.010086:0:6541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000652df4e0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:6541:1876568427203200:0@lo:502: 00000100:00100000:0.0:1789635182.010157:0:6541:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635182.010204:0:6541:0:(client.c:2716:ptlrpc_set_wait()) set 000000008754f67a going to sleep for 11 seconds 00000100:00100000:3.0:1789635182.010285:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427203200 00000100:00100000:3.0:1789635182.010292:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427203200 00000100:00100000:3.0:1789635182.010349:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789635182.010357:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004dcc5215 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+12:6541:x1876568427203200:12345-0@lo:502: 00000100:00100000:3.0:1789635182.010489:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004dcc5215 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+12:6541:x1876568427203200:12345-0@lo:502: Request processed in 133us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635182.010497:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789635182.011731:0:6541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000652df4e0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:6541:1876568427203200:0@lo:502: 00000040:00080000:0.0:1789635182.011785:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1789635182.011950:0:6491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1789635182.012137:0:6491:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789635182.012159:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 0000000043fb7bce/0xb0c3a59caa40eac1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40eac8 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635182.012170:0:6491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 0000000043fb7bce/0xb0c3a59caa40eac1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40eac8 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789635182.012215:0:6491:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789635182.012217:0:6491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789635182.012219:0:6491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789635182.012220:0:6491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789635182.012221:0:6491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789635182.012222:0:6491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789635182.012223:0:6491:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789635182.012225:0:6491:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789635182.012226:0:6491:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789635182.012227:0:6491:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789635182.012229:0:6491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789635182.012230:0:6491:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789635182.012236:0:6491:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1789635182.012238:0:6491:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789635182.012239:0:6491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789635182.012240:0:6491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789635182.012241:0:6491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789635182.012242:0:6491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789635182.012243:0:6491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789635182.012244:0:6491:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789635182.012245:0:6491:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789635182.012246:0:6491:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789635182.012246:0:6491:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789635182.012247:0:6491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789635182.012248:0:6491:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789635182.012268:0:6491:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789635182.012279:0:6491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002b09a3b8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:6491:1876568427203328:0@lo:253: 00000100:00100000:1.0:1789635182.012338:0:6491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635182.012576:0:6491:0:(client.c:2716:ptlrpc_set_wait()) set 0000000055e37895 going to sleep for 11 seconds 00000100:00100000:0.0:1789635182.012713:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427203328 00000100:00100000:0.0:1789635182.012721:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427203328 00000100:00100000:0.0:1789635182.012848:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789635182.012857:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000062ff57b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+12:6491:x1876568427203328:12345-0@lo:253: 20000000:01000000:0.0:1789635182.012882:0:6506:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789635182.012896:0:6506:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789635182.020187:0:6506:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789635182.020203:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789635182.020213:0:6530:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789635182.020218:0:6530:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789635182.020236:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000010729d41/0xb0c3a59caa40eadd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635182.020253:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000328d38f1/0xb0c3a59caa40eaac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40eaa5 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635182.020261:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000010729d41/0xb0c3a59caa40eadd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635182.020297:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000328d38f1/0xb0c3a59caa40eaac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40eaa5 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635182.020311:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000328d38f1/0xb0c3a59caa40eaac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40eaa5 expref: 12 pid: 6509 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635182.020335:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000fbfdc4a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1876568427203456:0@lo:104: 00000100:00100000:2.0:1789635182.020404:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635182.020512:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set 00000000153b7792 going to sleep for 11 seconds 00000100:00100000:1.0:1789635182.021233:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427203456 00000100:00100000:1.0:1789635182.021242:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427203456 00000100:00100000:1.0:1789635182.021291:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789635182.021299:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000776bce3a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+3:6530:x1876568427203456:12345-0@lo:104: 00010000:00010000:1.0:1789635182.021310:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: 00000000785530c2/0xb0c3a59caa40eaa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40eaac expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635182.021377:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789635182.021382:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000776bce3a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+3:6530:x1876568427203456:12345-0@lo:104: Request processed in 85us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635182.021389:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789635182.021511:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635182.021517:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: 00000000785530c2/0xb0c3a59caa40eaa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40eaac expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635182.021525:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000785530c2 already unused, calling callback (00000000af9d8a27) 10000000:00010000:3.0:1789635182.021528:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: 00000000785530c2/0xb0c3a59caa40eaa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40eaac expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635182.021535:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: 00000000785530c2/0xb0c3a59caa40eaa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40eaac expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789635182.021541:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: 00000000785530c2/0xb0c3a59caa40eaa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40eaac expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635182.021559:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789635182.021617:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: 00000000785530c2/0xb0c3a59caa40eaa5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40eaac expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635182.021625:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789635182.021638:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: 00000000785530c2/0xb0c3a59caa40eaa5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40eaac expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635182.021644:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: 00000000785530c2/0xb0c3a59caa40eaa5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40eaac expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635182.021662:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635182.021663:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635182.021665:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635182.021710:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000062ff57b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+12:6491:x1876568427203328:12345-0@lo:253: Request processed in 8854us (9372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635182.021718:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789635182.021889:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000153054e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427203584:0@lo:103: 00000100:00100000:2.0:1789635182.021920:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635182.022021:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000fbfdc4a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1876568427203456:0@lo:104: 00010000:00010000:2.0:1789635182.022049:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000010729d41/0xb0c3a59caa40eadd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635182.022236:0:6491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002b09a3b8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:6491:1876568427203328:0@lo:253: 10000000:01000000:1.0:1789635182.022247:0:6491:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789635182.022257:0:6491:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789635182.022259:0:6491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789635182.022260:0:6491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789635182.022261:0:6491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789635182.022262:0:6491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789635182.022263:0:6491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789635182.022265:0:6491:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789635182.022266:0:6491:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789635182.022267:0:6491:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789635182.022269:0:6491:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789635182.022270:0:6491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789635182.022271:0:6491:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789635182.022282:0:6491:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789635182.023185:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427203584 00000100:00100000:3.0:1789635182.023195:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427203584 00010000:00010000:3.0:1789635182.023223:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000328d38f1/0xb0c3a59caa40eaac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40eaa5 expref: 12 pid: 6509 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635182.023252:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789635182.023260:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007d09f3ad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+12:3641:x1876568427203584:12345-0@lo:103: 00010000:00010000:3.0:1789635182.023272:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635182.023277:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000328d38f1/0xb0c3a59caa40eaac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40eaa5 expref: 12 pid: 6509 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635182.023286:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000328d38f1/0xb0c3a59caa40eaac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40eaa5 expref: 12 pid: 6509 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635182.023310:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000328d38f1/0xb0c3a59caa40eaac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40eaa5 expref: 12 pid: 6509 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635182.023337:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000010729d41/0xb0c3a59caa40eadd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635182.023345:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000010729d41/0xb0c3a59caa40eadd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789635182.023360:0:6499:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003143292s 00010000:00010000:3.0:1789635182.023364:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000010729d41/0xb0c3a59caa40eadd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635182.023370:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000010729d41/0xb0c3a59caa40eadd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635182.023376:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000010729d41/0xb0c3a59caa40eadd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635182.023381:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000010729d41/0xb0c3a59caa40eadd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635182.023386:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000010729d41 already unused, calling callback (0000000034729756) 00010000:00010000:3.0:1789635182.023389:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000010729d41/0xb0c3a59caa40eadd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635182.023395:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000010729d41/0xb0c3a59caa40eadd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635182.023406:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000010729d41/0xb0c3a59caa40eadd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635182.023427:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635182.023478:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007d09f3ad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+11:3641:x1876568427203584:12345-0@lo:103: Request processed in 220us (1558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635182.023485:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789635182.023949:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000153054e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427203584:0@lo:103: 00010000:00010000:2.0:1789635182.023973:0:6530:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000010729d41/0xb0c3a59caa40eadd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635182.023980:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000010729d41/0xb0c3a59caa40eadd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635182.023985:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000010729d41/0xb0c3a59caa40eadd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1789635182.034969:0:6491:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:1.0:1789635182.035295:0:6491:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1789635182.035505:0:6491:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:1.0:1789635182.035708:0:6491:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1789635182.035913:0:6491:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:1.0:1789635182.036356:0:6491:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1789635182.039685:0:6491:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1789635182.039872:0:6491:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1789635182.040781:0:6491:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1789635182.041001:0:6491:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1789635182.041367:0:6491:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1789635182.041533:0:6491:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:0.0:1789635182.055848:0:6491:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1789635182.067580:0:6491:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1789635182.067884:0:6547:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:3.0:1789635182.068818:0:6546:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1789635182.068823:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789635182.069884:0:6491:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789635182.070011:0:6491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789635182.070791:0:6491:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789635182.070800:0:6491:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789635182.070920:0:6491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789635182.072337:0:6491:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789635182.074815:0:6491:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789635182.074879:0:6491:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789635182.075373:0:6491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789635182.075641:0:6491:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:3.0:1789635182.076426:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789635182.076563:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789635182.076818:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789635182.076951:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789635182.077230:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789635182.077383:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789635182.077708:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789635182.077859:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789635182.078036:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789635182.078475:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789635182.078719:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789635182.078877:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789635182.079010:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789635182.079265:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789635182.080747:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1789635182.080948:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00000040:00080000:1.0:1789635182.081541:0:6547:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789635182.088361:0:6547:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789635182.088444:0:6547:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789635182.088448:0:6547:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:3.0:1789635182.092961:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1789635182.093148:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1789635182.093312:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1789635182.093482:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1789635182.093665:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1789635182.093834:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1789635182.093983:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1789635182.094136:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1789635182.094274:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1789635182.094451:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1789635182.094614:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1789635182.094788:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1789635182.094927:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1789635182.095085:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1789635182.095242:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1789635182.095404:0:6491:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1789635182.095622:0:6491:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1789635182.107381:0:6491:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789635182.107431:0:6491:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa6bb4197b988 00100000:10000000:3.0:1789635182.107439:0:6491:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789635182.108128:0:6491:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789635182.108144:0:6491:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.120@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789635182.108162:0:6491:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789635182.108177:0:6491:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1789635182.108951:0:6491:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789635182.109125:0:6491:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1789635182.628730:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635183.656201:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635184.675813:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635185.704348:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789635186.326511:0:6792:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789635186.724587:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789635187.109148:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789635187.109158:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789635187.109161:0:8:0:(import.c:65:import_set_state_nolock()) 000000007e19d1f5 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789635187.109176:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000007e19d1f5 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1789635187.109198:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008f26b5c9 x1876568427203840/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789635187.109302:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000652df4e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427203712:0@lo:400: 00000100:00100000:0.0:1789635187.109375:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635187.109439:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f26b5c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876568427203840:0@lo:38: 00000100:00100000:0.0:1789635187.109463:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635187.109510:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427203712 00000100:00100000:0.0:1789635187.109517:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427203712 00000100:00100000:0.0:1789635187.109551:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789635187.109560:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000006df89ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+11:3642:x1876568427203712:12345-0@lo:400: 00000100:00100000:2.0:1789635187.109647:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427203840 00000100:00100000:2.0:1789635187.109653:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427203840 00000100:00100000:2.0:1789635187.109677:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789635187.109681:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000158e54e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1876568427203840:12345-0@lo:38: 00010000:00080000:2.0:1789635187.109702:0:6516:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 205 last 0 00000100:00100000:0.0:1789635187.109908:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000006df89ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+11:3642:x1876568427203712:12345-0@lo:400: Request processed in 349us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635187.109916:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000020:00000080:2.0:1789635187.109959:0:6516:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xb0c3a59caa40eae4 00000100:00100000:0.0:1789635187.109992:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000652df4e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427203712:0@lo:400: 00000004:00100000:2.0:1789635187.110005:0:6516:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789635187.110121:0:6516:0:(import.c:65:import_set_state_nolock()) 00000000fe4a4668 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789635187.110171:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000158e54e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876568427203840:12345-0@lo:38: Request processed in 488us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635187.110178:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789635187.110256:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008f26b5c9 x1876568427203840/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789635197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789635187.110270:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789635187.110286:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789635187.110290:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789635187.110292:0:3639:0:(import.c:65:import_set_state_nolock()) 000000007e19d1f5 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789635187.110297:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f26b5c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876568427203840:0@lo:38: 00000020:00000004:2.0:1789635187.206559:0:6844:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789635187.207155:0:6844:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789635187.751989:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635188.772559:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635189.797631:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789635189.808486:0:6945:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789635189.809888:0:6945:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1789635190.695655:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789635190.695662:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d0558960000 from 3 10000000:01000000:2.0:1789635190.695667:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789635190.695720:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 000000001139aef4/0xb0c3a59caa40eaeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635190.695732:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 000000001139aef4/0xb0c3a59caa40eaeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635190.695742:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 000000001139aef4/0xb0c3a59caa40eaeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635190.695764:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000fbfdc4a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427203968:0@lo:101: 00000100:00100000:2.0:1789635190.695826:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635190.695873:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 00000000decdad47 going to sleep for 11 seconds 00000100:00100000:0.0:1789635190.696112:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427203968 00000100:00100000:0.0:1789635190.696121:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427203968 00000100:00100000:0.0:1789635190.696180:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789635190.696188:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000716a9ab0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+11:6512:x1876568427203968:12345-0@lo:101: 00010000:00010000:0.0:1789635190.696201:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635190.696214:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fc2125df/0xb0c3a59caa40eaf2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40eaeb expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635190.696236:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fc2125df/0xb0c3a59caa40eaf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40eaeb expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635190.696273:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fc2125df/0xb0c3a59caa40eaf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40eaeb expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635190.696281:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fc2125df, rc 0) 00000100:00100000:0.0:1789635190.696324:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000716a9ab0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+12:6512:x1876568427203968:12345-0@lo:101: Request processed in 138us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635190.696331:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789635190.696374:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000fbfdc4a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427203968:0@lo:101: 00010000:00010000:0.0:1789635190.696387:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 000000001139aef4/0xb0c3a59caa40eaeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40eaf2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635190.696395:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 000000001139aef4/0xb0c3a59caa40eaeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40eaf2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635190.696440:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f26b5c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427204096:0@lo:256: 00000100:00100000:0.0:1789635190.696472:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635190.696487:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cf31b9a0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635190.696500:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427204096 00000100:00100000:0.0:1789635190.696503:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427204096 00000100:00100000:0.0:1789635190.696540:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789635190.696546:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ae745018 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+12:6512:x1876568427204096:12345-0@lo:256: 20000000:01000000:0.0:1789635190.696559:0:6509:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789635190.696574:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789635190.696577:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789635190.696667:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ae745018 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+12:6512:x1876568427204096:12345-0@lo:256: Request processed in 122us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635190.696673:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789635190.697073:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f26b5c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427204096:0@lo:256: 10000000:01000000:0.0:1789635190.697111:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789635190.697116:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 000000001139aef4/0xb0c3a59caa40eaeb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40eaf2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635190.697123:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 000000001139aef4/0xb0c3a59caa40eaeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40eaf2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635190.824917:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635191.853121:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635192.227897:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000094fef879 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427204352:0@lo:400: 00000100:00100000:1.0:1789635192.227972:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635192.229332:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d5334879 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427204224:0@lo:400: 00000100:00100000:3.0:1789635192.229390:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635192.229477:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427204352 00000100:00100000:3.0:1789635192.229485:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427204352 00000100:00100000:3.0:1789635192.229526:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789635192.229534:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002b09a3b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427204352:12345-0@lo:400: 00000100:00100000:2.0:1789635192.229618:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427204224 00000100:00100000:2.0:1789635192.229622:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427204224 00000100:00100000:2.0:1789635192.229654:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789635192.229660:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a78fa638 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+12:3643:x1876568427204224:12345-0@lo:400: 00000100:00100000:2.0:1789635192.229697:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a78fa638 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+12:3643:x1876568427204224:12345-0@lo:400: Request processed in 38us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635192.229704:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789635192.229755:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d5334879 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427204224:0@lo:400: 00000100:00100000:3.0:1789635192.231627:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002b09a3b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427204352:12345-0@lo:400: Request processed in 2086us (3648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635192.231640:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789635192.233571:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000094fef879 x1876568427204352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635192.234104:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000094fef879 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427204352:0@lo:400: 00010000:00010000:0.0:1789635192.870719:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635193.891952:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635194.916330:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635195.940676:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635196.971279:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635197.347964:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d5334879 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427204480:0@lo:400: 00000100:00100000:2.0:1789635197.348048:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635197.348111:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000026f0d866 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876568427204608:0@lo:400: 00000100:00100000:2.0:1789635197.348143:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635197.348181:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427204480 00000100:00100000:2.0:1789635197.348189:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427204480 00000100:00100000:2.0:1789635197.348242:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789635197.348250:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006eaebd45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+12:3641:x1876568427204480:12345-0@lo:400: 00000100:00100000:2.0:1789635197.348299:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006eaebd45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+12:3641:x1876568427204480:12345-0@lo:400: Request processed in 51us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635197.348307:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789635197.348337:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427204608 00000100:00100000:2.0:1789635197.348340:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427204608 00000100:00100000:2.0:1789635197.348365:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789635197.348371:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000090666e6d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876568427204608:12345-0@lo:400: 00000100:00100000:2.0:1789635197.348490:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000090666e6d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876568427204608:12345-0@lo:400: Request processed in 120us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635197.348498:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789635197.348537:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000026f0d866 x1876568427204608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635197.348550:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000026f0d866 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876568427204608:0@lo:400: 00000100:00100000:2.0:1789635197.348571:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d5334879 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427204480:0@lo:400: 00010000:00010000:1.0:1789635197.988054:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789635198.117080:0:7444:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789635198.117084:0:7444:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789635198.117085:0:7444:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789635198.117234:0:7444:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000c3275346 00000020:01000004:3.0:1789635198.117250:0:7444:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:3.0:1789635198.117259:0:7444:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789635198.117270:0:7444:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000b5bda7e5) 00000020:00000080:3.0:1789635198.117348:0:7444:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789635198.170014:0:7444:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1789635198.170072:0:7444:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:0.0:1789635198.184467:0:7444:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789635198.184746:0:7444:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1789635198.184756:0:7444:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789635198.184767:0:7444:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb0c3a59caa40eb00 00000020:01000004:0.0:1789635198.184773:0:7444:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789635198.184791:0:7444:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.120@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789635198.184793:0:7444:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789635198.184798:0:7444:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1789635198.184820:0:7444:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1789635198.184824:0:7444:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.120@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1789635198.199144:0:7444:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789635198.199183:0:7444:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.120@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1789635198.199187:0:7444:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789635198.199199:0:7444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789635198.199201:0:7444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789635198.199202:0:7444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789635198.199203:0:7444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789635198.199204:0:7444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789635198.199206:0:7444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789635198.199207:0:7444:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789635198.199209:0:7444:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789635198.199210:0:7444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789635198.199219:0:7444:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789635198.199222:0:7444:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1789635198.199224:0:7444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789635198.199225:0:7444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789635198.199226:0:7444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789635198.199227:0:7444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789635198.199227:0:7444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789635198.199228:0:7444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789635198.199229:0:7444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789635198.199230:0:7444:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789635198.199231:0:7444:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789635198.199231:0:7444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789635198.199232:0:7444:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789635198.199258:0:7444:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789635198.199275:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f26b5c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427204736:0@lo:253: 00000100:00100000:0.0:1789635198.199407:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635198.199542:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 000000001601d8dd going to sleep for 11 seconds 00000100:00100000:2.0:1789635198.199743:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427204736 00000100:00100000:2.0:1789635198.199751:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427204736 00000100:00100000:2.0:1789635198.199843:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789635198.199852:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e8cf8577 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+12:7444:x1876568427204736:12345-0@lo:253: 20000000:01000000:2.0:1789635198.199883:0:6509:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789635198.199887:0:6509:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:2.0:1789635198.199893:0:6509:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:2.0:1789635198.199896:0:6509:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:2.0:1789635198.199932:0:6509:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:2.0:1789635198.200114:0:6509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789635198.200250:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1789635198.200264:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789635198.200281:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1789635198.200298:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1789635198.200312:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1789635198.200376:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:2.0:1789635198.200384:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:2.0:1789635198.200397:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:2.0:1789635198.200402:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:2.0:1789635198.200413:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:2.0:1789635198.200419:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:2.0:1789635198.200431:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1789635198.200445:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1789635198.200551:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:2.0:1789635198.200561:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.120@tcp (null) (null) (null) 00000040:00080000:2.0:1789635198.200574:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:2.0:1789635198.200580:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789635198.200616:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:2.0:1789635198.200624:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.120@tcp (null) (null) 00000040:00080000:2.0:1789635198.200642:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:2.0:1789635198.200648:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1789635198.200660:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1789635198.200683:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1789635198.200693:0:6509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1789635198.200760:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:2.0:1789635198.200768:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:2.0:1789635198.200779:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1789635198.200796:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1789635198.200811:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:2.0:1789635198.200817:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:2.0:1789635198.200832:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1789635198.200854:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1789635198.200860:0:6509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:2.0:1789635198.200883:0:6509:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1789635198.200889:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:0.0:1789635198.201593:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1789635198.201888:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1789635198.201910:0:6509:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.120@tcp for mdt 20000000:01000000:2.0:1789635198.201912:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.120@tcp (null) (null) (null) 00000040:00080000:2.0:1789635198.201927:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1789635198.201933:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789635198.201947:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1789635198.201953:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.120@tcp (null) (null) 00000040:00080000:2.0:1789635198.201969:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1789635198.201977:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:2.0:1789635198.201990:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:2.0:1789635198.202081:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:2.0:1789635198.202128:0:6509:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:2.0:1789635198.202136:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1789635198.202565:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:2.0:1789635198.202776:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1789635198.202793:0:6509:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.120@tcp for mdt 20000000:01000000:2.0:1789635198.202795:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.120@tcp (null) (null) (null) 00000040:00080000:2.0:1789635198.202810:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1789635198.202816:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789635198.202840:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1789635198.202847:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.120@tcp (null) (null) 00000040:00080000:2.0:1789635198.202857:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1789635198.202862:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:2.0:1789635198.202871:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1789635198.202884:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:2.0:1789635198.202900:0:6509:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789635198.202903:0:6509:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789635198.202907:0:6509:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789635198.202949:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789635198.202951:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789635198.205651:0:7452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1789635198.205894:0:7452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1789635198.205921:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1789635198.206216:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1789635198.206240:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1789635198.206254:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1789635198.206265:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789635198.206267:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789635198.206964:0:7453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1789635198.206985:0:7453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1789635198.206998:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1789635198.207245:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1789635198.207276:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1789635198.207307:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1789635198.207317:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1789635198.207319:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789635198.207751:0:7454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1789635198.207777:0:7454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1789635198.207790:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:2.0:1789635198.207958:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1789635198.207977:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1789635198.207998:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:2.0:1789635198.208011:0:6509:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789635198.208021:0:6509:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789635198.208026:0:6509:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1789635198.208032:0:6509:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1789635198.208582:0:7455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1789635198.208710:0:6509:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789635198.225258:0:6509:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789635198.229763:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ec13b275/0xb0c3a59caa40eb07 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635198.229785:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a3282caf/0xb0c3a59caa40ea3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ea35 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635198.229791:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c2c2797e/0xb0c3a59caa40ea58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ea51 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635198.229810:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009a612eab/0xb0c3a59caa40eac8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40eac1 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635198.229817:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ec13b275/0xb0c3a59caa40eb07 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635198.229860:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009a612eab/0xb0c3a59caa40eac8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40eac1 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635198.229874:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009a612eab/0xb0c3a59caa40eac8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40eac1 expref: 12 pid: 6508 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635198.229888:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f4aa565f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6509:1876568427204864:0@lo:104: 00000100:00100000:3.0:1789635198.229950:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789635198.230010:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c2c2797e/0xb0c3a59caa40ea58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40ea51 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635198.230017:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c2c2797e/0xb0c3a59caa40ea58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40ea51 expref: 12 pid: 6506 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635198.230025:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003c9641f6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6509:1876568427204992:0@lo:104: 00000100:00100000:3.0:1789635198.230046:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789635198.230077:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a3282caf/0xb0c3a59caa40ea3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40ea35 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635198.230084:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a3282caf/0xb0c3a59caa40ea3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40ea35 expref: 12 pid: 6508 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635198.230092:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001651fb2e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6509:1876568427205120:0@lo:104: 00000100:00100000:3.0:1789635198.230121:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635198.230133:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 000000002cd4bda5 going to sleep for 11 seconds 00000100:00100000:1.0:1789635198.230207:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427204864 00000100:00100000:1.0:1789635198.230216:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427204864 00000100:00100000:1.0:1789635198.230258:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427204992 00000100:00100000:1.0:1789635198.230260:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427204992 00000100:00100000:1.0:1789635198.230267:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427205120 00000100:00100000:1.0:1789635198.230269:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427205120 00000100:00100000:1.0:1789635198.230281:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789635198.230288:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ddd7372e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+5:6509:x1876568427204864:12345-0@lo:104: 00010000:00010000:1.0:1789635198.230298:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: 0000000043fb7bce/0xb0c3a59caa40eac1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40eac8 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.230363:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789635198.230368:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ddd7372e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+5:6509:x1876568427204864:12345-0@lo:104: Request processed in 82us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635198.230381:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789635198.230399:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789635198.230406:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007ae1c5c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+4:6509:x1876568427204992:12345-0@lo:104: 00010000:00010000:0.0:1789635198.230407:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635198.230415:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: 0000000043fb7bce/0xb0c3a59caa40eac1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40eac8 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.230416:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: 0000000079a2551d/0xb0c3a59caa40ea51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ea58 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.230437:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000043fb7bce already unused, calling callback (00000000af9d8a27) 10000000:00010000:0.0:1789635198.230441:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: 0000000043fb7bce/0xb0c3a59caa40eac1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40eac8 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.230450:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: 0000000043fb7bce/0xb0c3a59caa40eac1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40eac8 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789635198.230457:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: 0000000043fb7bce/0xb0c3a59caa40eac1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40eac8 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635198.230463:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789635198.230469:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789635198.230477:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007ae1c5c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+4:6509:x1876568427204992:12345-0@lo:104: Request processed in 72us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635198.230483:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789635198.230497:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789635198.230503:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cca1010a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+3:6509:x1876568427205120:12345-0@lo:104: 00010000:00010000:0.0:1789635198.230508:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: 0000000043fb7bce/0xb0c3a59caa40eac1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40eac8 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.230510:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: 000000008929988d/0xb0c3a59caa40ea35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ea3c expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.230537:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789635198.230541:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cca1010a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+3:6509:x1876568427205120:12345-0@lo:104: Request processed in 40us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635198.230546:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789635198.230561:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789635198.230634:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789635198.230656:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: 0000000043fb7bce/0xb0c3a59caa40eac1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40eac8 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.230663:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: 0000000043fb7bce/0xb0c3a59caa40eac1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40eac8 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.230678:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635198.230681:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: 000000008929988d/0xb0c3a59caa40ea35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ea3c expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.230686:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008929988d already unused, calling callback (00000000af9d8a27) 10000000:00010000:0.0:1789635198.230689:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: 000000008929988d/0xb0c3a59caa40ea35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40ea3c expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.230696:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: 000000008929988d/0xb0c3a59caa40ea35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40ea3c expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789635198.230701:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: 000000008929988d/0xb0c3a59caa40ea35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40ea3c expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635198.230707:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789635198.230723:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: 000000008929988d/0xb0c3a59caa40ea35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ea3c expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.230730:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789635198.230744:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: 000000008929988d/0xb0c3a59caa40ea35 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ea3c expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.230747:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635198.230753:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: 0000000079a2551d/0xb0c3a59caa40ea51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ea58 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.230770:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000079a2551d already unused, calling callback (00000000af9d8a27) 00010000:00010000:0.0:1789635198.230773:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: 000000008929988d/0xb0c3a59caa40ea35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ea3c expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789635198.230775:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: 0000000079a2551d/0xb0c3a59caa40ea51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40ea58 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.230800:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635198.230803:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635198.230804:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: 0000000079a2551d/0xb0c3a59caa40ea51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40ea58 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.230805:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:1.0:1789635198.230813:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: 0000000079a2551d/0xb0c3a59caa40ea51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40ea58 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635198.230819:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789635198.230828:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000652df4e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427205248:0@lo:103: 00010000:00010000:1.0:1789635198.230843:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: 0000000079a2551d/0xb0c3a59caa40ea51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ea58 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.230851:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789635198.230857:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: 0000000079a2551d/0xb0c3a59caa40ea51 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ea58 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.230864:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: 0000000079a2551d/0xb0c3a59caa40ea51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ea58 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635198.230867:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789635198.230886:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635198.230888:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635198.230891:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635198.230895:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635198.230898:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635198.230927:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c3d6b7ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427205376:0@lo:103: 00000100:00100000:0.0:1789635198.230956:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635198.232887:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000056309ff6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427205504:0@lo:103: 00000100:00100000:1.0:1789635198.234306:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635198.250566:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427205248 00000100:00100000:2.0:1789635198.250582:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427205248 00010000:00010000:2.0:1789635198.250638:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009a612eab/0xb0c3a59caa40eac8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40eac1 expref: 13 pid: 6508 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635198.250670:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427205376 00000100:00100000:2.0:1789635198.250673:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427205376 00010000:00010000:2.0:1789635198.250706:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a3282caf/0xb0c3a59caa40ea3c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ea35 expref: 14 pid: 6508 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635198.250732:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427205504 00000100:00100000:2.0:1789635198.250735:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427205504 00010000:00010000:2.0:1789635198.250746:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c2c2797e/0xb0c3a59caa40ea58 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ea51 expref: 15 pid: 6506 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635198.250760:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789635198.250768:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000038a49d3f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+15:3643:x1876568427205248:12345-0@lo:103: 00010000:00010000:2.0:1789635198.250782:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635198.250787:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009a612eab/0xb0c3a59caa40eac8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40eac1 expref: 15 pid: 6508 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.250797:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009a612eab/0xb0c3a59caa40eac8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40eac1 expref: 15 pid: 6508 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.250816:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635198.250872:0:6501:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789635198.250883:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000038a49d3f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+15:3643:x1876568427205248:12345-0@lo:103: Request processed in 115us (20018us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635198.250884:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1789635198.250893:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789635198.250914:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789635198.250920:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a9eeef03 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+14:3640:x1876568427205376:12345-0@lo:103: 00010000:00010000:2.0:1789635198.250928:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635198.250938:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a3282caf/0xb0c3a59caa40ea3c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ea35 expref: 14 pid: 6508 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.250946:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a3282caf/0xb0c3a59caa40ea3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40ea35 expref: 14 pid: 6508 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.250955:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635198.250985:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a9eeef03 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+14:3640:x1876568427205376:12345-0@lo:103: Request processed in 66us (20029us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635198.250992:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789635198.251017:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789635198.251023:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bb896094 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+13:3641:x1876568427205504:12345-0@lo:103: 00010000:00010000:2.0:1789635198.251030:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635198.251034:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c2c2797e/0xb0c3a59caa40ea58 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ea51 expref: 13 pid: 6506 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.251042:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c2c2797e/0xb0c3a59caa40ea58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40ea51 expref: 13 pid: 6506 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.251052:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ec13b275/0xb0c3a59caa40eb07 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.251060:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ec13b275/0xb0c3a59caa40eb07 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.251073:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ec13b275/0xb0c3a59caa40eb07 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.251080:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ec13b275/0xb0c3a59caa40eb07 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.251085:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ec13b275/0xb0c3a59caa40eb07 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.251097:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ec13b275/0xb0c3a59caa40eb07 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.251103:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ec13b275 already unused, calling callback (0000000034729756) 00010000:00010000:2.0:1789635198.251107:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ec13b275/0xb0c3a59caa40eb07 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.251114:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ec13b275/0xb0c3a59caa40eb07 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.251123:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ec13b275/0xb0c3a59caa40eb07 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.251133:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635198.251167:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bb896094 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+13:3641:x1876568427205504:12345-0@lo:103: Request processed in 145us (16866us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635198.251174:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789635198.251261:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000056309ff6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427205504:0@lo:103: 00010000:00010000:2.0:1789635198.251305:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009a612eab/0xb0c3a59caa40eac8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40eac1 expref: 12 pid: 6508 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635198.251319:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f4aa565f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6509:1876568427204864:0@lo:104: 00010000:00010000:2.0:1789635198.251329:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c2c2797e/0xb0c3a59caa40ea58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40ea51 expref: 11 pid: 6506 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635198.251337:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003c9641f6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6509:1876568427204992:0@lo:104: 00010000:00010000:2.0:1789635198.251561:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a3282caf/0xb0c3a59caa40ea3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40ea35 expref: 10 pid: 6508 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635198.251574:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001651fb2e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6509:1876568427205120:0@lo:104: 00010000:00010000:2.0:1789635198.251612:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ec13b275/0xb0c3a59caa40eb07 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.251622:0:6509:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ec13b275/0xb0c3a59caa40eb07 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.251628:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ec13b275/0xb0c3a59caa40eb07 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.251634:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ec13b275/0xb0c3a59caa40eb07 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789635198.251651:0:6509:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1789635198.254256:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000652df4e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427205248:0@lo:103: 00000100:00100000:2.0:1789635198.255646:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c3d6b7ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427205376:0@lo:103: 00000100:00100000:2.0:1789635198.257926:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e8cf8577 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+9:7444:x1876568427204736:12345-0@lo:253: Request processed in 58068us (58511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635198.257940:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789635198.258059:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f26b5c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427204736:0@lo:253: 10000000:01000000:3.0:1789635198.258077:0:7444:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1789635198.258080:0:7444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789635198.258082:0:7444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789635198.258084:0:7444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789635198.258085:0:7444:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:3.0:1789635198.258086:0:7444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789635198.258087:0:7444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789635198.258088:0:7444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789635198.258090:0:7444:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789635198.258092:0:7444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789635198.258093:0:7444:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789635198.258111:0:7444:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c3275346 from lustre-MDT0001 10000000:01000000:3.0:1789635198.258141:0:7444:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1789635198.258144:0:7444:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789635198.258150:0:7444:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d057ae4b380 local copy 10000000:01000000:3.0:1789635198.258155:0:7444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789635198.258199:0:7444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 0000000043f598f7/0xb0c3a59caa40eb0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635198.258210:0:7444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.120@tcp lock: 0000000043f598f7/0xb0c3a59caa40eb0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635198.258219:0:7444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 0000000043f598f7/0xb0c3a59caa40eb0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635198.258236:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000081a46c64 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427205632:0@lo:101: 00000100:00100000:3.0:1789635198.258279:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635198.258320:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 0000000065d908cb going to sleep for 11 seconds 00000100:00100000:2.0:1789635198.258476:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427205632 00000100:00100000:2.0:1789635198.258483:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427205632 00000100:00100000:2.0:1789635198.258528:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789635198.258536:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004bc6c5aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+9:7444:x1876568427205632:12345-0@lo:101: 00010000:00010000:2.0:1789635198.258548:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635198.258560:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000010729d41/0xb0c3a59caa40eb15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40eb0e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.258581:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000010729d41/0xb0c3a59caa40eb15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40eb0e expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.258590:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000010729d41/0xb0c3a59caa40eb15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40eb0e expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.258646:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000010729d41, rc 0) 00000100:00100000:2.0:1789635198.258676:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004bc6c5aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+10:7444:x1876568427205632:12345-0@lo:101: Request processed in 142us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635198.258682:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789635198.258858:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000081a46c64 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427205632:0@lo:101: 00010000:00010000:3.0:1789635198.258878:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 0000000043f598f7/0xb0c3a59caa40eb0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xb0c3a59caa40eb15 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635198.258886:0:7444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 0000000043f598f7/0xb0c3a59caa40eb0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb0c3a59caa40eb15 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635198.258980:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000081a46c64 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427205760:0@lo:501: 00000100:00100000:3.0:1789635198.259018:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635198.259043:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 0000000065d908cb going to sleep for 11 seconds 00000100:00100000:1.0:1789635198.259257:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427205760 00000100:00100000:1.0:1789635198.259262:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427205760 00000100:00100000:0.0:1789635198.259311:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789635198.259321:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000079dd789c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+10:7444:x1876568427205760:12345-0@lo:501: 00000100:00100000:0.0:1789635198.259411:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000079dd789c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+10:7444:x1876568427205760:12345-0@lo:501: Request processed in 93us (393us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789635198.259468:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000081a46c64 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427205760:0@lo:501: 10000000:01000000:3.0:1789635198.259482:0:7444:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789635198.259498:0:7444:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789635198.259502:0:7444:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 0000000043f598f7/0xb0c3a59caa40eb0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb0c3a59caa40eb15 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635198.259513:0:7444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 0000000043f598f7/0xb0c3a59caa40eb0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb0c3a59caa40eb15 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635198.259519:0:7444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: 0000000043f598f7/0xb0c3a59caa40eb0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb0c3a59caa40eb15 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.259568:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635198.259573:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: 0000000043f598f7/0xb0c3a59caa40eb0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xb0c3a59caa40eb15 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.259583:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000043f598f7 already unused, calling callback (00000000af9d8a27) 10000000:00010000:2.0:1789635198.259586:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: 0000000043f598f7/0xb0c3a59caa40eb0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xb0c3a59caa40eb15 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.259616:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: 0000000043f598f7/0xb0c3a59caa40eb0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xb0c3a59caa40eb15 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789635198.259623:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: 0000000043f598f7/0xb0c3a59caa40eb0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xb0c3a59caa40eb15 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635198.259630:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789635198.259652:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: 0000000043f598f7/0xb0c3a59caa40eb0e lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb0c3a59caa40eb15 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.259664:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789635198.259687:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: 0000000043f598f7/0xb0c3a59caa40eb0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb0c3a59caa40eb15 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.259698:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635198.259700:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635198.259702:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635198.259925:0:7444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789635198.259930:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: 0000000043f598f7/0xb0c3a59caa40eb0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb0c3a59caa40eb15 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635198.259961:0:7444:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d0550107000 10000000:01000000:3.0:1789635198.259966:0:7444:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789635198.259971:0:7444:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d057ae4b380 10000000:01000000:3.0:1789635198.259978:0:7444:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789635198.259981:0:7444:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8d057ae4b380 from 1 10000000:01000000:3.0:1789635198.259984:0:7444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789635198.260000:0:7444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 00000000702e6ed0/0xb0c3a59caa40eb1c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635198.260380:0:7444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 00000000702e6ed0/0xb0c3a59caa40eb1c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635198.260389:0:7444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 00000000702e6ed0/0xb0c3a59caa40eb1c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635198.260407:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000081a46c64 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427206016:0@lo:101: 00000100:00100000:3.0:1789635198.260446:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635198.260481:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a98bed7f going to sleep for 11 seconds 00000100:00100000:2.0:1789635198.260534:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427206016 00000100:00100000:2.0:1789635198.260540:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427206016 00000100:00100000:0.0:1789635198.260850:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789635198.260858:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789635198.260872:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d5334879 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427205888:0@lo:103: 00000100:00100000:1.0:1789635198.260905:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635198.261103:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427205888 00000100:00100000:3.0:1789635198.261108:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427205888 00000100:00100000:3.0:1789635198.261139:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789635198.261145:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000056309ff6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+11:3643:x1876568427205888:12345-0@lo:103: 00010000:00010000:3.0:1789635198.261156:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635198.261167:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000010729d41/0xb0c3a59caa40eb15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb0c3a59caa40eb0e expref: 11 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635198.261182:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635198.261228:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000056309ff6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+10:3643:x1876568427205888:12345-0@lo:103: Request processed in 83us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635198.261235:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789635198.261403:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d5334879 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427205888:0@lo:103: 00000100:00100000:3.0:1789635198.262222:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789635198.262233:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000369d7875 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+9:7444:x1876568427206016:12345-0@lo:101: 00010000:00010000:3.0:1789635198.262260:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635198.262347:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001f001f5f/0xb0c3a59caa40eb23 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40eb1c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635198.262369:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001f001f5f/0xb0c3a59caa40eb23 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40eb1c expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635198.262378:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001f001f5f/0xb0c3a59caa40eb23 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40eb1c expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635198.262386:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001f001f5f, rc 0) 00000100:00100000:3.0:1789635198.262441:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000369d7875 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+10:7444:x1876568427206016:12345-0@lo:101: Request processed in 211us (1995us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635198.262447:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789635198.262521:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000081a46c64 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427206016:0@lo:101: 00010000:00010000:0.0:1789635198.262535:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 00000000702e6ed0/0xb0c3a59caa40eb1c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40eb23 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.262543:0:7444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 00000000702e6ed0/0xb0c3a59caa40eb1c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40eb23 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635198.262558:0:7444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789635198.262577:0:7444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 00000000702e6ed0/0xb0c3a59caa40eb1c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40eb23 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.262622:0:7444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 00000000702e6ed0/0xb0c3a59caa40eb1c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40eb23 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635198.262635:0:7444:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d0550107000 10000000:01000000:0.0:1789635198.262640:0:7444:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789635198.262644:0:7444:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d0550107000 from 1 10000000:01000000:0.0:1789635198.262647:0:7444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789635198.262670:0:7444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 000000005ed95ad6/0xb0c3a59caa40eb2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.262676:0:7444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 000000005ed95ad6/0xb0c3a59caa40eb2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.262683:0:7444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 000000005ed95ad6/0xb0c3a59caa40eb2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635198.262697:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000efa4508a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427206144:0@lo:101: 00000100:00100000:0.0:1789635198.262735:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635198.263173:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cd9fb405 going to sleep for 11 seconds 00000100:00100000:1.0:1789635198.263536:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427206144 00000100:00100000:1.0:1789635198.263543:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427206144 00000100:00100000:1.0:1789635198.263578:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789635198.263585:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000080c4880e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+10:7444:x1876568427206144:12345-0@lo:101: 00010000:00010000:1.0:1789635198.263637:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635198.263651:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e86ebbf2/0xb0c3a59caa40eb31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40eb2a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.263669:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e86ebbf2/0xb0c3a59caa40eb31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40eb2a expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.263679:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e86ebbf2/0xb0c3a59caa40eb31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40eb2a expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.263686:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e86ebbf2, rc 0) 00000100:00100000:1.0:1789635198.263839:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000080c4880e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+11:7444:x1876568427206144:12345-0@lo:101: Request processed in 255us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635198.263846:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789635198.264025:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000efa4508a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427206144:0@lo:101: 00010000:00010000:0.0:1789635198.264038:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 000000005ed95ad6/0xb0c3a59caa40eb2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40eb31 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.264046:0:7444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 000000005ed95ad6/0xb0c3a59caa40eb2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40eb31 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635198.264060:0:7444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789635198.264074:0:7444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 000000005ed95ad6/0xb0c3a59caa40eb2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40eb31 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.264090:0:7444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 000000005ed95ad6/0xb0c3a59caa40eb2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40eb31 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635198.264096:0:7444:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789635198.264100:0:7444:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789635198.264105:0:7444:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d0550107000 10000000:01000000:0.0:1789635198.264107:0:7444:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789635198.264110:0:7444:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1789635198.264112:0:7444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789635198.264131:0:7444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 00000000c2c2797e/0xb0c3a59caa40eb38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.264137:0:7444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 00000000c2c2797e/0xb0c3a59caa40eb38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.264144:0:7444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 00000000c2c2797e/0xb0c3a59caa40eb38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635198.264156:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000efa4508a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427206272:0@lo:101: 00000100:00100000:0.0:1789635198.264181:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635198.264215:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cd9fb405 going to sleep for 11 seconds 00000100:00100000:1.0:1789635198.264420:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427206272 00000100:00100000:1.0:1789635198.264426:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427206272 00000100:00100000:1.0:1789635198.264457:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789635198.264463:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cb662606 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+11:7444:x1876568427206272:12345-0@lo:101: 00010000:00010000:1.0:1789635198.264478:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635198.264488:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a3282caf/0xb0c3a59caa40eb3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40eb38 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.264500:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a3282caf/0xb0c3a59caa40eb3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40eb38 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.264507:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a3282caf/0xb0c3a59caa40eb3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40eb38 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.264514:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a3282caf, rc 0) 00000100:00100000:1.0:1789635198.264539:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cb662606 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+12:7444:x1876568427206272:12345-0@lo:101: Request processed in 77us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635198.264545:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789635198.264691:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000efa4508a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427206272:0@lo:101: 00010000:00010000:0.0:1789635198.264700:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 00000000c2c2797e/0xb0c3a59caa40eb38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40eb3f expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.264706:0:7444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 00000000c2c2797e/0xb0c3a59caa40eb38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40eb3f expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635198.264808:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000efa4508a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427206400:0@lo:501: 00000100:00100000:0.0:1789635198.264833:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635198.264859:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cd9fb405 going to sleep for 11 seconds 00000100:00100000:0.0:1789635198.264871:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427206400 00000100:00100000:0.0:1789635198.264874:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427206400 00000100:00100000:0.0:1789635198.264891:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789635198.264895:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cde2ba44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+12:7444:x1876568427206400:12345-0@lo:501: 00000100:00100000:0.0:1789635198.264979:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cde2ba44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+12:7444:x1876568427206400:12345-0@lo:501: Request processed in 83us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635198.264986:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789635198.265102:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000efa4508a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427206400:0@lo:501: 00000100:00100000:0.0:1789635198.265124:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000efa4508a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427206528:0@lo:503: 00000100:00100000:0.0:1789635198.265158:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635198.265177:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cd9fb405 going to sleep for 11 seconds 00000100:00100000:3.0:1789635198.265231:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427206528 00000100:00100000:3.0:1789635198.265235:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427206528 00000100:00100000:3.0:1789635198.265261:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789635198.265267:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008f951a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+12:7444:x1876568427206528:12345-0@lo:503: 00000100:00100000:3.0:1789635198.265432:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008f951a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+12:7444:x1876568427206528:12345-0@lo:503: Request processed in 165us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635198.265439:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789635198.265987:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000efa4508a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427206528:0@lo:503: 00000040:00080000:0.0:1789635198.266226:0:7444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789635198.266413:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000efa4508a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427206656:0@lo:502: 00000100:00100000:0.0:1789635198.266453:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635198.266517:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cd9fb405 going to sleep for 11 seconds 00000100:00100000:2.0:1789635198.268691:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427206656 00000100:00100000:2.0:1789635198.268704:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427206656 00000100:00100000:1.0:1789635198.270180:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789635198.270210:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000667a67e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+12:7444:x1876568427206656:12345-0@lo:502: 00000100:00100000:1.0:1789635198.270409:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000667a67e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+12:7444:x1876568427206656:12345-0@lo:502: Request processed in 218us (3956us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635198.270417:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789635198.270629:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000efa4508a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427206656:0@lo:502: 00000040:00080000:0.0:1789635198.270852:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789635198.270897:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:0.0:1789635198.270913:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:0.0:1789635198.270926:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:0.0:1789635198.270948:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:0.0:1789635198.270960:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:0.0:1789635198.270972:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:0.0:1789635198.270983:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:0.0:1789635198.270995:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:0.0:1789635198.271023:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:0.0:1789635198.271037:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:0.0:1789635198.271049:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:0.0:1789635198.271060:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:0.0:1789635198.271073:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:0.0:1789635198.271084:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:0.0:1789635198.271097:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:0.0:1789635198.271110:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:0.0:1789635198.271135:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:0.0:1789635198.271151:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:0.0:1789635198.271165:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:0.0:1789635198.271178:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:0.0:1789635198.271201:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:0.0:1789635198.271216:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:0.0:1789635198.271249:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000efa4508a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427206784:0@lo:502: 00000100:00100000:0.0:1789635198.271306:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635198.271344:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cd9fb405 going to sleep for 11 seconds 00000100:00100000:1.0:1789635198.272107:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427206784 00000100:00100000:1.0:1789635198.272116:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427206784 00000100:00100000:1.0:1789635198.272159:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789635198.272166:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009b57226d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+12:7444:x1876568427206784:12345-0@lo:502: 00000100:00100000:1.0:1789635198.272417:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009b57226d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+12:7444:x1876568427206784:12345-0@lo:502: Request processed in 252us (1111us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635198.272424:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789635198.272513:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000efa4508a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427206784:0@lo:502: 00000040:00080000:2.0:1789635198.272580:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:2.0:1789635198.272592:0:7444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:0.0:1789635198.274463:0:7458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789635198.274477:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635198.274480:0:7458:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789635198.274484:0:7458:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1789635198.274487:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789635198.274500:0:7458:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000ebbda0ca) 00000020:00000080:0.0:1789635198.274584:0:7458:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:0.0:1789635198.274924:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789635198.275047:0:7458:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789635198.275055:0:7458:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb0c3a59caa40eb4d 00000020:00000080:0.0:1789635198.275327:0:7458:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1789635198.275334:0:7458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635198.275338:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635198.275340:0:7458:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789635198.275343:0:7458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789635198.275347:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635198.275348:0:7458:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1789635198.275351:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789635198.275360:0:7458:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (0000000049c1a810) 00000020:00000080:0.0:1789635198.275370:0:7458:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:0.0:1789635198.275374:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789635198.275376:0:7458:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1789635198.275379:0:7458:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1789635198.275385:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789635198.275444:0:7458:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c3275346 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1789635198.275458:0:7458:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (0000000057da9d3d) 00000020:00000080:0.0:1789635198.275466:0:7458:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:0.0:1789635198.275537:0:7458:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789635198.275543:0:7458:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb0c3a59caa40eb62 00000020:00000080:0.0:1789635198.275817:0:7458:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1789635198.275824:0:7458:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789635198.275834:0:7458:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xb0c3a59caa40eb69 00080000:01000000:0.0:1789635198.275841:0:7458:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789635198.275844:0:7458:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb0c3a59caa40eb70 00080000:10000000:0.0:1789635198.276223:0:7458:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1789635198.276362:0:7458:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:3.0:1789635198.401820:0:7458:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1789635198.402055:0:7458:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1789635198.408130:0:7458:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789635198.408495:0:7458:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 10000000:01000000:3.0:1789635198.411685:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789635198.411692:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d0558960000 from 21 10000000:01000000:3.0:1789635198.411698:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789635198.411740:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 0000000043f598f7/0xb0c3a59caa40eb77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635198.411769:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 0000000043f598f7/0xb0c3a59caa40eb77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635198.411780:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 0000000043f598f7/0xb0c3a59caa40eb77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635198.411804:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d00c9120 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427206912:0@lo:101: 00000100:00100000:3.0:1789635198.411868:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635198.411929:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d4cede48 going to sleep for 11 seconds 00000100:00100000:1.0:1789635198.413357:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427206912 00000100:00100000:1.0:1789635198.413369:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427206912 00000100:00100000:1.0:1789635198.413428:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789635198.413437:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000416b1ab8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+12:6512:x1876568427206912:12345-0@lo:101: 00010000:00010000:1.0:1789635198.413453:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635198.413467:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000043fb7bce/0xb0c3a59caa40eb7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40eb77 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.413492:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000043fb7bce/0xb0c3a59caa40eb7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40eb77 expref: 13 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.413503:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000043fb7bce/0xb0c3a59caa40eb7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40eb77 expref: 13 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.413512:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000043fb7bce, rc 0) 00000100:00100000:1.0:1789635198.413574:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000416b1ab8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+13:6512:x1876568427206912:12345-0@lo:101: Request processed in 139us (1707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635198.413582:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789635198.413822:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d00c9120 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427206912:0@lo:101: 00010000:00010000:3.0:1789635198.413838:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 0000000043f598f7/0xb0c3a59caa40eb77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40eb7e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635198.413847:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 0000000043f598f7/0xb0c3a59caa40eb77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40eb7e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635198.413911:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d00c9120 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427207040:0@lo:501: 00000100:00100000:3.0:1789635198.413941:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635198.413963:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d4cede48 going to sleep for 11 seconds 00000100:00100000:0.0:1789635198.414035:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427207040 00000100:00100000:0.0:1789635198.414040:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427207040 00000100:00100000:0.0:1789635198.414070:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789635198.414076:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000046e97068 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+13:6512:x1876568427207040:12345-0@lo:501: 00000100:00100000:0.0:1789635198.414203:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000046e97068 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+13:6512:x1876568427207040:12345-0@lo:501: Request processed in 127us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635198.414220:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789635198.414343:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d00c9120 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427207040:0@lo:501: 00000100:00100000:3.0:1789635198.414385:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d00c9120 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427207168:0@lo:503: 00000100:00100000:3.0:1789635198.414421:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635198.414441:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d4cede48 going to sleep for 11 seconds 00000100:00100000:1.0:1789635198.414534:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427207168 00000100:00100000:1.0:1789635198.414539:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427207168 00000100:00100000:1.0:1789635198.414568:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789635198.414574:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000028895d9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+13:6512:x1876568427207168:12345-0@lo:503: 00000100:00100000:1.0:1789635198.414666:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000028895d9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+13:6512:x1876568427207168:12345-0@lo:503: Request processed in 92us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635198.414673:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789635198.414809:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d00c9120 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427207168:0@lo:503: 00000100:00100000:0.0:1789635198.415160:0:7459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000003efd5fe pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:7459:1876568427207296:0@lo:502: 00000100:00100000:0.0:1789635198.415203:0:7459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635198.415230:0:7459:0:(client.c:2716:ptlrpc_set_wait()) set 0000000067ad5114 going to sleep for 11 seconds 00000100:00100000:1.0:1789635198.415275:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427207296 00000100:00100000:1.0:1789635198.415280:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427207296 00000100:00100000:1.0:1789635198.415309:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789635198.415315:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004d626166 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+13:7459:x1876568427207296:12345-0@lo:502: 00000100:00100000:1.0:1789635198.415403:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004d626166 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+13:7459:x1876568427207296:12345-0@lo:502: Request processed in 88us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635198.415416:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789635198.415533:0:7459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000003efd5fe pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:7459:1876568427207296:0@lo:502: 00000100:00100000:3.0:1789635198.415575:0:7459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d00c9120 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:7459:1876568427207424:0@lo:502: 00000100:00100000:3.0:1789635198.415636:0:7459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635198.415653:0:7459:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d4cede48 going to sleep for 11 seconds 00000100:00100000:0.0:1789635198.415696:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427207424 00000100:00100000:0.0:1789635198.415701:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427207424 00000100:00100000:0.0:1789635198.415730:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789635198.415736:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000085e29476 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+13:7459:x1876568427207424:12345-0@lo:502: 00000100:00100000:0.0:1789635198.416446:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000085e29476 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+13:7459:x1876568427207424:12345-0@lo:502: Request processed in 708us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635198.416454:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789635198.416673:0:7459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d00c9120 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:7459:1876568427207424:0@lo:502: 00000040:00080000:3.0:1789635198.416695:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1789635198.416836:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1789635198.416854:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789635198.416862:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 0000000043f598f7/0xb0c3a59caa40eb77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40eb7e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.416871:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 0000000043f598f7/0xb0c3a59caa40eb77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40eb7e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635198.416881:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789635198.416883:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1789635198.416886:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789635198.416906:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 0000000079a2551d/0xb0c3a59caa40eb85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.416914:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 0000000079a2551d/0xb0c3a59caa40eb85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.416931:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 0000000079a2551d/0xb0c3a59caa40eb85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635198.416944:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cd448740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427207552:0@lo:101: 00000100:00100000:0.0:1789635198.416978:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635198.417080:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d129150b going to sleep for 11 seconds 00000100:00100000:3.0:1789635198.419425:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427207552 00000100:00100000:3.0:1789635198.419438:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427207552 00000100:00100000:3.0:1789635198.419492:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789635198.419500:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006b564b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+13:6512:x1876568427207552:12345-0@lo:101: 00010000:00010000:3.0:1789635198.419516:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635198.419531:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001eb5cc74/0xb0c3a59caa40eb8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40eb85 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635198.419554:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001eb5cc74/0xb0c3a59caa40eb8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40eb85 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635198.419564:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001eb5cc74/0xb0c3a59caa40eb8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40eb85 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635198.419573:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001eb5cc74, rc 0) 00000100:00100000:3.0:1789635198.419653:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006b564b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+14:6512:x1876568427207552:12345-0@lo:101: Request processed in 153us (2674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635198.419659:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789635198.419708:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cd448740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427207552:0@lo:101: 00010000:00010000:3.0:1789635198.419723:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 0000000079a2551d/0xb0c3a59caa40eb85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40eb8c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635198.419745:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 0000000079a2551d/0xb0c3a59caa40eb85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40eb8c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635198.419827:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d00c9120 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427207680:0@lo:501: 00000100:00100000:3.0:1789635198.419858:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635198.419884:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 000000001601d8dd going to sleep for 11 seconds 00000100:00100000:3.0:1789635198.419897:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427207680 00000100:00100000:3.0:1789635198.419901:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427207680 00000100:00100000:3.0:1789635198.419918:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789635198.419923:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fe2605ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+14:6512:x1876568427207680:12345-0@lo:501: 00000100:00100000:1.0:1789635198.421249:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fe2605ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+14:6512:x1876568427207680:12345-0@lo:501: Request processed in 1322us (1387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635198.421261:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789635198.421349:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d00c9120 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427207680:0@lo:501: 00000100:00100000:2.0:1789635198.421393:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000026f0d866 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427207808:0@lo:503: 00000100:00100000:2.0:1789635198.421647:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635198.421695:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 000000000f0f453e going to sleep for 11 seconds 00000100:00100000:1.0:1789635198.422145:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427207808 00000100:00100000:1.0:1789635198.422153:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427207808 00000100:00100000:1.0:1789635198.422203:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789635198.422211:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000379c04b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+14:6512:x1876568427207808:12345-0@lo:503: 00000100:00100000:1.0:1789635198.422384:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000379c04b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+14:6512:x1876568427207808:12345-0@lo:503: Request processed in 108us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635198.422393:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789635198.423117:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000026f0d866 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427207808:0@lo:503: 00000020:00000080:1.0:1789635198.430510:0:7458:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1789635198.430523:0:7458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789635198.430529:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635198.430532:0:7458:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1789635198.430535:0:7458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789635198.430540:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635198.430542:0:7458:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1789635198.430545:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789635198.430550:0:7458:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:00000080:1.0:1789635198.430574:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789635198.430588:0:7458:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000e148e9b8) 00000020:00000080:1.0:1789635198.430624:0:7458:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1789635198.430630:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789635198.430731:0:7458:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1789635198.430740:0:7458:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789635198.430747:0:7458:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb0c3a59caa40eb9a 00010000:00080000:1.0:1789635198.430775:0:7458:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000224255d3@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.120@tcp at head 00000100:00100000:0.0:1789635198.435509:0:7460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005bd2954c pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:7460:1876568427207936:0@lo:502: 00000100:00100000:0.0:1789635198.435581:0:7460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635198.435640:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427207936 00000100:00100000:0.0:1789635198.435647:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427207936 00000100:00100000:0.0:1789635198.435685:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789635198.435693:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000939c16fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+14:7460:x1876568427207936:12345-0@lo:502: 00000100:00100000:0.0:1789635198.435807:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000939c16fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+14:7460:x1876568427207936:12345-0@lo:502: Request processed in 113us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635198.435814:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789635198.435868:0:7460:0:(client.c:2716:ptlrpc_set_wait()) set 0000000067ad5114 going to sleep for 11 seconds 00000100:00100000:0.0:1789635198.435889:0:7460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005bd2954c pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:7460:1876568427207936:0@lo:502: 00000020:01000000:0.0:1789635198.435918:0:7460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789635198.435929:0:7460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635198.435932:0:7460:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1789635198.435937:0:7460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789635198.435941:0:7460:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:00000080:0.0:1789635198.435961:0:7460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789635198.435979:0:7460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000e9f19f24) 00000020:00000080:0.0:1789635198.435998:0:7460:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osp with refcount 2 00000020:00000080:0.0:1789635198.437426:0:7460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789635198.437528:0:7460:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1789635198.437534:0:7460:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789635198.437541:0:7460:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb0c3a59caa40eba8 00010000:00080000:0.0:1789635198.437572:0:7460:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000cd3db1c8@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.120@tcp at head 00010000:00010000:0.0:1789635198.440157:0:7460:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-2 is initialized 00010000:00010000:1.0:1789635198.441093:0:7458:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:3.0:1789635198.445688:0:7458:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789635198.445701:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789635198.445733:0:7458:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789635198.445753:0:7458:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb0c3a59caa40ebaf 00000100:00080000:3.0:1789635198.445762:0:7458:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789635198.445772:0:7458:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000224255d3 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789635198.445805:0:7458:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c6586179 x1876568427208064/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789635198.445824:0:7458:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789635198.445881:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000425a7faa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876568427208192:0@lo:400: 00000100:00100000:3.0:1789635198.445939:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635198.446093:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c6586179 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1876568427208064:0@lo:38: 00000100:00100000:1.0:1789635198.446129:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1789635198.446816:0:7460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789635198.446825:0:7460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789635198.446853:0:7460:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789635198.446867:0:7460:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb0c3a59caa40ebb6 00000100:00080000:1.0:1789635198.446874:0:7460:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789635198.446880:0:7460:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000cd3db1c8 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1789635198.446899:0:7460:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000028aa8cbc x1876568427208320/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789635198.446924:0:7460:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:1.0:1789635198.446955:0:7460:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1789635198.447430:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000028aa8cbc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427208320:0@lo:38: 00000100:00100000:0.0:1789635198.447476:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635198.455246:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427208064 00000100:00100000:0.0:1789635198.455261:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427208064 00000100:00100000:0.0:1789635198.455298:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427208320 00000100:00100000:0.0:1789635198.455301:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427208320 00000100:00100000:0.0:1789635198.455324:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789635198.455331:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007047d2cf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1876568427208064:12345-0@lo:38: 00010000:00080000:0.0:1789635198.455359:0:6519:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:0.0:1789635198.455413:0:6519:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb0c3a59caa40ebbd 00000004:00100000:0.0:1789635198.455428:0:6519:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789635198.455433:0:6519:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:0.0:1789635198.455566:0:7458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635198.455572:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635198.455574:0:7458:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1789635198.455577:0:7458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789635198.455579:0:7458:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1789635198.455581:0:7458:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789635198.455582:0:7458:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789635198.455584:0:7458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789635198.455586:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635198.455588:0:7458:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789635198.455590:0:7458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789635198.455610:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635198.455612:0:7458:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1789635198.455622:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789635198.455668:0:7458:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789635198.455685:0:7458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635198.455688:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635198.455690:0:7458:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1789635198.455693:0:7458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789635198.455695:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635198.455696:0:7458:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789635198.455699:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789635198.455701:0:7458:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789635198.455720:0:7458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635198.455723:0:7458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635198.455724:0:7458:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789635198.455727:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:0.0:1789635198.455779:0:7444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:0.0:1789635198.455805:0:7444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789635198.455813:0:7444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 00000000c2c2797e/0xb0c3a59caa40eb38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40eb3f expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.455823:0:7444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 00000000c2c2797e/0xb0c3a59caa40eb38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40eb3f expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635198.455831:0:7444:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d0550107000 from 1 10000000:01000000:0.0:1789635198.455834:0:7444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789635198.455861:0:7444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 000000007a224277/0xb0c3a59caa40ebc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.455868:0:7444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 000000007a224277/0xb0c3a59caa40ebc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.455877:0:7444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 000000007a224277/0xb0c3a59caa40ebc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635198.455904:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000226fe2ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427208448:0@lo:101: 00000100:00100000:0.0:1789635198.455962:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635198.455983:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 000000001601d8dd going to sleep for 11 seconds 00000100:00100000:0.0:1789635198.456179:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427208448 00000100:00100000:0.0:1789635198.456185:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427208448 00000100:00100000:0.0:1789635198.456225:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789635198.456231:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001c18e5fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+14:7444:x1876568427208448:12345-0@lo:101: 00010000:00010000:0.0:1789635198.456243:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635198.456253:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c5e66dd5/0xb0c3a59caa40ebcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ebc4 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.456368:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c5e66dd5/0xb0c3a59caa40ebcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ebc4 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.456380:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c5e66dd5/0xb0c3a59caa40ebcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ebc4 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.456388:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c5e66dd5, rc 0) 00000100:00100000:0.0:1789635198.456423:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001c18e5fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+15:7444:x1876568427208448:12345-0@lo:101: Request processed in 192us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635198.456430:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789635198.456476:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000226fe2ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427208448:0@lo:101: 00010000:00010000:0.0:1789635198.456488:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 000000007a224277/0xb0c3a59caa40ebc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ebcb expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.456497:0:7444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 000000007a224277/0xb0c3a59caa40ebc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ebcb expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635198.457763:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000226fe2ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427208576:0@lo:256: 00000100:00100000:0.0:1789635198.457828:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635198.457852:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 000000001601d8dd going to sleep for 11 seconds 00000100:00100000:0.0:1789635198.457877:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427208576 00000100:00100000:0.0:1789635198.457883:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427208576 00000100:00100000:0.0:1789635198.457920:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789635198.457927:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000012132d01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+15:7444:x1876568427208576:12345-0@lo:256: 20000000:01000000:0.0:1789635198.457944:0:6509:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789635198.457962:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789635198.457965:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789635198.458174:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000012132d01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+15:7444:x1876568427208576:12345-0@lo:256: Request processed in 247us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635198.458182:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789635198.458231:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000226fe2ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427208576:0@lo:256: 10000000:01000000:0.0:1789635198.458951:0:7444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789635198.458961:0:7444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 000000007a224277/0xb0c3a59caa40ebc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ebcb expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.458971:0:7444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 000000007a224277/0xb0c3a59caa40ebc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ebcb expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635198.458980:0:7444:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0550107000 from 1 10000000:01000000:0.0:1789635198.458982:0:7444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789635198.459031:0:7444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 00000000d7938e45/0xb0c3a59caa40ebd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.459038:0:7444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 00000000d7938e45/0xb0c3a59caa40ebd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.459051:0:7444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 00000000d7938e45/0xb0c3a59caa40ebd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635198.459065:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000226fe2ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427208704:0@lo:101: 00000100:00100000:0.0:1789635198.459100:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635198.459118:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 000000001601d8dd going to sleep for 11 seconds 00000100:00100000:0.0:1789635198.459136:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427208704 00000100:00100000:0.0:1789635198.459141:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427208704 00000100:00100000:0.0:1789635198.459170:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789635198.459176:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009f0b1a7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+15:7444:x1876568427208704:12345-0@lo:101: 00010000:00010000:0.0:1789635198.459186:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635198.459438:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004ab8b3ba/0xb0c3a59caa40ebd9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ebd2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.459459:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004ab8b3ba/0xb0c3a59caa40ebd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ebd2 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.459468:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004ab8b3ba/0xb0c3a59caa40ebd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ebd2 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.459476:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004ab8b3ba, rc 0) 00000100:00100000:0.0:1789635198.459508:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009f0b1a7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+16:7444:x1876568427208704:12345-0@lo:101: Request processed in 332us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635198.459514:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789635198.459564:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000226fe2ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427208704:0@lo:101: 00010000:00010000:0.0:1789635198.459577:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 00000000d7938e45/0xb0c3a59caa40ebd2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ebd9 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789635198.459800:0:7467:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000007b27d83b x1876568427208832/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635198.459810:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 0000000086536b99 going to sleep for 0 seconds 00000020:01000000:2.0:1789635198.459868:0:7460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789635198.459873:0:7460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635198.459875:0:7460:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1789635198.459879:0:7460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789635198.459882:0:7460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635198.459883:0:7460:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789635198.459887:0:7460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789635198.459888:0:7460:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789635198.459905:0:7460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000019352533 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:7460:1876568427208960:0@lo:502: 00000100:00100000:2.0:1789635198.459944:0:7460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635198.459960:0:7460:0:(client.c:2716:ptlrpc_set_wait()) set 00000000736f887b going to sleep for 11 seconds 00000100:00100000:3.0:1789635198.460068:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427208192 00000100:00100000:3.0:1789635198.460074:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427208192 00000100:00100000:3.0:1789635198.460116:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789635198.460123:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009e3611e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876568427208192:12345-0@lo:400: 00000100:00100000:3.0:1789635198.460166:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009e3611e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876568427208192:12345-0@lo:400: Request processed in 44us (14228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635198.460178:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789635198.460218:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000425a7faa x1876568427208192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635198.460229:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000425a7faa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876568427208192:0@lo:400: 00010000:00010000:0.0:1789635198.460489:0:7444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 00000000d7938e45/0xb0c3a59caa40ebd2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ebd9 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635198.460581:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000226fe2ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427209088:0@lo:501: 00000100:00100000:0.0:1789635198.460703:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635198.460763:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 000000001601d8dd going to sleep for 11 seconds 00000100:00080000:1.0:1789635198.465954:0:6519:0:(import.c:65:import_set_state_nolock()) 00000000fa9223c5 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789635198.466043:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007047d2cf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1876568427208064:12345-0@lo:38: Request processed in 10710us (19912us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635198.466058:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789635198.466086:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789635198.466091:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005bd2954c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1876568427208320:12345-0@lo:38: 00000100:00100000:1.0:1789635198.466132:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005bd2954c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1876568427208320:12345-0@lo:38: Request processed in 39us (18656us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789635198.466138:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789635198.466536:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427208960 00000100:00100000:2.0:1789635198.466544:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427208960 00000100:00100000:2.0:1789635198.466649:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427209088 00000100:00100000:2.0:1789635198.466653:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427209088 00000100:00100000:2.0:1789635198.466669:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789635198.466674:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000319f445a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+17:7460:x1876568427208960:12345-0@lo:502: 00000100:00100000:2.0:1789635198.466778:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000319f445a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+17:7460:x1876568427208960:12345-0@lo:502: Request processed in 104us (6834us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635198.466785:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789635198.466815:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789635198.466820:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c4691a55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+16:7444:x1876568427209088:12345-0@lo:501: 00000100:00100000:2.0:1789635198.466900:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c4691a55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+16:7444:x1876568427209088:12345-0@lo:501: Request processed in 80us (6197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635198.466907:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789635198.467078:0:7460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000019352533 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:7460:1876568427208960:0@lo:502: 00000020:01000000:3.0:1789635198.467110:0:7460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789635198.467117:0:7460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635198.467119:0:7460:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789635198.467124:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:0.0:1789635198.467443:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000226fe2ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427209088:0@lo:501: 00000100:00100000:0.0:1789635198.467482:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000226fe2ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427209216:0@lo:503: 00000100:00100000:0.0:1789635198.467522:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635198.467560:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 000000001601d8dd going to sleep for 11 seconds 00000100:00100000:0.0:1789635198.467584:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789635198.467590:0:3639:0:(import.c:65:import_set_state_nolock()) 00000000cd3db1c8 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789635198.467613:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789635198.467617:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000028aa8cbc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427208320:0@lo:38: 00000100:00100000:0.0:1789635198.467631:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789635198.467636:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1789635198.467643:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789635198.467648:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789635198.467650:0:3639:0:(import.c:65:import_set_state_nolock()) 00000000224255d3 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789635198.467660:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c6586179 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1876568427208064:0@lo:38: 00000100:00100000:0.0:1789635198.467706:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d24a2dbd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427209344:0@lo:41: 00000100:00100000:0.0:1789635198.467730:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635198.467766:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427209344 00000100:00100000:0.0:1789635198.467771:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427209344 00000100:00100000:0.0:1789635198.467803:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789635198.467809:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000002a71353 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1876568427209344:12345-0@lo:41: 00000004:00000024:0.0:1789635198.467834:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1789635198.467868:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000002a71353 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1876568427209344:12345-0@lo:41: Request processed in 60us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635198.467875:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789635198.467902:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d24a2dbd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427209344:0@lo:41: 00000100:00100000:3.0:1789635198.467977:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427209216 00000100:00100000:3.0:1789635198.467981:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427209216 00000100:00100000:3.0:1789635198.468003:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789635198.468008:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006eaa2a8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+16:7444:x1876568427209216:12345-0@lo:503: 00000040:00080000:3.0:1789635198.468038:0:6508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789635198.468075:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006eaa2a8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+16:7444:x1876568427209216:12345-0@lo:503: Request processed in 67us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635198.468082:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789635198.468120:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000226fe2ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427209216:0@lo:503: 00000040:00080000:3.0:1789635198.468383:0:7444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789635198.468423:0:7444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:3.0:1789635198.468482:0:7444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789635198.469218:0:7468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:3.0:1789635198.469253:0:7444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1789635198.469271:0:7444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789635198.469279:0:7444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 00000000d7938e45/0xb0c3a59caa40ebd2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ebd9 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635198.469303:0:7444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 00000000d7938e45/0xb0c3a59caa40ebd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ebd9 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635198.469346:0:7444:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789635198.469349:0:7444:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d0550107000 10000000:01000000:3.0:1789635198.469351:0:7444:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d0550107000 10000000:01000000:3.0:1789635198.469355:0:7444:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789635198.469360:0:7444:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d0550107000 from 1 10000000:01000000:3.0:1789635198.469362:0:7444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789635198.469387:0:7444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 000000004cc746e5/0xb0c3a59caa40ebe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635198.469394:0:7444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 000000004cc746e5/0xb0c3a59caa40ebe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635198.469401:0:7444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 000000004cc746e5/0xb0c3a59caa40ebe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635198.469417:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000425a7faa pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427209472:0@lo:101: 00000100:00100000:3.0:1789635198.469456:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635198.469481:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 000000006b5604a3 going to sleep for 11 seconds 00000100:00100000:3.0:1789635198.469497:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427209472 00000100:00100000:3.0:1789635198.469502:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427209472 00000100:00100000:3.0:1789635198.469526:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789635198.469531:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000006d4433e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+16:7444:x1876568427209472:12345-0@lo:101: 00010000:00010000:3.0:1789635198.469548:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635198.469559:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c8630c26/0xb0c3a59caa40ebe7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ebe0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635198.469588:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c8630c26/0xb0c3a59caa40ebe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ebe0 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635198.469639:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c8630c26/0xb0c3a59caa40ebe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ebe0 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635198.469648:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c8630c26, rc 0) 00000100:00100000:3.0:1789635198.469678:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000006d4433e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+17:7444:x1876568427209472:12345-0@lo:101: Request processed in 147us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635198.469685:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789635198.469729:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000425a7faa pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427209472:0@lo:101: 00010000:00010000:3.0:1789635198.469740:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 000000004cc746e5/0xb0c3a59caa40ebe0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ebe7 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635198.469747:0:7444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 000000004cc746e5/0xb0c3a59caa40ebe0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ebe7 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635198.469802:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000425a7faa pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427209600:0@lo:501: 00000100:00100000:3.0:1789635198.469826:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635198.469853:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 000000006b5604a3 going to sleep for 11 seconds 00000100:00100000:1.0:1789635198.469963:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427209600 00000100:00100000:1.0:1789635198.469977:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427209600 00000100:00100000:1.0:1789635198.470009:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789635198.470016:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000043ce1b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+17:7444:x1876568427209600:12345-0@lo:501: 00000100:00100000:1.0:1789635198.470116:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000043ce1b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+17:7444:x1876568427209600:12345-0@lo:501: Request processed in 100us (289us total) trans 0 rc 0/0 00000020:01000000:2.0:1789635198.470124:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 00000100:00100000:1.0:1789635198.470143:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 10000000:01000000:2.0:1789635198.470151:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789635198.470156:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 0000000079a2551d/0xb0c3a59caa40eb85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40eb8c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.470164:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 0000000079a2551d/0xb0c3a59caa40eb85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40eb8c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635198.470174:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789635198.470176:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d057ae4b380 from 1 10000000:01000000:2.0:1789635198.470177:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789635198.470202:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 000000009a612eab/0xb0c3a59caa40ebee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.470209:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 000000009a612eab/0xb0c3a59caa40ebee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.470226:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 000000009a612eab/0xb0c3a59caa40ebee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635198.470238:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9fdbe5e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427209728:0@lo:101: 00000100:00100000:2.0:1789635198.470266:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635198.470295:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 000000002c982e86 going to sleep for 11 seconds 00000100:00100000:0.0:1789635198.470463:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427209728 00000100:00100000:0.0:1789635198.470468:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427209728 00000100:00100000:0.0:1789635198.470488:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789635198.470493:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002e3287ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+17:6512:x1876568427209728:12345-0@lo:101: 00010000:00010000:0.0:1789635198.470501:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635198.470511:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001769419a/0xb0c3a59caa40ebf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ebee expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.470523:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001769419a/0xb0c3a59caa40ebf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ebee expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.470529:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001769419a/0xb0c3a59caa40ebf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ebee expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.470535:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001769419a, rc 0) 00000100:00100000:0.0:1789635198.470565:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002e3287ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+18:6512:x1876568427209728:12345-0@lo:101: Request processed in 72us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635198.470570:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789635198.470592:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9fdbe5e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427209728:0@lo:101: 00010000:00010000:0.0:1789635198.470623:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 000000009a612eab/0xb0c3a59caa40ebee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ebf5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.470640:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 000000009a612eab/0xb0c3a59caa40ebee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ebf5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635198.470684:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d24a2dbd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427209856:0@lo:501: 00000100:00100000:0.0:1789635198.470720:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635198.470729:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 000000007163497d going to sleep for 11 seconds 00000100:00100000:0.0:1789635198.470744:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427209856 00000100:00100000:0.0:1789635198.470748:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427209856 00000100:00100000:0.0:1789635198.470762:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789635198.470766:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000531b01fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+18:6512:x1876568427209856:12345-0@lo:501: 00000100:00100000:0.0:1789635198.470815:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000531b01fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+18:6512:x1876568427209856:12345-0@lo:501: Request processed in 49us (95us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789635198.470827:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789635198.470848:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d24a2dbd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427209856:0@lo:501: 10000000:01000000:0.0:1789635198.470874:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789635198.470879:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 000000009a612eab/0xb0c3a59caa40ebee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ebf5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635198.470885:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 000000009a612eab/0xb0c3a59caa40ebee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ebf5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635198.470888:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000425a7faa pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427209600:0@lo:501: 00000100:00100000:3.0:1789635198.470927:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000425a7faa pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427209984:0@lo:503: 00000100:00100000:3.0:1789635198.471095:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635198.471127:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 000000006b5604a3 going to sleep for 11 seconds 00000100:00100000:1.0:1789635198.471707:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427209984 00000100:00100000:1.0:1789635198.471713:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427209984 00000100:00100000:1.0:1789635198.471749:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789635198.471756:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006ece675a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+18:7444:x1876568427209984:12345-0@lo:503: 00000100:00100000:1.0:1789635198.471856:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006ece675a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+18:7444:x1876568427209984:12345-0@lo:503: Request processed in 101us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635198.471864:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789635198.472065:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000425a7faa pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427209984:0@lo:503: 00000040:00080000:3.0:1789635198.472340:0:7444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789635198.472416:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000425a7faa pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427210112:0@lo:502: 00000100:00100000:3.0:1789635198.472452:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635198.472483:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 000000006b5604a3 going to sleep for 11 seconds 00000100:00100000:0.0:1789635198.472671:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427210112 00000100:00100000:0.0:1789635198.472677:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427210112 00000100:00100000:0.0:1789635198.472741:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789635198.472748:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d1a46c73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+18:7444:x1876568427210112:12345-0@lo:502: 00000100:00100000:0.0:1789635198.472832:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d1a46c73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+18:7444:x1876568427210112:12345-0@lo:502: Request processed in 84us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635198.472845:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789635198.473908:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000425a7faa pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427210112:0@lo:502: 00000040:00080000:3.0:1789635198.474293:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789635198.474320:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789635198.474343:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789635198.474384:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789635198.474407:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789635198.474422:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789635198.474434:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789635198.474447:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789635198.474459:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789635198.474469:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789635198.474480:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789635198.474492:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789635198.474505:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789635198.474519:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789635198.474531:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789635198.474542:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789635198.474570:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789635198.474583:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789635198.474637:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789635198.474655:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789635198.474670:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789635198.474684:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789635198.474697:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789635198.474717:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789635198.474730:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1789635198.474741:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1789635198.479349:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1789635198.479418:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1789635198.479469:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d24a2dbd pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427210240:0@lo:502: 00000100:00100000:0.0:1789635198.479564:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635198.479632:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f7a7ddf0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635198.479730:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427210240 00000100:00100000:2.0:1789635198.479737:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427210240 00000100:00100000:2.0:1789635198.479784:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789635198.479810:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000db3f1c74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+18:7444:x1876568427210240:12345-0@lo:502: 00000100:00100000:2.0:1789635198.479921:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000db3f1c74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+18:7444:x1876568427210240:12345-0@lo:502: Request processed in 129us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635198.479928:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789635198.482168:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d24a2dbd pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427210240:0@lo:502: 00000040:00080000:3.0:1789635198.482289:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1789635198.482305:0:7444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1789635198.482783:0:7469:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1789635198.482796:0:7469:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000001520d414) 00000020:00000080:3.0:1789635198.482817:0:7469:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type lwp with refcount 2 00000020:01000004:3.0:1789635198.482915:0:7469:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c3275346 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789635198.482918:0:7469:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000c3275346 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789635198.482921:0:7469:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000c3275346 3 00010000:00080000:3.0:1789635198.484147:0:7469:0:(ldlm_lib.c:102:import_set_conn()) imp 000000000eefd2fb@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.120@tcp at head 00010000:00010000:3.0:1789635198.488917:0:7469:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-4 is initialized 00000020:00000080:3.0:1789635198.489218:0:7469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1789635198.489260:0:7469:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789635198.489270:0:7469:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xb0c3a59caa40ec03 00000100:00080000:3.0:1789635198.489281:0:7469:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789635198.489291:0:7469:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000000eefd2fb using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789635198.489326:0:7469:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000425a7faa x1876568427210368/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789635198.489352:0:7469:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789635198.493257:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000425a7faa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876568427210368:0@lo:38: 00000100:00100000:0.0:1789635198.493338:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635198.493531:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427210368 00000100:00100000:3.0:1789635198.493540:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427210368 00000100:00100000:3.0:1789635198.493571:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789635198.493577:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b47da260 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1876568427210368:12345-0@lo:38: 00010000:00080000:3.0:1789635198.493622:0:6516:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:3.0:1789635198.493677:0:6516:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xb0c3a59caa40ec0a 00000004:00100000:3.0:1789635198.493693:0:6516:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789635198.493725:0:6516:0:(import.c:65:import_set_state_nolock()) 00000000cf24ec32 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789635198.493776:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b47da260 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876568427210368:12345-0@lo:38: Request processed in 198us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635198.493789:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789635198.493834:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000425a7faa x1876568427210368/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789635208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635198.493844:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789635198.493851:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1789635198.493858:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789635198.493862:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789635198.493865:0:3639:0:(import.c:65:import_set_state_nolock()) 000000000eefd2fb lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789635198.493872:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000425a7faa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876568427210368:0@lo:38: 40000000:00080000:0.0:1789635198.493965:0:7470:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000040:00080000:1.0:1789635198.493994:0:7469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1789635198.494090:0:7444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1789635198.494119:0:7444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789635198.494138:0:7444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 000000004cc746e5/0xb0c3a59caa40ebe0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ebe7 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635198.494148:0:7444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 000000004cc746e5/0xb0c3a59caa40ebe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ebe7 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789635198.494201:0:7444:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789635198.494204:0:7444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789635198.494205:0:7444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789635198.494207:0:7444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789635198.494208:0:7444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789635198.494209:0:7444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789635198.494210:0:7444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789635198.494212:0:7444:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789635198.494213:0:7444:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789635198.494214:0:7444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789635198.494215:0:7444:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789635198.494218:0:7444:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:3.0:1789635198.494220:0:7444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789635198.494226:0:7444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789635198.494227:0:7444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789635198.494228:0:7444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789635198.494229:0:7444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789635198.494229:0:7444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789635198.494230:0:7444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789635198.494231:0:7444:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789635198.494232:0:7444:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789635198.494232:0:7444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789635198.494233:0:7444:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789635198.494251:0:7444:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789635198.494261:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000425a7faa pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427210496:0@lo:253: 00000100:00100000:3.0:1789635198.494326:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635198.494374:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 0000000040bdb06b going to sleep for 11 seconds 00000100:00100000:1.0:1789635198.494629:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427210496 00000100:00100000:1.0:1789635198.494636:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427210496 00000100:00100000:1.0:1789635198.494681:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789635198.494689:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b197a961 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+18:7444:x1876568427210496:12345-0@lo:253: 20000000:01000000:1.0:1789635198.494711:0:6506:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789635198.494723:0:6506:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1789635198.499275:0:6493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1789635198.500278:0:6506:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789635198.500295:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1789635198.501257:0:6530:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789635198.501264:0:6530:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789635198.501286:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d307fb45/0xb0c3a59caa40ec11 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.501302:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000fc2125df/0xb0c3a59caa40eaf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40eaeb expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.501309:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c5e66dd5/0xb0c3a59caa40ebcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ebc4 expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.501315:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d307fb45/0xb0c3a59caa40ec11 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.501352:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c5e66dd5/0xb0c3a59caa40ebcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40ebc4 expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.501378:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c5e66dd5/0xb0c3a59caa40ebcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40ebc4 expref: 18 pid: 6508 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635198.501391:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000074b8d150 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1876568427210624:0@lo:104: 00000100:00100000:2.0:1789635198.501449:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789635198.501498:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000fc2125df/0xb0c3a59caa40eaf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40eaeb expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.501507:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000fc2125df/0xb0c3a59caa40eaf2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40eaeb expref: 18 pid: 6506 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635198.501516:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002fd73580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1876568427210752:0@lo:104: 00000100:00100000:2.0:1789635198.501538:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635198.501558:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set 000000002c982e86 going to sleep for 11 seconds 00000100:00100000:2.0:1789635198.501591:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427210624 00000100:00100000:2.0:1789635198.501620:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427210624 00000100:00100000:2.0:1789635198.501662:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427210752 00000100:00100000:2.0:1789635198.501665:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427210752 00000100:00100000:1.0:1789635198.501676:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789635198.501688:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000658b6670 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+4:6530:x1876568427210624:12345-0@lo:104: 00010000:00010000:1.0:1789635198.501700:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: 000000007a224277/0xb0c3a59caa40ebc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ebcb expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.501763:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789635198.501769:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000658b6670 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+4:6530:x1876568427210624:12345-0@lo:104: Request processed in 85us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635198.501775:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789635198.501779:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074b8d150 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1876568427210624:0@lo:104: 00000100:00100000:1.0:1789635198.501801:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789635198.501818:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000468684df pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+3:6530:x1876568427210752:12345-0@lo:104: 00010000:00010000:1.0:1789635198.501826:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: 000000001139aef4/0xb0c3a59caa40eaeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40eaf2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.501926:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789635198.501931:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000468684df pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+3:6530:x1876568427210752:12345-0@lo:104: Request processed in 115us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635198.501938:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1789635198.501956:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789635198.501961:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: 000000007a224277/0xb0c3a59caa40ebc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ebcb expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.501968:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007a224277 already unused, calling callback (00000000af9d8a27) 10000000:00010000:1.0:1789635198.501971:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: 000000007a224277/0xb0c3a59caa40ebc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40ebcb expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.501979:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: 000000007a224277/0xb0c3a59caa40ebc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40ebcb expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789635198.501986:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: 000000007a224277/0xb0c3a59caa40ebc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40ebcb expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635198.501991:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789635198.502024:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: 000000007a224277/0xb0c3a59caa40ebc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ebcb expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.502030:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789635198.502045:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: 000000007a224277/0xb0c3a59caa40ebc4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ebcb expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.502061:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: 000000007a224277/0xb0c3a59caa40ebc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ebcb expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.502081:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635198.502084:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: 000000001139aef4/0xb0c3a59caa40eaeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40eaf2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.502089:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001139aef4 already unused, calling callback (00000000af9d8a27) 10000000:00010000:1.0:1789635198.502091:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: 000000001139aef4/0xb0c3a59caa40eaeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40eaf2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.502097:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: 000000001139aef4/0xb0c3a59caa40eaeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40eaf2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789635198.502101:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: 000000001139aef4/0xb0c3a59caa40eaeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40eaf2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635198.502105:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789635198.502120:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: 000000001139aef4/0xb0c3a59caa40eaeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40eaf2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.502126:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789635198.502144:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: 000000001139aef4/0xb0c3a59caa40eaeb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40eaf2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.502151:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: 000000001139aef4/0xb0c3a59caa40eaeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40eaf2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635198.502156:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1789635198.502164:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635198.502169:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c2ad7e3e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427211008:0@lo:103: 00010000:00010000:1.0:1789635198.502174:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635198.502176:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635198.502184:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635198.502215:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635198.502263:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b197a961 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+18:7444:x1876568427210496:12345-0@lo:253: Request processed in 7575us (7937us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635198.502273:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789635198.502280:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000425a7faa pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:7444:1876568427210496:0@lo:253: 10000000:01000000:3.0:1789635198.502292:0:7444:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1789635198.502295:0:7444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789635198.502298:0:7444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789635198.502299:0:7444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789635198.502301:0:7444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789635198.502302:0:7444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789635198.502303:0:7444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789635198.502305:0:7444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789635198.502306:0:7444:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789635198.502307:0:7444:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789635198.502309:0:7444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789635198.502310:0:7444:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789635198.502335:0:7444:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789635198.503112:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005b9c8a7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427210880:0@lo:103: 00000100:00100000:0.0:1789635198.503154:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635198.504740:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427211008 00000100:00100000:1.0:1789635198.504752:0:7457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427211008 00010000:00010000:1.0:1789635198.504789:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000fc2125df/0xb0c3a59caa40eaf2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40eaeb expref: 18 pid: 6506 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635198.504825:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427210880 00000100:00100000:1.0:1789635198.504829:0:7457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427210880 00010000:00010000:1.0:1789635198.504839:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c5e66dd5/0xb0c3a59caa40ebcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ebc4 expref: 19 pid: 6508 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635198.504856:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789635198.504863:0:7457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b7d4ea08 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6356ed01-c755-4f9e-b839-20feb7c3f098+19:3643:x1876568427211008:12345-0@lo:103: 00010000:00010000:1.0:1789635198.504875:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635198.504880:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000fc2125df/0xb0c3a59caa40eaf2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40eaeb expref: 19 pid: 6506 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.504888:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000fc2125df/0xb0c3a59caa40eaf2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40eaeb expref: 19 pid: 6506 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.504908:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635198.504970:0:7457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b7d4ea08 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6356ed01-c755-4f9e-b839-20feb7c3f098+19:3643:x1876568427211008:12345-0@lo:103: Request processed in 109us (2756us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635198.504978:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789635198.504995:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789635198.505001:0:7457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bacef478 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6356ed01-c755-4f9e-b839-20feb7c3f098+18:3641:x1876568427210880:12345-0@lo:103: 00010000:00010000:1.0:1789635198.505021:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635198.505025:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c5e66dd5/0xb0c3a59caa40ebcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ebc4 expref: 18 pid: 6508 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.505032:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c5e66dd5/0xb0c3a59caa40ebcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40ebc4 expref: 18 pid: 6508 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.505041:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c5e66dd5/0xb0c3a59caa40ebcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40ebc4 expref: 18 pid: 6508 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.505056:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d307fb45/0xb0c3a59caa40ec11 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.505063:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d307fb45/0xb0c3a59caa40ec11 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789635198.505077:0:7457:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003814006s 00010000:00010000:1.0:1789635198.505081:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d307fb45/0xb0c3a59caa40ec11 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.505087:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d307fb45/0xb0c3a59caa40ec11 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.505092:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d307fb45/0xb0c3a59caa40ec11 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.505098:0:7457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d307fb45/0xb0c3a59caa40ec11 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.505104:0:7457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d307fb45 already unused, calling callback (0000000034729756) 00010000:00010000:1.0:1789635198.505106:0:7457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d307fb45/0xb0c3a59caa40ec11 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.505121:0:7457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d307fb45/0xb0c3a59caa40ec11 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.505129:0:7457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d307fb45/0xb0c3a59caa40ec11 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635198.505140:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635198.505168:0:7457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bacef478 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6356ed01-c755-4f9e-b839-20feb7c3f098+17:3641:x1876568427210880:12345-0@lo:103: Request processed in 168us (2014us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635198.505174:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789635198.506696:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c2ad7e3e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427211008:0@lo:103: 00000100:00100000:0.0:1789635198.509317:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005b9c8a7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427210880:0@lo:103: 00010000:00010000:2.0:1789635198.511824:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fc2125df/0xb0c3a59caa40eaf2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40eaeb expref: 16 pid: 6506 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635198.511858:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002fd73580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1876568427210752:0@lo:104: 00010000:00010000:2.0:1789635198.511885:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d307fb45/0xb0c3a59caa40ec11 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.511895:0:6530:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d307fb45/0xb0c3a59caa40ec11 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.511912:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d307fb45/0xb0c3a59caa40ec11 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635198.511917:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d307fb45/0xb0c3a59caa40ec11 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1789635198.512041:0:7444:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:3.0:1789635198.512217:0:7444:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1789635198.512437:0:7444:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1789635198.512694:0:7444:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1789635198.512904:0:7444:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1789635198.513071:0:7444:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1789635198.518923:0:7444:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1789635198.519173:0:7444:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1789635198.519372:0:7444:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:1.0:1789635198.519535:0:7444:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1789635198.519758:0:7444:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:1.0:1789635198.519963:0:7444:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1789635198.521440:0:7444:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1789635198.521706:0:7475:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1789635198.521754:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000425a7faa pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7475:1876568427211136:0@lo:700: 00000100:00100000:3.0:1789635198.521817:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635198.521857:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427211136 00000100:00100000:3.0:1789635198.521864:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427211136 00000100:00100000:3.0:1789635198.521925:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789635198.521933:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006d76f3c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7475:x1876568427211136:12345-0@lo:700: 00000100:00100000:3.0:1789635198.522021:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cf31b9a0 going to sleep for 11 seconds 00000040:01000000:0.0:1789635198.522068:0:7444:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000020:00080000:2.0:1789635198.522443:0:7474:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1789635198.522447:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:0.0:1789635198.527484:0:7476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009f5ca71a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1876568427211264:0@lo:1000: 00000100:00100000:0.0:1789635198.527563:0:7476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635198.527637:0:7476:0:(client.c:2716:ptlrpc_set_wait()) set 000000005712a2ba going to sleep for 11 seconds 00000100:00100000:1.0:1789635198.527820:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427211264 00000100:00100000:1.0:1789635198.527828:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427211264 00000100:00100000:1.0:1789635198.527881:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789635198.527888:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000018cb8c3e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1876568427211264:12345-0@lo:1000: 00000100:00100000:1.0:1789635198.527964:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000018cb8c3e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1876568427211264:12345-0@lo:1000: Request processed in 76us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635198.527971:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789635198.528224:0:7476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009f5ca71a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1876568427211264:0@lo:1000: 00000040:01000000:0.0:1789635198.528254:0:7476:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:0.0:1789635198.528279:0:7476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009f5ca71a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1876568427211392:0@lo:700: 00000100:00100000:0.0:1789635198.528305:0:7476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635198.528359:0:7476:0:(client.c:2716:ptlrpc_set_wait()) set 0000000021231214 going to sleep for 11 seconds 00000100:00100000:2.0:1789635198.531816:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427211392 00000100:00100000:2.0:1789635198.531831:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427211392 00000100:00100000:2.0:1789635198.531891:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789635198.531900:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000038a49d3f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7476:x1876568427211392:12345-0@lo:700: 00000100:00100000:2.0:1789635198.532085:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000038a49d3f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7476:x1876568427211392:12345-0@lo:700: Request processed in 185us (3778us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635198.532233:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:3.0:1789635198.532302:0:7444:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1789635198.532487:0:7444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789635198.532936:0:7444:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789635198.533017:0:7444:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:1.0:1789635198.533122:0:7476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009f5ca71a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1876568427211392:0@lo:700: 00000100:00100000:1.0:1789635198.533205:0:7476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c2ad7e3e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7476:1876568427211520:0@lo:900: 00000040:00080000:2.0:1789635198.533220:0:7444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789635198.533265:0:7476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635198.533297:0:7476:0:(client.c:2716:ptlrpc_set_wait()) set 0000000015c3645d going to sleep for 11 seconds 00000100:00100000:3.0:1789635198.533361:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427211520 00000100:00100000:3.0:1789635198.533367:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427211520 00000100:00100000:3.0:1789635198.533407:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789635198.533414:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bb896094 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7476:x1876568427211520:12345-0@lo:900: 00000100:00100000:3.0:1789635198.533508:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bb896094 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7476:x1876568427211520:12345-0@lo:900: Request processed in 95us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635198.533515:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789635198.533976:0:7476:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c2ad7e3e x1876568427211520/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789635214 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635198.533988:0:7476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c2ad7e3e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7476:1876568427211520:0@lo:900: 00000100:00100000:1.0:1789635198.534145:0:7476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c2ad7e3e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1876568427211648:0@lo:1000: 00000100:00100000:1.0:1789635198.534179:0:7476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635198.534217:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427211648 00000100:00100000:1.0:1789635198.534221:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427211648 00000100:00100000:1.0:1789635198.534259:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789635198.534297:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000056309ff6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1876568427211648:12345-0@lo:1000: 00000040:00080000:2.0:1789635198.534358:0:7444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:1.0:1789635198.534371:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000056309ff6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1876568427211648:12345-0@lo:1000: Request processed in 93us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635198.534378:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 40000000:02000000:1.0:1789635198.534433:0:6521:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000040:00080000:2.0:1789635198.534923:0:7444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789635198.534952:0:7444:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1789635198.535124:0:7444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1789635198.535459:0:7444:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1789635198.536019:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1789635198.536159:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00000100:00100000:0.0:1789635198.540696:0:7476:0:(client.c:2716:ptlrpc_set_wait()) set 00000000764e2808 going to sleep for 11 seconds 00000100:00100000:0.0:1789635198.540743:0:7476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c2ad7e3e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1876568427211648:0@lo:1000: 00000004:00080000:0.0:1789635198.540825:0:7476:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000015c3645d with version 0 00000020:00100000:0.0:1789635198.540853:0:7476:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789635198.540872:0:7476:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000a9eeef03 x1876568427211904/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789635198.540894:0:7476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a9eeef03 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1876568427211904:0@lo:1000: 00000100:00100000:0.0:1789635198.540959:0:7476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635198.540998:0:7476:0:(client.c:2716:ptlrpc_set_wait()) set 000000005712a2ba going to sleep for 11 seconds 00100000:10000000:3.0:1789635198.541347:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789635198.541540:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789635198.541748:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789635198.541934:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789635198.542069:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789635198.542214:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789635198.542371:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789635198.542495:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789635198.542666:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789635198.542798:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789635198.542948:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789635198.543073:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789635198.543209:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1789635198.543336:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1789635198.543753:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00000100:00100000:0.0:1789635198.543825:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427211904 00000100:00100000:0.0:1789635198.543836:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427211904 00000100:00100000:0.0:1789635198.543899:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789635198.543910:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d24a2dbd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1876568427211904:12345-0@lo:1000: 00100000:10000000:2.0:1789635198.544300:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1789635198.544472:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1789635198.544824:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1789635198.545125:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1789635198.545454:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1789635198.545736:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00000100:00100000:1.0:1789635198.547347:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006d76f3c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7475:x1876568427211136:12345-0@lo:700: Request processed in 25408us (25523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635198.547366:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789635198.547560:0:7475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000425a7faa x1876568427211136/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789635214 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635198.547576:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000425a7faa pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7475:1876568427211136:0@lo:700: 40000000:02000000:0.0:1789635198.547590:0:7475:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:2.0:1789635198.548422:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1789635198.548631:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1789635198.548784:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1789635198.548921:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1789635198.549140:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1789635198.549310:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1789635198.549446:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1789635198.549576:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1789635198.549753:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1789635198.549946:0:7444:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1789635198.554787:0:7444:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789635198.554821:0:7444:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa6bb41c63988 00100000:10000000:2.0:1789635198.554828:0:7444:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1789635198.556865:0:7444:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789635198.556897:0:7444:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.120@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789635198.556913:0:7444:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789635198.556930:0:7444:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000001:00080000:1.0:1789635198.557559:0:6493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:0.0:1789635198.557834:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d24a2dbd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1876568427211904:12345-0@lo:1000: Request processed in 13924us (16872us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789635198.557847:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000004:00080000:1.0:1789635198.557912:0:7476:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1789635198.557916:0:7476:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789635198.557928:0:7476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a9eeef03 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1876568427211904:0@lo:1000: 00000020:00000004:2.0:1789635198.557970:0:7444:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000100:00100000:1.0:1789635198.558005:0:7476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cb5d4222 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1876568427212032:0@lo:1000: 00000100:00100000:1.0:1789635198.558049:0:7476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000004:2.0:1789635198.558141:0:7444:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:1.0:1789635198.558180:0:7476:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d9091a4 going to sleep for 11 seconds 00000100:00100000:0.0:1789635198.558228:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427212032 00000100:00100000:0.0:1789635198.558234:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427212032 00000100:00100000:0.0:1789635198.558369:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789635198.558378:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000751863a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1876568427212032:12345-0@lo:1000: 00000100:00100000:0.0:1789635198.558444:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000751863a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1876568427212032:12345-0@lo:1000: Request processed in 67us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635198.558451:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789635198.558497:0:7476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cb5d4222 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1876568427212032:0@lo:1000: 00000040:00080000:1.0:1789635198.558519:0:7476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1789635198.558545:0:7476:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000015c3645d with version 1 00000004:00080000:1.0:1789635198.558561:0:7463:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000000e6412a9 version 1 rpc_version 1 00000020:00100000:1.0:1789635198.558575:0:7463:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789635198.558581:0:7463:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000cb5d4222 x1876568427212288/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789635198.558614:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cb5d4222 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7463:1876568427212288:0@lo:1000: 00000100:00100000:1.0:1789635198.558639:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635198.558653:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d5a42511 going to sleep for 11 seconds 00000100:00100000:1.0:1789635198.558666:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427212288 00000100:00100000:1.0:1789635198.558669:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427212288 00000100:00100000:1.0:1789635198.558687:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789635198.558692:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008bb011d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7463:x1876568427212288:12345-0@lo:1000: 00000001:00080000:1.0:1789635198.563382:0:6493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1789635198.563498:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008bb011d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7463:x1876568427212288:12345-0@lo:1000: Request processed in 4802us (4855us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789635198.563511:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000004:00080000:1.0:1789635198.563561:0:7463:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1789635198.563565:0:7463:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789635198.563581:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cb5d4222 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7463:1876568427212288:0@lo:1000: 00000040:00080000:1.0:1789635198.566650:0:7476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789635198.566718:0:7476:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1789635198.595709:0:7475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789635198.608092:0:7475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789635198.608161:0:7475:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789635198.608171:0:7475:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:1.0:1789635199.011770:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635199.459705:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 0000000086536b99 going to sleep for 0 seconds 00010000:00010000:0.0:1789635200.041234:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635200.484201:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 0000000086536b99 going to sleep for 0 seconds 00010000:00010000:2.0:1789635201.060892:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635201.507883:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 0000000086536b99 going to sleep for 0 seconds 00010000:00010000:1.0:1789635202.091378:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789635202.315806:0:7720:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789635202.532148:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 0000000086536b99 going to sleep for 0 seconds 00000020:00000004:1.0:1789635203.036496:0:7772:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789635203.036889:0:7772:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789635203.108923:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789635203.493105:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789635203.493120:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789635203.493123:0:36:0:(import.c:65:import_set_state_nolock()) 00000000cd3db1c8 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789635203.493141:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000cd3db1c8 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1789635203.493173:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000090655e77 x1876568427212800/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789635203.493215:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cb5d4222 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427212416:0@lo:400: 00000100:00100000:1.0:1789635203.493273:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635203.493319:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789635203.493325:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ac321d9f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876568427212928:0@lo:400: 00000100:00100000:1.0:1789635203.493395:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635203.493426:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000627100c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427212544:0@lo:400: 00000100:00100000:1.0:1789635203.493449:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635203.493465:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789635203.493470:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000024f4cd6b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427212672:0@lo:400: 00000100:00100000:1.0:1789635203.493491:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635203.493518:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427212416 00000100:00100000:1.0:1789635203.493525:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427212416 00000100:00100000:1.0:1789635203.493566:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789635203.493573:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000515de3df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+16:3643:x1876568427212416:12345-0@lo:400: 00000100:00100000:1.0:1789635203.493636:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000515de3df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+16:3643:x1876568427212416:12345-0@lo:400: Request processed in 64us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635203.493642:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789635203.493674:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427212928 00000100:00100000:1.0:1789635203.493678:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427212928 00000100:00100000:1.0:1789635203.493699:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427212544 00000100:00100000:1.0:1789635203.493702:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427212544 00000100:00100000:1.0:1789635203.493715:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789635203.493727:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000171cff50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876568427212928:12345-0@lo:400: 00000100:00100000:1.0:1789635203.493779:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000171cff50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876568427212928:12345-0@lo:400: Request processed in 54us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635203.493785:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789635203.493797:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789635203.493803:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c2ad7e3e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427212544:12345-0@lo:400: 00000100:00100000:1.0:1789635203.493832:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c2ad7e3e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427212544:12345-0@lo:400: Request processed in 30us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635203.493838:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789635203.493857:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427212672 00000100:00100000:1.0:1789635203.493860:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427212672 00000100:00100000:1.0:1789635203.493884:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789635203.493890:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005b9c8a7b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427212672:12345-0@lo:400: 00000100:00100000:1.0:1789635203.493922:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005b9c8a7b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427212672:12345-0@lo:400: Request processed in 32us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635203.493928:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789635203.493961:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000ac321d9f x1876568427212928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635203.493974:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ac321d9f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876568427212928:0@lo:400: 00000100:00100000:1.0:1789635203.493983:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cb5d4222 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427212416:0@lo:400: 00000100:00100000:1.0:1789635203.494009:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000024f4cd6b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427212672:0@lo:400: 00010000:00080000:1.0:1789635203.494017:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000627100c8 x1876568427212544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635203.494024:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000627100c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427212544:0@lo:400: 00000100:00100000:3.0:1789635203.494295:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000090655e77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427212800:0@lo:38: 00000100:00100000:3.0:1789635203.494329:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635203.494478:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427212800 00000100:00100000:1.0:1789635203.494483:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427212800 00000100:00100000:1.0:1789635203.494511:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789635203.494515:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003409249f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3639:x1876568427212800:12345-0@lo:38: 00010000:00080000:1.0:1789635203.494537:0:6520:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:1.0:1789635203.494567:0:6520:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb0c3a59caa40ec18 00000004:00100000:1.0:1789635203.494580:0:6520:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789635203.494586:0:6520:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1789635203.495852:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789635203.495869:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000627100c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427213056:0@lo:41: 00000100:00100000:0.0:1789635203.495921:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635203.496038:0:6519:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1789635203.496047:0:6519:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1789635203.499001:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427213056 00000100:00100000:1.0:1789635203.499013:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427213056 00000100:00100000:3.0:1789635203.499194:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789635203.499204:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000226fe2ca pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427213056:12345-0@lo:41: 00000004:00000024:3.0:1789635203.499239:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1789635203.499320:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000226fe2ca pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427213056:12345-0@lo:41: Request processed in 118us (3399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635203.499327:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789635203.499404:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000627100c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427213056:0@lo:41: 00000100:00080000:1.0:1789635203.514001:0:6520:0:(import.c:65:import_set_state_nolock()) 00000000325a4675 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789635203.514306:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003409249f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1876568427212800:12345-0@lo:38: Request processed in 19788us (19975us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635203.514317:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1789635203.515541:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789635203.515554:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789635203.515561:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789635203.515563:0:3639:0:(import.c:65:import_set_state_nolock()) 00000000cd3db1c8 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1789635203.515585:0:3639:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000086536b99): req@000000007b27d83b x1876568427208832/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635203.515622:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000090655e77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427212800:0@lo:38: 00000100:00100000:1.0:1789635203.515717:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789635203.515734:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000024f4cd6b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427213184:0@lo:41: 00000100:00100000:1.0:1789635203.515803:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635203.515905:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427213184 00000100:00100000:1.0:1789635203.515912:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427213184 00000100:00100000:2.0:1789635203.515966:0:7467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635203.515972:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789635203.515988:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cb5d4222 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1876568427213184:12345-0@lo:41: 00000100:00100000:2.0:1789635203.515997:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 0000000086536b99 going to sleep for 11 seconds 00000004:00000024:1.0:1789635203.516027:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1789635203.516168:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cb5d4222 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1876568427213184:12345-0@lo:41: Request processed in 166us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635203.516175:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000024f4cd6b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427213184:0@lo:41: 00000100:00100000:1.0:1789635203.516181:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789635203.516204:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427208832 00000100:00100000:1.0:1789635203.516214:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427208832 00000100:00100000:1.0:1789635203.516483:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789635203.516491:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002fd73580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7467:x1876568427208832:12345-0@lo:1000: 00000100:00100000:1.0:1789635203.517321:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002fd73580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7467:x1876568427208832:12345-0@lo:1000: Request processed in 830us (1356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635203.517331:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789635203.517429:0:7467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007b27d83b pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7467:1876568427208832:0@lo:1000: 00000040:01000000:1.0:1789635203.517464:0:7467:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789635203.517504:0:7467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ac321d9f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7467:1876568427213312:0@lo:1000: 00000100:00100000:1.0:1789635203.517543:0:7467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635203.518314:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 000000007d21814c going to sleep for 11 seconds 00000100:00100000:1.0:1789635203.527816:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427213312 00000100:00100000:1.0:1789635203.527832:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427213312 00000100:00100000:1.0:1789635203.527893:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789635203.527903:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000028aa8cbc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7467:x1876568427213312:12345-0@lo:1000: 00000100:00100000:1.0:1789635203.528144:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000028aa8cbc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7467:x1876568427213312:12345-0@lo:1000: Request processed in 243us (10600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635203.528165:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789635203.528206:0:7467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ac321d9f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7467:1876568427213312:0@lo:1000: 00000100:00100000:1.0:1789635203.529413:0:7467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ac321d9f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7467:1876568427213440:0@lo:700: 00000100:00100000:1.0:1789635203.529458:0:7467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635203.529538:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 000000006f73d2ce going to sleep for 11 seconds 00000100:00100000:2.0:1789635203.529684:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427213440 00000100:00100000:2.0:1789635203.529691:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427213440 00000100:00100000:2.0:1789635203.529892:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789635203.529902:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002c7a7574 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7467:x1876568427213440:12345-0@lo:700: 00000100:00100000:2.0:1789635203.529964:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002c7a7574 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7467:x1876568427213440:12345-0@lo:700: Request processed in 65us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635203.529973:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789635203.530028:0:7467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ac321d9f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7467:1876568427213440:0@lo:700: 00000100:00100000:1.0:1789635203.530697:0:7467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ac321d9f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7467:1876568427213568:0@lo:1000: 00000100:00100000:1.0:1789635203.531337:0:7467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635203.531358:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 00000000562bb205 going to sleep for 11 seconds 00000100:00100000:3.0:1789635203.532505:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427213568 00000100:00100000:3.0:1789635203.532525:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427213568 00000100:00100000:3.0:1789635203.532579:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789635203.532587:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000969b03cd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7467:x1876568427213568:12345-0@lo:1000: 00000100:00100000:3.0:1789635203.532737:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000969b03cd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7467:x1876568427213568:12345-0@lo:1000: Request processed in 151us (1401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635203.532755:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789635203.532775:0:7467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ac321d9f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7467:1876568427213568:0@lo:1000: 00000004:00080000:1.0:1789635203.532841:0:7467:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000006f73d2ce with version 0 00000020:00100000:1.0:1789635203.532874:0:7467:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789635203.532882:0:7467:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000ac321d9f x1876568427213824/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789635203.532900:0:7467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ac321d9f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7467:1876568427213824:0@lo:1000: 00000100:00100000:1.0:1789635203.532932:0:7467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635203.532960:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 00000000391320eb going to sleep for 11 seconds 00000100:00100000:2.0:1789635203.533074:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427213824 00000100:00100000:2.0:1789635203.533080:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427213824 00000100:00100000:2.0:1789635203.533112:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789635203.533118:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000095591951 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7467:x1876568427213824:12345-0@lo:1000: 00000001:00080000:3.0:1789635203.535500:0:7446:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:3.0:1789635203.535513:0:7446:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789635203.536353:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000095591951 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7467:x1876568427213824:12345-0@lo:1000: Request processed in 3231us (3417us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789635203.536366:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:1.0:1789635203.536454:0:7467:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1789635203.536459:0:7467:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789635203.536488:0:7467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ac321d9f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7467:1876568427213824:0@lo:1000: 00000100:00100000:1.0:1789635203.536576:0:7467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ac321d9f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7467:1876568427213952:0@lo:1000: 00000100:00100000:1.0:1789635203.536642:0:7467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635203.536674:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 000000007d21814c going to sleep for 11 seconds 00000100:00100000:3.0:1789635203.538640:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427213952 00000100:00100000:3.0:1789635203.538654:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427213952 00000100:00100000:2.0:1789635203.539123:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789635203.539132:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000024f4cd6b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7467:x1876568427213952:12345-0@lo:1000: 00000100:00100000:2.0:1789635203.539260:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000024f4cd6b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7467:x1876568427213952:12345-0@lo:1000: Request processed in 129us (2617us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635203.539267:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789635203.539343:0:7467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ac321d9f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7467:1876568427213952:0@lo:1000: 00000040:00080000:1.0:1789635203.539375:0:7467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1789635203.539412:0:7467:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000006f73d2ce with version 1 00000004:00080000:2.0:1789635203.539552:0:7465:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000c48b8a71 version 1 rpc_version 1 00000020:00100000:2.0:1789635203.539573:0:7465:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789635203.539579:0:7465:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000074b8d150 x1876568427214208/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789635203.539613:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000074b8d150 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7465:1876568427214208:0@lo:1000: 00000100:00100000:2.0:1789635203.539646:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635203.539663:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 00000000efd136b0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635203.539704:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427214208 00000100:00100000:3.0:1789635203.539710:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427214208 00000100:00100000:3.0:1789635203.539734:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789635203.539740:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007958c9db pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7465:x1876568427214208:12345-0@lo:1000: 00000040:00080000:1.0:1789635203.541633:0:7467:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789635203.541709:0:7467:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 5, retries 0 00000004:00080000:1.0:1789635203.541714:0:7467:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:0.0:1789635203.543664:0:7446:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:3.0:1789635203.543868:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007958c9db pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7465:x1876568427214208:12345-0@lo:1000: Request processed in 4124us (4218us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789635203.543881:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:2.0:1789635203.543933:0:7465:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1789635203.543938:0:7465:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789635203.543955:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074b8d150 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7465:1876568427214208:0@lo:1000: 00010000:00010000:2.0:1789635204.131773:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635205.159372:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789635205.678568:0:7875:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789635205.678772:0:7875:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1789635206.051741:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789635206.051753:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d0550107000 from 4 10000000:01000000:0.0:1789635206.051759:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789635206.051823:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 0000000070cbb084/0xb0c3a59caa40ec1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635206.051839:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 0000000070cbb084/0xb0c3a59caa40ec1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635206.051854:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 0000000070cbb084/0xb0c3a59caa40ec1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635206.051886:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cd448740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427214336:0@lo:101: 00000100:00100000:0.0:1789635206.051981:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635206.052049:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 000000000c1f95db going to sleep for 11 seconds 00000100:00100000:1.0:1789635206.052401:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427214336 00000100:00100000:1.0:1789635206.052413:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427214336 00000100:00100000:1.0:1789635206.052487:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789635206.052497:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cf7da620 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+16:6512:x1876568427214336:12345-0@lo:101: 00010000:00010000:1.0:1789635206.052514:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635206.052551:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009ffe2b7e/0xb0c3a59caa40ec26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ec1f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635206.052579:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009ffe2b7e/0xb0c3a59caa40ec26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ec1f expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635206.052591:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009ffe2b7e/0xb0c3a59caa40ec26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ec1f expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635206.052641:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009ffe2b7e, rc 0) 00000100:00100000:1.0:1789635206.052697:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cf7da620 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+17:6512:x1876568427214336:12345-0@lo:101: Request processed in 202us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635206.052704:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789635206.052829:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cd448740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427214336:0@lo:101: 00010000:00010000:0.0:1789635206.052846:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 0000000070cbb084/0xb0c3a59caa40ec1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ec26 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635206.052866:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 0000000070cbb084/0xb0c3a59caa40ec1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ec26 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635206.052924:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cd448740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427214464:0@lo:256: 00000100:00100000:0.0:1789635206.052961:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635206.053026:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 000000000c1f95db going to sleep for 11 seconds 00000100:00100000:1.0:1789635206.056393:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427214464 00000100:00100000:1.0:1789635206.056416:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427214464 00000100:00100000:1.0:1789635206.056486:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789635206.056496:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000aba9b605 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+17:6512:x1876568427214464:12345-0@lo:256: 20000000:01000000:1.0:1789635206.056530:0:6509:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789635206.056559:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789635206.056563:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1789635206.056747:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000aba9b605 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+17:6512:x1876568427214464:12345-0@lo:256: Request processed in 252us (3785us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635206.056756:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789635206.056836:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cd448740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427214464:0@lo:256: 10000000:01000000:1.0:1789635206.056899:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789635206.056909:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 0000000070cbb084/0xb0c3a59caa40ec1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ec26 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635206.056920:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 0000000070cbb084/0xb0c3a59caa40ec1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ec26 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635206.056940:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789635206.056942:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d0558960000 from 4 10000000:01000000:1.0:1789635206.056945:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789635206.056984:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 00000000328d38f1/0xb0c3a59caa40ec2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635206.056992:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 00000000328d38f1/0xb0c3a59caa40ec2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635206.057002:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 00000000328d38f1/0xb0c3a59caa40ec2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635206.057024:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ac321d9f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427214592:0@lo:101: 00000100:00100000:1.0:1789635206.057060:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635206.057095:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 00000000eaedf245 going to sleep for 11 seconds 00000100:00100000:1.0:1789635206.057118:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427214592 00000100:00100000:1.0:1789635206.057122:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427214592 00000100:00100000:1.0:1789635206.057157:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789635206.057164:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f11ade77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+17:6512:x1876568427214592:12345-0@lo:101: 00010000:00010000:1.0:1789635206.057175:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635206.058383:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000785530c2/0xb0c3a59caa40ec34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ec2d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635206.058429:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000785530c2/0xb0c3a59caa40ec34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ec2d expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635206.058442:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000785530c2/0xb0c3a59caa40ec34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ec2d expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635206.058471:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000785530c2, rc 0) 00000100:00100000:1.0:1789635206.058554:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f11ade77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+18:6512:x1876568427214592:12345-0@lo:101: Request processed in 1389us (1493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635206.058562:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789635206.058645:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ac321d9f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427214592:0@lo:101: 00010000:00010000:1.0:1789635206.058663:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 00000000328d38f1/0xb0c3a59caa40ec2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ec34 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635206.058672:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 00000000328d38f1/0xb0c3a59caa40ec2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ec34 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635206.058734:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ac321d9f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427214720:0@lo:256: 00000100:00100000:1.0:1789635206.058776:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635206.058811:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 00000000eaedf245 going to sleep for 11 seconds 00000100:00100000:1.0:1789635206.058830:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427214720 00000100:00100000:1.0:1789635206.058837:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427214720 00000100:00100000:1.0:1789635206.058874:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789635206.058882:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bbcd7c49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+18:6512:x1876568427214720:12345-0@lo:256: 20000000:01000000:1.0:1789635206.058902:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789635206.058920:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789635206.058923:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1789635206.058998:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bbcd7c49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+18:6512:x1876568427214720:12345-0@lo:256: Request processed in 118us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635206.059005:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789635206.059036:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ac321d9f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427214720:0@lo:256: 10000000:01000000:1.0:1789635206.059077:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789635206.059089:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 00000000328d38f1/0xb0c3a59caa40ec2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ec34 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635206.059096:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 00000000328d38f1/0xb0c3a59caa40ec2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ec34 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635206.180421:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789635206.612941:0:7923:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde6b78f00 20000000:00000080:2.0:1789635206.612959:0:7923:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d0575891800 uarg=0000000000000000 20000000:01000000:2.0:1789635206.613009:0:7923:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789635206.613016:0:7923:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789635206.613020:0:7923:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789635206.613089:0:7923:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1789635206.613101:0:7923:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1789635206.621217:0:7923:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789635206.621456:0:7923:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789635206.621499:0:7923:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1789635206.621513:0:7923:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1789635206.621527:0:7923:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789635206.621545:0:7923:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000032a2161f/0xb0c3a59caa40ec3b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635206.621563:0:7923:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000443756f2/0xb0c3a59caa40eaba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40eab3 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635206.621569:0:7923:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004ab8b3ba/0xb0c3a59caa40ebd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ebd2 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635206.621576:0:7923:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000032a2161f/0xb0c3a59caa40ec3b lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635206.621636:0:7923:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004ab8b3ba/0xb0c3a59caa40ebd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40ebd2 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635206.621650:0:7923:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004ab8b3ba/0xb0c3a59caa40ebd9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40ebd2 expref: 17 pid: 6506 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635206.621676:0:7923:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000003efd5fe pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7923:1876568427214848:0@lo:104: 00000100:00100000:0.0:1789635206.621751:0:7923:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789635206.621813:0:7923:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000443756f2/0xb0c3a59caa40eaba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40eab3 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635206.621825:0:7923:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000443756f2/0xb0c3a59caa40eaba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40eab3 expref: 17 pid: 6506 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635206.621833:0:7923:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000efa4508a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7923:1876568427214976:0@lo:104: 00000100:00100000:0.0:1789635206.621852:0:7923:0:(client.c:2716:ptlrpc_set_wait()) set 0000000073c386c5 going to sleep for 11 seconds 00000100:00100000:1.0:1789635206.622111:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789635206.622141:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635206.622166:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427214848 00000100:00100000:1.0:1789635206.622173:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427214848 00000100:00100000:1.0:1789635206.622204:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427214976 00000100:00100000:1.0:1789635206.622206:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427214976 00000100:00100000:1.0:1789635206.622217:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789635206.622223:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000081e15935 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+4:7923:x1876568427214848:12345-0@lo:104: 00010000:00010000:1.0:1789635206.622234:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: 00000000d7938e45/0xb0c3a59caa40ebd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ebd9 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635206.622287:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789635206.622396:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000081e15935 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+4:7923:x1876568427214848:12345-0@lo:104: Request processed in 172us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635206.622404:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1789635206.622431:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635206.622444:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: 00000000d7938e45/0xb0c3a59caa40ebd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ebd9 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635206.622458:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d7938e45 already unused, calling callback (00000000af9d8a27) 10000000:00010000:2.0:1789635206.622463:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: 00000000d7938e45/0xb0c3a59caa40ebd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40ebd9 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635206.622473:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: 00000000d7938e45/0xb0c3a59caa40ebd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40ebd9 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789635206.622482:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: 00000000d7938e45/0xb0c3a59caa40ebd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40ebd9 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635206.622487:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789635206.622547:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: 00000000d7938e45/0xb0c3a59caa40ebd2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ebd9 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635206.622555:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789635206.622586:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: 00000000d7938e45/0xb0c3a59caa40ebd2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ebd9 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635206.622593:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: 00000000d7938e45/0xb0c3a59caa40ebd2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ebd9 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635206.622657:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000074b8d150 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427215104:0@lo:103: 00000100:00100000:3.0:1789635206.622691:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635206.622768:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427215104 00000100:00100000:3.0:1789635206.622774:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427215104 00010000:00010000:3.0:1789635206.622793:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004ab8b3ba/0xb0c3a59caa40ebd9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ebd2 expref: 18 pid: 6506 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635206.622831:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789635206.622838:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e5ae5970 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+18:3641:x1876568427215104:12345-0@lo:103: 00010000:00010000:3.0:1789635206.622847:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635206.622860:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004ab8b3ba/0xb0c3a59caa40ebd9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ebd2 expref: 18 pid: 6506 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635206.622870:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004ab8b3ba/0xb0c3a59caa40ebd9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40ebd2 expref: 18 pid: 6506 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635206.622887:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635206.622916:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e5ae5970 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+18:3641:x1876568427215104:12345-0@lo:103: Request processed in 79us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635206.622922:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789635206.622957:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074b8d150 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427215104:0@lo:103: 00000100:00100000:1.0:1789635206.623120:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789635206.623139:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ac321d9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+3:7923:x1876568427214976:12345-0@lo:104: 00010000:00010000:1.0:1789635206.623148:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: 00000000d149d74f/0xb0c3a59caa40eab3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40eaba expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635206.623194:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789635206.623199:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ac321d9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+3:7923:x1876568427214976:12345-0@lo:104: Request processed in 64us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635206.623213:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1789635206.623376:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635206.623381:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: 00000000d149d74f/0xb0c3a59caa40eab3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40eaba expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635206.623388:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d149d74f already unused, calling callback (00000000af9d8a27) 10000000:00010000:3.0:1789635206.623391:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: 00000000d149d74f/0xb0c3a59caa40eab3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40eaba expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635206.623399:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: 00000000d149d74f/0xb0c3a59caa40eab3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40eaba expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789635206.623405:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: 00000000d149d74f/0xb0c3a59caa40eab3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40eaba expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635206.623410:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789635206.623435:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: 00000000d149d74f/0xb0c3a59caa40eab3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40eaba expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635206.623442:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789635206.623474:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: 00000000d149d74f/0xb0c3a59caa40eab3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40eaba expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635206.623481:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: 00000000d149d74f/0xb0c3a59caa40eab3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40eaba expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635206.623493:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635206.623495:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635206.623497:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635206.623505:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec42f51c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427215232:0@lo:103: 00000100:00100000:3.0:1789635206.623532:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635206.623791:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427215232 00000100:00100000:0.0:1789635206.623796:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427215232 00010000:00010000:0.0:1789635206.623821:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000443756f2/0xb0c3a59caa40eaba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40eab3 expref: 18 pid: 6506 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635206.623844:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789635206.623850:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ddd7372e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+18:3642:x1876568427215232:12345-0@lo:103: 00010000:00010000:0.0:1789635206.623858:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635206.623862:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000443756f2/0xb0c3a59caa40eaba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40eab3 expref: 18 pid: 6506 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635206.623870:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000443756f2/0xb0c3a59caa40eaba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40eab3 expref: 18 pid: 6506 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635206.623884:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000032a2161f/0xb0c3a59caa40ec3b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635206.623891:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000032a2161f/0xb0c3a59caa40ec3b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635206.623909:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000032a2161f/0xb0c3a59caa40ec3b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635206.623915:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000032a2161f/0xb0c3a59caa40ec3b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635206.623921:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000032a2161f/0xb0c3a59caa40ec3b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635206.623928:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000032a2161f/0xb0c3a59caa40ec3b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635206.623934:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000032a2161f already unused, calling callback (0000000034729756) 00010000:00010000:0.0:1789635206.623938:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000032a2161f/0xb0c3a59caa40ec3b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635206.623963:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000032a2161f/0xb0c3a59caa40ec3b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635206.623975:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000032a2161f/0xb0c3a59caa40ec3b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635206.623989:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635206.623989:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789635206.623995:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635206.623999:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635206.624034:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ddd7372e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+18:3642:x1876568427215232:12345-0@lo:103: Request processed in 184us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635206.624041:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789635206.624089:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec42f51c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427215232:0@lo:103: 00010000:00010000:2.0:1789635206.624144:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004ab8b3ba/0xb0c3a59caa40ebd9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40ebd2 expref: 17 pid: 6506 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635206.624156:0:7923:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000003efd5fe pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7923:1876568427214848:0@lo:104: 00010000:00010000:2.0:1789635206.624167:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000443756f2/0xb0c3a59caa40eaba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40eab3 expref: 16 pid: 6506 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635206.624174:0:7923:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000efa4508a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7923:1876568427214976:0@lo:104: 00010000:00010000:2.0:1789635206.624192:0:7923:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000032a2161f/0xb0c3a59caa40ec3b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635206.624202:0:7923:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000032a2161f/0xb0c3a59caa40ec3b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635206.627009:0:7923:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000032a2161f/0xb0c3a59caa40ec3b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635206.627023:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000032a2161f/0xb0c3a59caa40ec3b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635207.203703:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635208.227806:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635208.611890:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b7d4ea08 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427215744:0@lo:400: 00000100:00100000:3.0:1789635208.611975:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635208.612031:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789635208.612037:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007ae1c5c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427215360:0@lo:400: 00000100:00100000:3.0:1789635208.612064:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635208.612085:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c6586179 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876568427215872:0@lo:400: 00000100:00100000:3.0:1789635208.612106:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635208.612143:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cca1010a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427215488:0@lo:400: 00000100:00100000:3.0:1789635208.612165:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635208.612182:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789635208.612186:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000425a7faa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427215616:0@lo:400: 00000100:00100000:3.0:1789635208.612209:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635208.612236:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427215744 00000100:00100000:3.0:1789635208.612243:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427215744 00000100:00100000:3.0:1789635208.612279:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427215616 00000100:00100000:3.0:1789635208.612283:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427215616 00000100:00100000:3.0:1789635208.612309:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789635208.612316:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d00c9120 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427215744:12345-0@lo:400: 00000100:00100000:3.0:1789635208.612408:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d00c9120 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427215744:12345-0@lo:400: Request processed in 92us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635208.612415:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789635208.612431:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789635208.612437:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003c9641f6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427215616:12345-0@lo:400: 00000100:00100000:3.0:1789635208.612468:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003c9641f6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427215616:12345-0@lo:400: Request processed in 32us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635208.612473:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789635208.612495:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427215360 00000100:00100000:3.0:1789635208.612499:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427215360 00000100:00100000:3.0:1789635208.612523:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789635208.612529:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008be32e3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+16:3642:x1876568427215360:12345-0@lo:400: 00000100:00100000:3.0:1789635208.612564:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008be32e3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+16:3642:x1876568427215360:12345-0@lo:400: Request processed in 36us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635208.612569:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789635208.612593:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427215872 00000100:00100000:3.0:1789635208.612615:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427215872 00000100:00100000:3.0:1789635208.612639:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427215488 00000100:00100000:3.0:1789635208.612641:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427215488 00000100:00100000:3.0:1789635208.612653:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789635208.612658:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000081a46c64 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876568427215872:12345-0@lo:400: 00000100:00100000:3.0:1789635208.612687:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000081a46c64 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876568427215872:12345-0@lo:400: Request processed in 29us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635208.612692:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789635208.612703:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789635208.612713:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001651fb2e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427215488:12345-0@lo:400: 00000100:00100000:3.0:1789635208.612744:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001651fb2e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427215488:12345-0@lo:400: Request processed in 32us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635208.612750:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789635208.612797:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000425a7faa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427215616:0@lo:400: 00010000:00080000:3.0:1789635208.612808:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000cca1010a x1876568427215488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635208.612818:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cca1010a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427215488:0@lo:400: 00000100:00100000:3.0:1789635208.612841:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007ae1c5c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427215360:0@lo:400: 00010000:00080000:3.0:1789635208.612850:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000c6586179 x1876568427215872/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635208.612858:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c6586179 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876568427215872:0@lo:400: 00000100:00100000:3.0:1789635208.612866:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b7d4ea08 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427215744:0@lo:400: 00000100:00100000:3.0:1789635208.616653:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b7d4ea08 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427216128:0@lo:41: 00000100:00100000:3.0:1789635208.616719:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635208.616763:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789635208.616769:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f26b5c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427216000:0@lo:41: 00000100:00100000:3.0:1789635208.616792:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635208.616821:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427216128 00000100:00100000:3.0:1789635208.616828:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427216128 00000100:00100000:3.0:1789635208.616866:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427216000 00000100:00100000:3.0:1789635208.616870:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427216000 00000100:00100000:3.0:1789635208.616885:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789635208.616892:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c6586179 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427216128:12345-0@lo:41: 00000004:00000024:3.0:1789635208.616933:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1789635208.616976:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c6586179 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427216128:12345-0@lo:41: Request processed in 85us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635208.616983:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789635208.616999:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789635208.617005:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007ae1c5c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427216000:12345-0@lo:41: 00000004:00000024:3.0:1789635208.617019:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1789635208.617044:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007ae1c5c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427216000:12345-0@lo:41: Request processed in 40us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635208.617050:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789635208.617088:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f26b5c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427216000:0@lo:41: 00000100:00100000:3.0:1789635208.617097:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b7d4ea08 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427216128:0@lo:41: 00010000:00010000:2.0:1789635209.253472:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635210.275762:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635211.313939:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635212.323809:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635213.347770:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635213.733966:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000074b8d150 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427216640:0@lo:400: 00000100:00100000:2.0:1789635213.734031:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635213.734105:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789635213.734111:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000776bce3a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427216512:0@lo:400: 00000100:00100000:2.0:1789635213.734138:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635213.734167:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427216640 00000100:00100000:2.0:1789635213.734174:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427216640 00000100:00100000:2.0:1789635213.734208:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427216512 00000100:00100000:2.0:1789635213.734211:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427216512 00000100:00100000:2.0:1789635213.734227:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789635213.734233:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000468684df pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427216640:12345-0@lo:400: 00000100:00100000:2.0:1789635213.734283:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000468684df pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427216640:12345-0@lo:400: Request processed in 50us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635213.734289:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789635213.734304:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789635213.734310:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007b27d83b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427216512:12345-0@lo:400: 00000100:00100000:2.0:1789635213.734334:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007b27d83b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427216512:12345-0@lo:400: Request processed in 25us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635213.734339:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789635213.734373:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000776bce3a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427216512:0@lo:400: 00000100:00100000:2.0:1789635213.734382:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074b8d150 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427216640:0@lo:400: 00000100:00100000:0.0:1789635213.737284:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d0220fe9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876568427216384:0@lo:400: 00000100:00100000:0.0:1789635213.737352:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635213.737381:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c3d6b7ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427216896:0@lo:41: 00000100:00100000:0.0:1789635213.737402:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635213.737424:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789635213.737430:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d02eabae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427216256:0@lo:400: 00000100:00100000:0.0:1789635213.737452:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635213.737477:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000658b6670 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876568427216768:0@lo:400: 00000100:00100000:0.0:1789635213.737496:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635213.737523:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427216896 00000100:00100000:0.0:1789635213.737530:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427216896 00000100:00100000:0.0:1789635213.737658:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789635213.737668:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ef1aa31e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427216896:12345-0@lo:41: 00000004:00000024:0.0:1789635213.737699:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1789635213.737739:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ef1aa31e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427216896:12345-0@lo:41: Request processed in 73us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635213.737746:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789635213.737774:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427216384 00000100:00100000:0.0:1789635213.737778:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427216384 00000100:00100000:0.0:1789635213.737816:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427216768 00000100:00100000:0.0:1789635213.737819:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427216768 00000100:00100000:0.0:1789635213.737832:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789635213.737837:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000652df4e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876568427216384:12345-0@lo:400: 00000100:00100000:0.0:1789635213.737868:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000652df4e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876568427216384:12345-0@lo:400: Request processed in 32us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635213.737874:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789635213.737885:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789635213.737890:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008f26b5c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876568427216768:12345-0@lo:400: 00000100:00100000:0.0:1789635213.737924:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008f26b5c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876568427216768:12345-0@lo:400: Request processed in 35us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635213.737929:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789635213.737951:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427216256 00000100:00100000:0.0:1789635213.737954:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427216256 00000100:00100000:0.0:1789635213.737977:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789635213.737982:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e995f888 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+16:3643:x1876568427216256:12345-0@lo:400: 00000100:00100000:0.0:1789635213.738009:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e995f888 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+16:3643:x1876568427216256:12345-0@lo:400: Request processed in 27us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635213.738014:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789635213.738084:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d02eabae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427216256:0@lo:400: 00010000:00080000:0.0:1789635213.738098:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000658b6670 x1876568427216768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635213.738109:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000658b6670 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876568427216768:0@lo:400: 00010000:00080000:0.0:1789635213.738118:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000d0220fe9 x1876568427216384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635213.738125:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d0220fe9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876568427216384:0@lo:400: 00000100:00100000:0.0:1789635213.738137:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c3d6b7ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427216896:0@lo:41: 00000100:00100000:3.0:1789635213.738555:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000090655e77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427217024:0@lo:41: 00000100:00100000:3.0:1789635213.738589:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635213.738700:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427217024 00000100:00100000:1.0:1789635213.738705:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427217024 00000100:00100000:1.0:1789635213.738730:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789635213.738736:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b7d4ea08 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427217024:12345-0@lo:41: 00000004:00000024:1.0:1789635213.738756:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1789635213.738792:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b7d4ea08 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427217024:12345-0@lo:41: Request processed in 57us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635213.738797:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789635213.738826:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000090655e77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427217024:0@lo:41: 10000000:01000000:3.0:1789635214.244816:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789635214.244824:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0550107000 from 1 10000000:01000000:3.0:1789635214.244828:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789635214.244937:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 000000004bbd5d5f/0xb0c3a59caa40ec42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635214.244951:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 000000004bbd5d5f/0xb0c3a59caa40ec42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635214.244961:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 000000004bbd5d5f/0xb0c3a59caa40ec42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635214.244983:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cca1010a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427217152:0@lo:101: 00000100:00100000:3.0:1789635214.245055:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635214.245112:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ac93e273 going to sleep for 11 seconds 00000100:00100000:0.0:1789635214.245171:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427217152 00000100:00100000:0.0:1789635214.245180:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427217152 00000100:00100000:0.0:1789635214.245227:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789635214.245235:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eed41478 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+16:6512:x1876568427217152:12345-0@lo:101: 00010000:00010000:0.0:1789635214.245247:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635214.245259:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000efa52288/0xb0c3a59caa40ec49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ec42 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635214.245288:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000efa52288/0xb0c3a59caa40ec49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ec42 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635214.245297:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000efa52288/0xb0c3a59caa40ec49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ec42 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635214.245306:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000efa52288, rc 0) 00000100:00100000:0.0:1789635214.245351:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eed41478 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+17:6512:x1876568427217152:12345-0@lo:101: Request processed in 117us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635214.245358:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789635214.245483:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cca1010a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427217152:0@lo:101: 00010000:00010000:3.0:1789635214.245496:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 000000004bbd5d5f/0xb0c3a59caa40ec42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ec49 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635214.245505:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 000000004bbd5d5f/0xb0c3a59caa40ec42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ec49 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635214.245557:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cca1010a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427217280:0@lo:501: 00000100:00100000:3.0:1789635214.245582:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635214.245630:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ac93e273 going to sleep for 11 seconds 00000100:00100000:0.0:1789635214.245750:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427217280 00000100:00100000:0.0:1789635214.245755:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427217280 00000100:00100000:0.0:1789635214.245775:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789635214.245781:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bb30c94e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+17:6512:x1876568427217280:12345-0@lo:501: 00000100:00100000:0.0:1789635214.245954:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bb30c94e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+17:6512:x1876568427217280:12345-0@lo:501: Request processed in 173us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635214.245962:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789635214.246031:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cca1010a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427217280:0@lo:501: 00000100:00100000:2.0:1789635214.246058:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000074b8d150 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427217408:0@lo:503: 00000100:00100000:2.0:1789635214.246112:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635214.246135:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f8b38e80 going to sleep for 11 seconds 00000100:00100000:3.0:1789635214.246186:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427217408 00000100:00100000:3.0:1789635214.246190:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427217408 00000100:00100000:3.0:1789635214.246249:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789635214.246255:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e8a1a3ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+17:6512:x1876568427217408:12345-0@lo:503: 00000100:00100000:3.0:1789635214.246331:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e8a1a3ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+17:6512:x1876568427217408:12345-0@lo:503: Request processed in 77us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635214.246338:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789635214.246984:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074b8d150 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427217408:0@lo:503: 00000100:00100000:2.0:1789635214.247272:0:8394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000074b8d150 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:8394:1876568427217536:0@lo:502: 00000100:00100000:2.0:1789635214.247344:0:8394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635214.247373:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427217536 00000100:00100000:2.0:1789635214.247379:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427217536 00000100:00100000:2.0:1789635214.247404:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789635214.247411:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000096b2fd42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+17:8394:x1876568427217536:12345-0@lo:502: 00000100:00100000:2.0:1789635214.247535:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000096b2fd42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+17:8394:x1876568427217536:12345-0@lo:502: Request processed in 124us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635214.247543:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789635214.247629:0:8394:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b67c6feb going to sleep for 11 seconds 00000100:00100000:2.0:1789635214.247652:0:8394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074b8d150 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:8394:1876568427217536:0@lo:502: 00000020:01000000:2.0:1789635214.247673:0:8394:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789635214.247681:0:8394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635214.247684:0:8394:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789635214.247691:0:8394:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d0550107000 00000020:00000080:2.0:1789635214.247693:0:8394:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789635214.247729:0:8394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:8394:1876568427217664:0@lo:502: 00000100:00100000:2.0:1789635214.247760:0:8394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635214.247781:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427217664 00000100:00100000:2.0:1789635214.247785:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427217664 00000100:00100000:2.0:1789635214.247801:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789635214.247805:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+17:8394:x1876568427217664:12345-0@lo:502: 00000100:00100000:2.0:1789635214.247880:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+17:8394:x1876568427217664:12345-0@lo:502: Request processed in 74us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635214.247887:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789635214.247928:0:8394:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05429e7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789635214.247939:0:8394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:8394:1876568427217664:0@lo:502: 00000020:01000000:2.0:1789635214.247954:0:8394:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789635214.247961:0:8394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635214.247972:0:8394:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789635214.247975:0:8394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1789635214.248027:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789635214.248047:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789635214.248056:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05820d3600/0xb0c3a59caa40ec42 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ec49 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.248077:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d05820d3600/0xb0c3a59caa40ec42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ec49 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635214.248087:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789635214.248090:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0558960000 from 1 10000000:01000000:2.0:1789635214.248092:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789635214.248113:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d054139de00/0xb0c3a59caa40ec50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.248121:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d054139de00/0xb0c3a59caa40ec50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.248130:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d054139de00/0xb0c3a59caa40ec50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635214.248142:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427217792:0@lo:101: 00000100:00100000:2.0:1789635214.248166:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635214.248188:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05429e7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789635214.248306:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427217792 00000100:00100000:1.0:1789635214.248311:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427217792 00000100:00100000:1.0:1789635214.248332:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789635214.248338:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+17:6512:x1876568427217792:12345-0@lo:101: 00010000:00010000:1.0:1789635214.248348:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635214.248359:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0540030c00/0xb0c3a59caa40ec57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ec50 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.248381:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0540030c00/0xb0c3a59caa40ec57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ec50 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.248391:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0540030c00/0xb0c3a59caa40ec57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ec50 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.248401:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0540030c00, rc 0) 00000100:00100000:1.0:1789635214.248439:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+18:6512:x1876568427217792:12345-0@lo:101: Request processed in 101us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635214.248453:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789635214.249253:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427217792:0@lo:101: 00010000:00010000:2.0:1789635214.249273:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d054139de00/0xb0c3a59caa40ec50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ec57 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.249284:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d054139de00/0xb0c3a59caa40ec50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ec57 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635214.249361:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427217920:0@lo:501: 00000100:00100000:2.0:1789635214.249401:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635214.249449:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05429e7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789635214.249715:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427217920 00000100:00100000:2.0:1789635214.249722:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427217920 00000100:00100000:2.0:1789635214.249762:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789635214.249771:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+18:6512:x1876568427217920:12345-0@lo:501: 00000100:00100000:2.0:1789635214.250099:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+18:6512:x1876568427217920:12345-0@lo:501: Request processed in 329us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635214.250107:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789635214.250373:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427217920:0@lo:501: 00000100:00100000:3.0:1789635214.250410:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e016680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427218048:0@lo:503: 00000100:00100000:3.0:1789635214.250455:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635214.250485:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0575963600 going to sleep for 11 seconds 00000100:00100000:0.0:1789635214.250530:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427218048 00000100:00100000:0.0:1789635214.250535:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427218048 00000100:00100000:0.0:1789635214.250998:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789635214.251008:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+18:6512:x1876568427218048:12345-0@lo:503: 00000100:00100000:0.0:1789635214.251119:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+18:6512:x1876568427218048:12345-0@lo:503: Request processed in 112us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635214.251128:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789635214.251144:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e016680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427218048:0@lo:503: 00000100:00100000:1.0:1789635214.251344:0:8395:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d057b598380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:8395:1876568427218176:0@lo:502: 00000100:00100000:1.0:1789635214.251383:0:8395:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635214.257079:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427218176 00000100:00100000:3.0:1789635214.257092:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427218176 00000100:00100000:3.0:1789635214.257140:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789635214.257151:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+18:8395:x1876568427218176:12345-0@lo:502: 00000100:00100000:3.0:1789635214.257301:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+18:8395:x1876568427218176:12345-0@lo:502: Request processed in 151us (5917us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635214.257309:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789635214.260054:0:8395:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05515319c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635214.260105:0:8395:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d057b598380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:8395:1876568427218176:0@lo:502: 00000020:01000000:1.0:1789635214.260144:0:8395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789635214.260153:0:8395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635214.260156:0:8395:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789635214.260164:0:8395:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d0558960000 00000020:00000080:1.0:1789635214.260167:0:8395:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789635214.260262:0:8395:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d057b598380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:8395:1876568427218304:0@lo:502: 00000100:00100000:1.0:1789635214.260328:0:8395:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635214.260351:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427218304 00000100:00100000:2.0:1789635214.260359:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427218304 00000100:00100000:1.0:1789635214.260365:0:8395:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05515319c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635214.260407:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789635214.260416:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+18:8395:x1876568427218304:12345-0@lo:502: 00000100:00100000:2.0:1789635214.265531:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+18:8395:x1876568427218304:12345-0@lo:502: Request processed in 5109us (5196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635214.265546:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789635214.267294:0:8395:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d057b598380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:8395:1876568427218304:0@lo:502: 00000020:01000000:1.0:1789635214.267334:0:8395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789635214.267342:0:8395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635214.267344:0:8395:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789635214.267350:0:8395:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1789635214.267495:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789635214.267518:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789635214.267528:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d054139de00/0xb0c3a59caa40ec50 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ec57 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635214.267546:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d054139de00/0xb0c3a59caa40ec50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ec57 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635214.372056:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789635214.551013:0:8423:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789635214.551017:0:8423:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789635214.551019:0:8423:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789635214.551155:0:8423:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d056f7ce800 00000020:01000004:3.0:1789635214.551169:0:8423:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789635214.551181:0:8423:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789635214.551200:0:8423:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d0575920000) 00000020:00000080:3.0:1789635214.551216:0:8423:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789635214.591405:0:8423:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1789635214.591467:0:8423:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1789635214.641736:0:8423:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789635214.641937:0:8423:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789635214.641948:0:8423:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789635214.641959:0:8423:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb0c3a59caa40ec65 00000020:01000004:2.0:1789635214.641965:0:8423:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789635214.641985:0:8423:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.120@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789635214.641988:0:8423:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789635214.641994:0:8423:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789635214.641998:0:8423:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789635214.642008:0:8423:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8d0558610000) 00000020:00000080:2.0:1789635214.642025:0:8423:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1789635214.646014:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789635214.649137:0:8423:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789635214.650019:0:8423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789635214.651246:0:8423:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789635214.651255:0:8423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789635214.652650:0:8423:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789635214.652660:0:8423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789635214.665689:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789635214.665939:0:8423:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789635214.665945:0:8423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789635214.673521:0:8423:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789635214.673533:0:8423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789635214.722384:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789635214.722621:0:8423:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789635214.722628:0:8423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789635214.731529:0:8423:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789635214.731544:0:8423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789635214.732375:0:8423:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789635214.732384:0:8423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789635214.737852:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789635214.738028:0:8423:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789635214.738034:0:8423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789635214.739036:0:8423:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789635214.739045:0:8423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789635214.792486:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789635214.792815:0:8423:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789635214.792822:0:8423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789635214.794073:0:8423:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789635214.794084:0:8423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789635214.794577:0:8423:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789635214.794636:0:8423:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1789635214.794643:0:8423:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.120@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789635214.816847:0:8423:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789635214.816884:0:8423:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.120@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1789635214.816889:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789635214.816890:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789635214.816892:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789635214.816893:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789635214.816894:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789635214.816895:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789635214.816896:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789635214.816898:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789635214.816899:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789635214.816900:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789635214.816902:0:8423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789635214.816905:0:8423:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1789635214.816907:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789635214.816908:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789635214.816909:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789635214.816910:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789635214.816911:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789635214.816912:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789635214.816913:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789635214.816914:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789635214.816915:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789635214.816916:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789635214.816917:0:8423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789635214.816947:0:8423:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789635214.816964:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e017480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427218432:0@lo:253: 00000100:00100000:3.0:1789635214.817041:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635214.817148:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0550647b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789635214.817986:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427218432 00000100:00100000:0.0:1789635214.817995:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427218432 00000100:00100000:0.0:1789635214.818037:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789635214.818045:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+18:8423:x1876568427218432:12345-0@lo:253: 20000000:01000000:0.0:1789635214.818093:0:6509:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789635214.818097:0:6509:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1789635214.818102:0:6509:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1789635214.818104:0:6509:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1789635214.818534:0:6509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789635214.818753:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1789635214.818766:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1789635214.818781:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1789635214.818786:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1789635214.818795:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1789635214.818807:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1789635214.818876:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1789635214.818889:0:6509:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.120@tcp 20000000:01000000:0.0:1789635214.818891:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.120@tcp (null) (null) (null) 00000040:00080000:0.0:1789635214.818901:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1789635214.818905:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789635214.818915:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1789635214.818919:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.120@tcp (null) (null) 00000040:00080000:0.0:1789635214.818929:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1789635214.818935:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789635214.818944:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1789635214.818958:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1789635214.819008:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1789635214.819016:0:6509:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.120@tcp 20000000:01000000:0.0:1789635214.819018:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.120@tcp (null) (null) (null) 00000040:00080000:0.0:1789635214.819027:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1789635214.819032:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789635214.819041:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1789635214.819045:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.120@tcp (null) (null) 00000040:00080000:0.0:1789635214.819055:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1789635214.819059:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789635214.819083:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1789635214.819095:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1789635214.819769:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1789635214.819782:0:6509:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.120@tcp 20000000:01000000:0.0:1789635214.819783:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.120@tcp (null) (null) (null) 00000040:00080000:0.0:1789635214.819805:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1789635214.819810:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789635214.819819:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1789635214.819824:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.120@tcp (null) (null) 00000040:00080000:0.0:1789635214.819833:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1789635214.819837:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789635214.819847:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1789635214.819858:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1789635214.819869:0:6509:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789635214.819871:0:6509:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789635214.819875:0:6509:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789635214.819911:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789635214.819913:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789635214.820537:0:8442:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1789635214.820567:0:8442:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1789635214.820580:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1789635214.820825:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:0.0:1789635214.820845:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:0.0:1789635214.820861:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:0.0:1789635214.820870:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789635214.820872:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789635214.821185:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1789635214.821503:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1789635214.821521:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1789635214.821533:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1789635214.821541:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789635214.821543:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789635214.825443:0:8444:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:0.0:1789635214.825503:0:8444:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:0.0:1789635214.825522:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1789635214.825845:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1789635214.825873:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1789635214.825888:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1789635214.825900:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789635214.825902:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789635214.826412:0:8445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1789635214.826436:0:8445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1789635214.826453:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:1.0:1789635214.827232:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:1.0:1789635214.827268:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:1.0:1789635214.827287:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:1.0:1789635214.827434:0:6509:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789635214.827454:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d0540030a00/0xb0c3a59caa40ec73 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.827472:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d058214b400/0xb0c3a59caa40eb3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40eb38 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.827480:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d058214b800/0xb0c3a59caa40eb7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40eb77 expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.827487:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d05820d2c00/0xb0c3a59caa40eb8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40eb85 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.827494:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d05820d3c00/0xb0c3a59caa40ebe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ebe0 expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.827500:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d056f6e9400/0xb0c3a59caa40ebf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ebee expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.827507:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d0540030a00/0xb0c3a59caa40ec73 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.827549:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d056f6e9400/0xb0c3a59caa40ebf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40ebee expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.827562:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d056f6e9400/0xb0c3a59caa40ebf5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40ebee expref: 18 pid: 6509 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635214.827575:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d057b598380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6509:1876568427218560:0@lo:104: 00000100:00100000:1.0:1789635214.827662:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789635214.827720:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d05820d3c00/0xb0c3a59caa40ebe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40ebe0 expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.827733:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d05820d3c00/0xb0c3a59caa40ebe7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40ebe0 expref: 18 pid: 6508 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635214.827742:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459dce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6509:1876568427218688:0@lo:104: 00000100:00100000:1.0:1789635214.827763:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789635214.827788:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d05820d2c00/0xb0c3a59caa40eb8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40eb85 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.827795:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d05820d2c00/0xb0c3a59caa40eb8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40eb85 expref: 18 pid: 6506 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635214.827803:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459dd880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6509:1876568427218816:0@lo:104: 00000100:00100000:1.0:1789635214.827821:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789635214.827836:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d058214b800/0xb0c3a59caa40eb7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40eb77 expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.827844:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d058214b800/0xb0c3a59caa40eb7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40eb77 expref: 18 pid: 6508 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635214.827852:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ddf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6509:1876568427218944:0@lo:104: 00000100:00100000:1.0:1789635214.827870:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789635214.827893:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d058214b400/0xb0c3a59caa40eb3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40eb38 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.827901:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d058214b400/0xb0c3a59caa40eb3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40eb38 expref: 18 pid: 6506 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635214.827910:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ded80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6509:1876568427219072:0@lo:104: 00000100:00100000:3.0:1789635214.827973:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427218560 00000100:00100000:3.0:1789635214.827982:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427218560 00000100:00100000:3.0:1789635214.828014:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427218688 00000100:00100000:3.0:1789635214.828017:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427218688 00000100:00100000:3.0:1789635214.828026:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427218816 00000100:00100000:3.0:1789635214.828028:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427218816 00000100:00100000:3.0:1789635214.828038:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427218944 00000100:00100000:3.0:1789635214.828040:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427218944 00000100:00100000:3.0:1789635214.828053:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789635214.828071:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b599c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+6:6509:x1876568427218560:12345-0@lo:104: 00010000:00010000:3.0:1789635214.828083:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d054139d200/0xb0c3a59caa40ebee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ebf5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635214.828126:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789635214.828132:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b599c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+6:6509:x1876568427218560:12345-0@lo:104: Request processed in 72us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635214.828140:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789635214.828156:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789635214.828162:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+5:6509:x1876568427218688:12345-0@lo:104: 00010000:00010000:3.0:1789635214.828176:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d05820d3000/0xb0c3a59caa40ebe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ebe7 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635214.828210:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789635214.828215:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+5:6509:x1876568427218688:12345-0@lo:104: Request processed in 54us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635214.828221:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789635214.828234:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789635214.828239:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+4:6509:x1876568427218816:12345-0@lo:104: 00010000:00010000:3.0:1789635214.828245:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d0540031400/0xb0c3a59caa40eb85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40eb8c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635214.828285:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789635214.828290:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+4:6509:x1876568427218816:12345-0@lo:104: Request processed in 51us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635214.828307:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789635214.828319:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789635214.828324:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+3:6509:x1876568427218944:12345-0@lo:104: 00010000:00010000:3.0:1789635214.828331:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40eb77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40eb7e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635214.828357:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789635214.828362:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+3:6509:x1876568427218944:12345-0@lo:104: Request processed in 38us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635214.828366:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1789635214.828382:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789635214.828388:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d054139d200/0xb0c3a59caa40ebee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ebf5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635214.828400:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d054139d200 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:3.0:1789635214.828404:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d054139d200/0xb0c3a59caa40ebee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40ebf5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635214.828412:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d054139d200/0xb0c3a59caa40ebee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40ebf5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789635214.828419:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d054139d200/0xb0c3a59caa40ebee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40ebf5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635214.828425:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789635214.828454:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d054139d200/0xb0c3a59caa40ebee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ebf5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635214.828461:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789635214.828483:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d054139d200/0xb0c3a59caa40ebee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ebf5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635214.828490:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d054139d200/0xb0c3a59caa40ebee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ebf5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635214.828504:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789635214.828507:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d05820d3000/0xb0c3a59caa40ebe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ebe7 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635214.828518:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05820d3000 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:3.0:1789635214.828520:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d05820d3000/0xb0c3a59caa40ebe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40ebe7 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635214.828537:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d05820d3000/0xb0c3a59caa40ebe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40ebe7 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789635214.828542:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d05820d3000/0xb0c3a59caa40ebe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40ebe7 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635214.828547:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789635214.828560:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d05820d3000/0xb0c3a59caa40ebe0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ebe7 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635214.828565:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789635214.828578:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d05820d3000/0xb0c3a59caa40ebe0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ebe7 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635214.828584:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d05820d3000/0xb0c3a59caa40ebe0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ebe7 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635214.828592:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789635214.828617:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d0540031400/0xb0c3a59caa40eb85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40eb8c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635214.828623:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540031400 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:3.0:1789635214.828626:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d0540031400/0xb0c3a59caa40eb85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40eb8c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635214.828632:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d0540031400/0xb0c3a59caa40eb85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40eb8c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789635214.828643:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d0540031400/0xb0c3a59caa40eb85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40eb8c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635214.828654:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789635214.828671:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d0540031400/0xb0c3a59caa40eb85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40eb8c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635214.828676:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789635214.828682:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d0540031400/0xb0c3a59caa40eb85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40eb8c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635214.828688:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d0540031400/0xb0c3a59caa40eb85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40eb8c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635214.828701:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635214.828704:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40eb77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40eb7e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635214.828713:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05820d3800 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:3.0:1789635214.828716:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40eb77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40eb7e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635214.828725:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40eb77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40eb7e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789635214.828732:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40eb77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40eb7e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635214.828737:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789635214.828751:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40eb77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40eb7e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635214.828756:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789635214.828769:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40eb77 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40eb7e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635214.828776:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40eb77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40eb7e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635214.828785:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635214.828787:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635214.828788:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635214.828798:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635214.828815:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e015880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427219200:0@lo:103: 00000100:00100000:3.0:1789635214.828850:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635214.828886:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789635214.828892:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427219584:0@lo:103: 00000100:00100000:3.0:1789635214.828923:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635214.829026:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427219328:0@lo:103: 00000100:00100000:3.0:1789635214.829051:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635214.829080:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789635214.829085:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e016680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427219456:0@lo:103: 00000100:00100000:3.0:1789635214.829107:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635214.829136:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427219200 00000100:00100000:3.0:1789635214.829142:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427219200 00010000:00010000:3.0:1789635214.829160:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d056f6e9400/0xb0c3a59caa40ebf5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ebee expref: 19 pid: 6509 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635214.829175:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427219584 00000100:00100000:3.0:1789635214.829177:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427219584 00010000:00010000:3.0:1789635214.829186:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d058214b800/0xb0c3a59caa40eb7e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40eb77 expref: 20 pid: 6508 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635214.829210:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427219328 00000100:00100000:3.0:1789635214.829212:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427219328 00010000:00010000:3.0:1789635214.829227:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d05820d3c00/0xb0c3a59caa40ebe7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ebe0 expref: 21 pid: 6508 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635214.829238:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427219456 00000100:00100000:3.0:1789635214.829240:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427219456 00010000:00010000:3.0:1789635214.829249:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d05820d2c00/0xb0c3a59caa40eb8c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40eb85 expref: 22 pid: 6506 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635214.829265:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789635214.829274:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e014e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+22:3641:x1876568427219200:12345-0@lo:103: 00010000:00010000:3.0:1789635214.829283:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635214.829344:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d056f6e9400/0xb0c3a59caa40ebf5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ebee expref: 22 pid: 6509 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635214.829356:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d056f6e9400/0xb0c3a59caa40ebf5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40ebee expref: 22 pid: 6509 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635214.829458:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635214.829496:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e014e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+22:3641:x1876568427219200:12345-0@lo:103: Request processed in 221us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635214.829503:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789635214.829519:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789635214.829526:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+21:3641:x1876568427219584:12345-0@lo:103: 00010000:00010000:3.0:1789635214.829536:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635214.829540:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d058214b800/0xb0c3a59caa40eb7e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40eb77 expref: 21 pid: 6508 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635214.829561:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d058214b800/0xb0c3a59caa40eb7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40eb77 expref: 21 pid: 6508 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635214.829571:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635214.829629:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789635214.829637:0:7457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6356ed01-c755-4f9e-b839-20feb7c3f098+21:3642:x1876568427219328:12345-0@lo:103: 00010000:00010000:1.0:1789635214.829649:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635214.829653:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d05820d3c00/0xb0c3a59caa40ebe7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ebe0 expref: 21 pid: 6508 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.829665:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d05820d3c00/0xb0c3a59caa40ebe7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40ebe0 expref: 21 pid: 6508 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.829673:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635214.829704:0:7457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6356ed01-c755-4f9e-b839-20feb7c3f098+21:3642:x1876568427219328:12345-0@lo:103: Request processed in 68us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635214.829713:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789635214.829724:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789635214.829731:0:7457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6356ed01-c755-4f9e-b839-20feb7c3f098+20:3642:x1876568427219456:12345-0@lo:103: 00010000:00010000:2.0:1789635214.829823:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635214.829871:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+20:3641:x1876568427219584:12345-0@lo:103: Request processed in 342us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635214.829877:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789635214.829920:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427219584:0@lo:103: 00000100:00100000:3.0:1789635214.829932:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e015880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427219200:0@lo:103: 00010000:00010000:1.0:1789635214.829965:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635214.829970:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d05820d2c00/0xb0c3a59caa40eb8c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40eb85 expref: 19 pid: 6506 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.829982:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d05820d2c00/0xb0c3a59caa40eb8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40eb85 expref: 19 pid: 6506 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.829992:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635214.830019:0:7457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6356ed01-c755-4f9e-b839-20feb7c3f098+19:3642:x1876568427219456:12345-0@lo:103: Request processed in 289us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635214.830025:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789635214.830050:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e016680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427219456:0@lo:103: 00000100:00100000:1.0:1789635214.830057:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427219328:0@lo:103: 00000100:00100000:1.0:1789635214.830112:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635214.830146:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05515319c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789635214.830158:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056f6e9400/0xb0c3a59caa40ebf5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40ebee expref: 18 pid: 6509 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635214.830169:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d057b598380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6509:1876568427218560:0@lo:104: 00010000:00010000:1.0:1789635214.830178:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d05820d3c00/0xb0c3a59caa40ebe7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40ebe0 expref: 17 pid: 6508 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635214.830185:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459dce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6509:1876568427218688:0@lo:104: 00010000:00010000:1.0:1789635214.830192:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d05820d2c00/0xb0c3a59caa40eb8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40eb85 expref: 16 pid: 6506 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635214.830202:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459dd880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6509:1876568427218816:0@lo:104: 00010000:00010000:1.0:1789635214.830209:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d058214b800/0xb0c3a59caa40eb7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40eb77 expref: 15 pid: 6508 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635214.830218:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ddf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6509:1876568427218944:0@lo:104: 00000100:00100000:0.0:1789635214.830311:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427219072 00000100:00100000:0.0:1789635214.830316:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427219072 00000100:00100000:0.0:1789635214.830346:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789635214.830353:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+3:6509:x1876568427219072:12345-0@lo:104: 00010000:00010000:0.0:1789635214.830362:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d0540031800/0xb0c3a59caa40eb38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40eb3f expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635214.830427:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789635214.830432:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+3:6509:x1876568427219072:12345-0@lo:104: Request processed in 81us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635214.830441:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1789635214.830539:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635214.830548:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d0540031800/0xb0c3a59caa40eb38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40eb3f expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.830556:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540031800 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:2.0:1789635214.830560:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d0540031800/0xb0c3a59caa40eb38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40eb3f expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.830568:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d0540031800/0xb0c3a59caa40eb38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40eb3f expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789635214.830578:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d0540031800/0xb0c3a59caa40eb38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40eb3f expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635214.830623:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789635214.830653:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d0540031800/0xb0c3a59caa40eb38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40eb3f expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.830663:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789635214.830677:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d0540031800/0xb0c3a59caa40eb38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40eb3f expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.830684:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d0540031800/0xb0c3a59caa40eb38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40eb3f expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.830698:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635214.830703:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635214.830704:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635214.830812:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789635214.830823:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427219712:0@lo:103: 00000100:00100000:1.0:1789635214.830858:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635214.830962:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ded80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6509:1876568427219072:0@lo:104: 00010000:00010000:1.0:1789635214.830992:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d0540030a00/0xb0c3a59caa40ec73 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635214.832800:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427219712 00000100:00100000:2.0:1789635214.832813:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427219712 00010000:00010000:2.0:1789635214.832874:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d058214b400/0xb0c3a59caa40eb3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40eb38 expref: 15 pid: 6506 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635214.832914:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789635214.832923:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b406450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+15:3640:x1876568427219712:12345-0@lo:103: 00010000:00010000:2.0:1789635214.832937:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635214.832942:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d058214b400/0xb0c3a59caa40eb3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40eb38 expref: 15 pid: 6506 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.832952:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d058214b400/0xb0c3a59caa40eb3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40eb38 expref: 15 pid: 6506 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.832968:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d058214b400/0xb0c3a59caa40eb3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40eb38 expref: 15 pid: 6506 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.832991:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d0540030a00/0xb0c3a59caa40ec73 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.832999:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0540030a00/0xb0c3a59caa40ec73 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.833013:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d0540030a00/0xb0c3a59caa40ec73 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.833020:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d0540030a00/0xb0c3a59caa40ec73 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.833027:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d0540030a00/0xb0c3a59caa40ec73 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.833033:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d0540030a00/0xb0c3a59caa40ec73 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.833039:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540030a00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635214.833044:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d0540030a00/0xb0c3a59caa40ec73 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.833050:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d0540030a00/0xb0c3a59caa40ec73 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.833078:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d0540030a00/0xb0c3a59caa40ec73 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.833088:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635214.833149:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b406450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+14:3640:x1876568427219712:12345-0@lo:103: Request processed in 227us (2289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635214.833165:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789635214.834441:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427219712:0@lo:103: 00010000:00010000:1.0:1789635214.834475:0:6509:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d0540030a00/0xb0c3a59caa40ec73 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.834496:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d0540030a00/0xb0c3a59caa40ec73 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.834502:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0540030a00/0xb0c3a59caa40ec73 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789635214.834519:0:6509:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789635214.837683:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+13:8423:x1876568427218432:12345-0@lo:253: Request processed in 19629us (20634us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635214.837696:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789635214.837886:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e017480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427218432:0@lo:253: 10000000:01000000:3.0:1789635214.837902:0:8423:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789635214.837905:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789635214.837906:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789635214.837908:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789635214.837909:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1789635214.837910:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789635214.837912:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789635214.837913:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789635214.837914:0:8423:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789635214.837916:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789635214.837917:0:8423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789635214.837937:0:8423:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d056f7ce800 from lustre-OST0000 10000000:01000000:3.0:1789635214.837967:0:8423:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789635214.837970:0:8423:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789635214.837978:0:8423:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d057ae4b380 local copy 10000000:01000000:3.0:1789635214.837982:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789635214.838016:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05820d3200/0xb0c3a59caa40ec7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635214.838027:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.120@tcp lock: ffff8d05820d3200/0xb0c3a59caa40ec7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635214.838048:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d05820d3200/0xb0c3a59caa40ec7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635214.838078:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427219840:0@lo:101: 00000100:00100000:3.0:1789635214.838114:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635214.838215:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427219840 00000100:00100000:2.0:1789635214.838221:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427219840 00000100:00100000:2.0:1789635214.838261:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789635214.838270:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+13:8423:x1876568427219840:12345-0@lo:101: 00010000:00010000:2.0:1789635214.838281:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635214.838301:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40ec81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ec7a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.838324:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40ec81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ec7a expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.838333:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40ec81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ec7a expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.838341:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d054139c000, rc 0) 00000100:00100000:2.0:1789635214.838368:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+14:8423:x1876568427219840:12345-0@lo:101: Request processed in 99us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635214.838374:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789635214.838505:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d054604af00 going to sleep for 11 seconds 00000100:00100000:3.0:1789635214.838517:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427219840:0@lo:101: 00010000:00010000:3.0:1789635214.838528:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d05820d3200/0xb0c3a59caa40ec7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xb0c3a59caa40ec81 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635214.838537:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d05820d3200/0xb0c3a59caa40ec7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb0c3a59caa40ec81 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635214.838647:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427219968:0@lo:501: 00000100:00100000:3.0:1789635214.838672:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635214.838692:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d054604af00 going to sleep for 11 seconds 00000100:00100000:1.0:1789635214.838771:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427219968 00000100:00100000:1.0:1789635214.838777:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427219968 00000100:00100000:1.0:1789635214.838799:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789635214.838805:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+14:8423:x1876568427219968:12345-0@lo:501: 00000100:00100000:1.0:1789635214.838857:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+14:8423:x1876568427219968:12345-0@lo:501: Request processed in 52us (184us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789635214.838864:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789635214.838950:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427219968:0@lo:501: 10000000:01000000:0.0:1789635214.838962:0:8423:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789635214.838981:0:8423:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789635214.838986:0:8423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05820d3200/0xb0c3a59caa40ec7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb0c3a59caa40ec81 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635214.838996:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05820d3200/0xb0c3a59caa40ec7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb0c3a59caa40ec81 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635214.839003:0:8423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff8d05820d3200/0xb0c3a59caa40ec7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb0c3a59caa40ec81 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635214.839069:0:8423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789635214.839091:0:8423:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d056f7ce800 10000000:01000000:0.0:1789635214.839096:0:8423:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789635214.839100:0:8423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789635214.839102:0:8423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789635214.839106:0:8423:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789635214.839109:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789635214.839123:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8e00/0xb0c3a59caa40ec88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635214.839130:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8e00/0xb0c3a59caa40ec88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635214.840205:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8e00/0xb0c3a59caa40ec88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635214.840227:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427220096:0@lo:101: 00000100:00100000:0.0:1789635214.840281:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635214.840448:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549fa8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789635214.840665:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427220096 00000100:00100000:2.0:1789635214.840672:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427220096 00000100:00100000:2.0:1789635214.840752:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789635214.840761:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+14:8423:x1876568427220096:12345-0@lo:101: 00010000:00010000:2.0:1789635214.840773:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635214.840787:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d054139c400/0xb0c3a59caa40ec8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ec88 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.840809:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d054139c400/0xb0c3a59caa40ec8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ec88 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.840826:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d054139c400/0xb0c3a59caa40ec8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ec88 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.840834:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d054139c400, rc 0) 00000100:00100000:2.0:1789635214.840873:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+15:8423:x1876568427220096:12345-0@lo:101: Request processed in 114us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635214.840878:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00010000:1.0:1789635214.840949:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635214.840956:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d05820d3200/0xb0c3a59caa40ec7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb0c3a59caa40ec81 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.840964:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05820d3200 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:1.0:1789635214.840967:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d05820d3200/0xb0c3a59caa40ec7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb0c3a59caa40ec81 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.840976:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d05820d3200/0xb0c3a59caa40ec7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xb0c3a59caa40ec81 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789635214.840993:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d05820d3200/0xb0c3a59caa40ec7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xb0c3a59caa40ec81 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635214.840999:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789635214.841021:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d05820d3200/0xb0c3a59caa40ec7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb0c3a59caa40ec81 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.841027:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789635214.841045:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d05820d3200/0xb0c3a59caa40ec7a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb0c3a59caa40ec81 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.841052:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d05820d3200/0xb0c3a59caa40ec7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb0c3a59caa40ec81 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.841073:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635214.841075:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635214.841076:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635214.841084:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789635214.841094:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427220224:0@lo:103: 00000100:00100000:1.0:1789635214.841120:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635214.841173:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427220224 00000100:00100000:1.0:1789635214.841177:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427220224 00000100:00100000:1.0:1789635214.841206:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789635214.841214:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+15:3643:x1876568427220224:12345-0@lo:103: 00010000:00010000:1.0:1789635214.841224:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635214.841235:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40ec81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb0c3a59caa40ec7a expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.841244:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635214.841285:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+14:3643:x1876568427220224:12345-0@lo:103: Request processed in 72us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635214.841291:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789635214.841472:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427220224:0@lo:103: 00000100:00100000:0.0:1789635214.841555:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427220096:0@lo:101: 00010000:00010000:0.0:1789635214.841567:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8e00/0xb0c3a59caa40ec88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ec8f expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635214.841576:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8e00/0xb0c3a59caa40ec88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ec8f expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635214.841697:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427220352:0@lo:501: 00000100:00100000:0.0:1789635214.841725:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635214.842117:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549fa8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789635214.842247:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427220352 00000100:00100000:2.0:1789635214.842253:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427220352 00000100:00100000:2.0:1789635214.842286:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789635214.842293:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+14:8423:x1876568427220352:12345-0@lo:501: 00000100:00100000:2.0:1789635214.842407:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+14:8423:x1876568427220352:12345-0@lo:501: Request processed in 114us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635214.842413:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789635214.842517:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427220352:0@lo:501: 00000100:00100000:0.0:1789635214.842543:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427220480:0@lo:503: 00000100:00100000:0.0:1789635214.842582:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635214.842624:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549fa8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789635214.842638:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427220480 00000100:00100000:0.0:1789635214.842641:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427220480 00000100:00100000:0.0:1789635214.842661:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789635214.842667:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+14:8423:x1876568427220480:12345-0@lo:503: 00000100:00100000:0.0:1789635214.842738:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+14:8423:x1876568427220480:12345-0@lo:503: Request processed in 70us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635214.842750:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789635214.842782:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427220480:0@lo:503: 00000040:00080000:0.0:1789635214.843007:0:8423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789635214.843073:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427220608:0@lo:502: 00000100:00100000:0.0:1789635214.843105:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635214.843114:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549fa8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789635214.843131:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427220608 00000100:00100000:0.0:1789635214.843135:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427220608 00000100:00100000:0.0:1789635214.843163:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789635214.843170:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+14:8423:x1876568427220608:12345-0@lo:502: 00000100:00100000:0.0:1789635214.843243:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+14:8423:x1876568427220608:12345-0@lo:502: Request processed in 73us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635214.843249:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789635214.843278:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427220608:0@lo:502: 00000040:00080000:0.0:1789635214.843442:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789635214.843464:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789635214.843477:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789635214.843490:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789635214.843513:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789635214.843527:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789635214.843547:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427220736:0@lo:502: 00000100:00100000:0.0:1789635214.843577:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635214.843586:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549fa8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789635214.843624:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427220736 00000100:00100000:0.0:1789635214.843628:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427220736 00000100:00100000:0.0:1789635214.843644:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789635214.843649:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+14:8423:x1876568427220736:12345-0@lo:502: 00000100:00100000:0.0:1789635214.843716:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+14:8423:x1876568427220736:12345-0@lo:502: Request processed in 65us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635214.843723:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789635214.843756:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427220736:0@lo:502: 00000040:00080000:0.0:1789635214.843803:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789635214.843810:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1789635214.844618:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789635214.844627:0:8446:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1789635214.844633:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635214.844635:0:8446:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789635214.844641:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789635214.844655:0:8446:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d056f55cd40) 00000020:00000080:0.0:1789635214.844673:0:8446:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789635214.844678:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789635214.844743:0:8446:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d056f7ce800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789635214.844751:0:8446:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789635214.844758:0:8446:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb0c3a59caa40ec9d 00010000:00010000:0.0:1789635214.849816:0:8446:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:0.0:1789635214.850131:0:8446:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1789635214.853033:0:8446:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1789635214.853498:0:8446:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1789635214.858453:0:8446:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1789635214.859218:0:8446:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1789635214.867939:0:8446:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1789635214.869158:0:8446:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789635214.869170:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789635214.869177:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635214.869179:0:8446:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789635214.869183:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789635214.869187:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635214.869189:0:8446:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789635214.869192:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789635214.869194:0:8446:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789635214.869212:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789635214.869216:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635214.869218:0:8446:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789635214.869221:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1789635214.869412:0:8423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1789635214.869436:0:8423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789635214.869454:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8e00/0xb0c3a59caa40ec88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ec8f expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635214.869466:0:8423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8e00/0xb0c3a59caa40ec88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ec8f expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635214.869480:0:8423:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d056f7ce800 from 1 10000000:01000000:0.0:1789635214.869482:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789635214.869512:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8000/0xb0c3a59caa40eca4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635214.869520:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8000/0xb0c3a59caa40eca4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635214.869530:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8000/0xb0c3a59caa40eca4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635214.869549:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427220864:0@lo:101: 00000100:00100000:0.0:1789635214.869633:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635214.869666:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0551530f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789635214.869687:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427220864 00000100:00100000:0.0:1789635214.869694:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427220864 00000100:00100000:0.0:1789635214.869732:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789635214.869742:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b817c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+14:8423:x1876568427220864:12345-0@lo:101: 00010000:00010000:0.0:1789635214.869754:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635214.869765:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056f6e8400/0xb0c3a59caa40ecab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40eca4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635214.869786:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056f6e8400/0xb0c3a59caa40ecab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40eca4 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635214.869796:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056f6e8400/0xb0c3a59caa40ecab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40eca4 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635214.869804:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056f6e8400, rc 0) 00000100:00100000:0.0:1789635214.869846:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b817c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+15:8423:x1876568427220864:12345-0@lo:101: Request processed in 105us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635214.869853:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789635214.869893:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427220864:0@lo:101: 00010000:00010000:0.0:1789635214.869906:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8000/0xb0c3a59caa40eca4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ecab expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635214.869914:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8000/0xb0c3a59caa40eca4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ecab expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635214.869985:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427220992:0@lo:501: 00000100:00100000:0.0:1789635214.870009:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635214.870020:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0551530f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789635214.871177:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427220992 00000100:00100000:3.0:1789635214.871185:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427220992 00000100:00100000:3.0:1789635214.871224:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789635214.871233:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+15:8423:x1876568427220992:12345-0@lo:501: 00000100:00100000:3.0:1789635214.871353:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+15:8423:x1876568427220992:12345-0@lo:501: Request processed in 121us (1343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635214.871360:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789635214.871509:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427220992:0@lo:501: 00000100:00100000:0.0:1789635214.871547:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427221120:0@lo:503: 00000100:00100000:0.0:1789635214.871589:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635214.871750:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0551530f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789635214.875242:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427221120 00000100:00100000:3.0:1789635214.875256:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427221120 00000100:00100000:3.0:1789635214.875305:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789635214.875316:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+15:8423:x1876568427221120:12345-0@lo:503: 00000100:00100000:3.0:1789635214.875453:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+15:8423:x1876568427221120:12345-0@lo:503: Request processed in 139us (3863us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635214.875461:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789635214.876925:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427221120:0@lo:503: 00000040:00080000:0.0:1789635214.877184:0:8423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789635214.877284:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427221248:0@lo:502: 00000100:00100000:0.0:1789635214.877369:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635214.877414:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d054a0cfc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789635214.877691:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427221248 00000100:00100000:2.0:1789635214.877699:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427221248 00000100:00100000:2.0:1789635214.877741:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789635214.877750:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+15:8423:x1876568427221248:12345-0@lo:502: 00000100:00100000:2.0:1789635214.877843:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+15:8423:x1876568427221248:12345-0@lo:502: Request processed in 94us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635214.877850:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789635214.877988:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427221248:0@lo:502: 00000040:00080000:0.0:1789635214.878206:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789635214.878228:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789635214.878249:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427221376:0@lo:502: 00000100:00100000:0.0:1789635214.878304:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635214.878331:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d054a0cfc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789635214.878456:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427221376 00000100:00100000:2.0:1789635214.878462:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427221376 00000100:00100000:2.0:1789635214.878493:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789635214.878508:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+15:8423:x1876568427221376:12345-0@lo:502: 00000100:00100000:2.0:1789635214.878590:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+15:8423:x1876568427221376:12345-0@lo:502: Request processed in 91us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635214.878641:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789635214.878738:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427221376:0@lo:502: 00000040:00080000:0.0:1789635214.878783:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789635214.878798:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789635214.879857:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789635214.879866:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635214.879869:0:8450:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789635214.879875:0:8450:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d056f7ce800 00000020:00000080:2.0:1789635214.879877:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789635214.879887:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789635214.879889:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635214.879890:0:8450:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789635214.879893:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789635214.880023:0:8423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789635214.880048:0:8423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789635214.880105:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8000/0xb0c3a59caa40eca4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ecab expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635214.880117:0:8423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8000/0xb0c3a59caa40eca4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ecab expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635214.880176:0:8423:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789635214.880180:0:8423:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d056f7ce800 10000000:01000000:0.0:1789635214.880183:0:8423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d056f7ce800 10000000:01000000:0.0:1789635214.880186:0:8423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789635214.880192:0:8423:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d056f7ce800 from 1 10000000:01000000:0.0:1789635214.880194:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789635214.880223:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8200/0xb0c3a59caa40ecb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635214.880231:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8200/0xb0c3a59caa40ecb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635214.880241:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8200/0xb0c3a59caa40ecb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635214.880261:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427221504:0@lo:101: 00000100:00100000:0.0:1789635214.880309:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635214.880352:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d054a0cf840 going to sleep for 11 seconds 00000100:00100000:2.0:1789635214.880398:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427221504 00000100:00100000:2.0:1789635214.880404:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427221504 00000100:00100000:2.0:1789635214.880445:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789635214.880454:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+15:8423:x1876568427221504:12345-0@lo:101: 00010000:00010000:2.0:1789635214.880465:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635214.880477:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d054139c600/0xb0c3a59caa40ecb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ecb2 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.880498:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d054139c600/0xb0c3a59caa40ecb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ecb2 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.880509:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d054139c600/0xb0c3a59caa40ecb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ecb2 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.880517:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d054139c600, rc 0) 00000100:00100000:2.0:1789635214.880564:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+16:8423:x1876568427221504:12345-0@lo:101: Request processed in 111us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635214.880570:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789635214.880766:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427221504:0@lo:101: 00010000:00010000:1.0:1789635214.880781:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8200/0xb0c3a59caa40ecb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ecb9 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.880789:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8200/0xb0c3a59caa40ecb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ecb9 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635214.880864:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427221632:0@lo:501: 00000100:00100000:1.0:1789635214.880890:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635214.880917:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0551531780 going to sleep for 11 seconds 00000100:00100000:2.0:1789635214.881003:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427221632 00000100:00100000:2.0:1789635214.881015:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427221632 00000100:00100000:2.0:1789635214.881049:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789635214.881056:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+16:8423:x1876568427221632:12345-0@lo:501: 00000100:00100000:2.0:1789635214.881169:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+16:8423:x1876568427221632:12345-0@lo:501: Request processed in 114us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635214.881177:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789635214.881499:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427221632:0@lo:501: 00000100:00100000:1.0:1789635214.881529:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427221760:0@lo:503: 00000100:00100000:1.0:1789635214.881566:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635214.881586:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0551531780 going to sleep for 11 seconds 00000100:00100000:2.0:1789635214.881664:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427221760 00000100:00100000:2.0:1789635214.881669:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427221760 00000100:00100000:2.0:1789635214.881692:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789635214.881698:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+16:8423:x1876568427221760:12345-0@lo:503: 00000100:00100000:2.0:1789635214.881780:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+16:8423:x1876568427221760:12345-0@lo:503: Request processed in 80us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635214.881787:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789635214.881985:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427221760:0@lo:503: 00000040:00080000:1.0:1789635214.882231:0:8423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789635214.882305:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427221888:0@lo:502: 00000100:00100000:1.0:1789635214.882343:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635214.882368:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0551531780 going to sleep for 11 seconds 00000100:00100000:0.0:1789635214.882485:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427221888 00000100:00100000:0.0:1789635214.882490:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427221888 00000100:00100000:0.0:1789635214.882524:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789635214.882531:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+16:8423:x1876568427221888:12345-0@lo:502: 00000100:00100000:0.0:1789635214.882631:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+16:8423:x1876568427221888:12345-0@lo:502: Request processed in 101us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635214.882638:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789635214.882798:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427221888:0@lo:502: 00000040:00080000:1.0:1789635214.882946:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789635214.882973:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789635214.882985:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789635214.882995:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789635214.883005:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789635214.883016:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789635214.883026:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789635214.883036:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789635214.883047:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789635214.883059:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789635214.883098:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789635214.883112:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789635214.883123:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789635214.883136:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789635214.883249:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789635214.883266:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789635214.883281:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789635214.883293:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789635214.883307:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789635214.883319:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789635214.883331:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789635214.883344:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789635214.883356:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789635214.883369:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789635214.883380:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1789635214.883393:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1789635214.883416:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1789635214.883431:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1789635214.883443:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1789635214.883456:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1789635214.883468:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1789635214.883480:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1789635214.883494:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1789635214.883509:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1789635214.883533:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1789635214.883548:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1789635214.883561:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1789635214.883586:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427222016:0@lo:502: 00000100:00100000:1.0:1789635214.883801:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635214.883871:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0551531780 going to sleep for 11 seconds 00000100:00100000:0.0:1789635214.883970:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427222016 00000100:00100000:0.0:1789635214.883976:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427222016 00000100:00100000:0.0:1789635214.884042:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789635214.884050:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+16:8423:x1876568427222016:12345-0@lo:502: 00000100:00100000:0.0:1789635214.884163:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+16:8423:x1876568427222016:12345-0@lo:502: Request processed in 113us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635214.884170:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789635214.884241:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427222016:0@lo:502: 00000040:00080000:1.0:1789635214.884281:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1789635214.884289:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1789635214.884775:0:8451:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789635214.884795:0:8451:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d044646b380) 00000020:00000080:1.0:1789635214.884814:0:8451:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1789635214.884894:0:8451:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d056f7ce800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789635214.884898:0:8451:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d056f7ce800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789635214.884900:0:8451:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d056f7ce800 3 00010000:00080000:1.0:1789635214.884926:0:8451:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d056e352000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.120@tcp at head 00010000:00010000:1.0:1789635214.886527:0:8451:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1789635214.886725:0:8451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789635214.886762:0:8451:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789635214.886774:0:8451:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xb0c3a59caa40ecc7 00000100:00080000:1.0:1789635214.886782:0:8451:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789635214.886793:0:8451:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d056e352000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1789635214.886825:0:8451:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d04459ded80 x1876568427222144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789635214.886845:0:8451:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789635214.886931:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876568427222272:0@lo:400: 00000100:00100000:1.0:1789635214.886983:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635214.887015:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789635214.887029:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876568427222656:0@lo:400: 00000100:00100000:1.0:1789635214.887050:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635214.887097:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427222400:0@lo:400: 00000100:00100000:1.0:1789635214.887122:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635214.887140:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789635214.887146:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427222528:0@lo:400: 00000100:00100000:1.0:1789635214.887166:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635214.887192:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427222272 00000100:00100000:1.0:1789635214.887199:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427222272 00000100:00100000:1.0:1789635214.887231:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427222656 00000100:00100000:1.0:1789635214.887234:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427222656 00000100:00100000:1.0:1789635214.887249:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789635214.887257:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876568427222272:12345-0@lo:400: 00000100:00100000:1.0:1789635214.887304:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876568427222272:12345-0@lo:400: Request processed in 47us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635214.887311:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789635214.887324:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789635214.887330:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876568427222656:12345-0@lo:400: 00000100:00100000:1.0:1789635214.887357:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876568427222656:12345-0@lo:400: Request processed in 27us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635214.887363:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789635214.887383:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427222400 00000100:00100000:1.0:1789635214.887387:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427222400 00000100:00100000:1.0:1789635214.887407:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427222528 00000100:00100000:1.0:1789635214.887410:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427222528 00000100:00100000:1.0:1789635214.887424:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789635214.887430:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427222400:12345-0@lo:400: 00000100:00100000:1.0:1789635214.887477:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427222400:12345-0@lo:400: Request processed in 47us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635214.887488:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789635214.887501:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789635214.887507:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427222528:12345-0@lo:400: 00000100:00100000:1.0:1789635214.887535:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427222528:12345-0@lo:400: Request processed in 29us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635214.887541:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789635214.887578:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427222528:0@lo:400: 00000100:00100000:1.0:1789635214.887588:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427222400:0@lo:400: 00010000:00080000:1.0:1789635214.887634:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d04459ddc00 x1876568427222656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635214.887645:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876568427222656:0@lo:400: 00010000:00080000:1.0:1789635214.887655:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d04459dd880 x1876568427222272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635214.887662:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876568427222272:0@lo:400: 00000100:00100000:3.0:1789635214.887901:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1876568427222144:0@lo:38: 00000100:00100000:3.0:1789635214.887933:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635214.891891:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427222144 00000100:00100000:1.0:1789635214.891904:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427222144 00000100:00100000:1.0:1789635214.891955:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789635214.891965:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1876568427222144:12345-0@lo:38: 00010000:00080000:1.0:1789635214.891993:0:6514:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:1.0:1789635214.892032:0:6514:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xb0c3a59caa40ecce 00000004:00100000:1.0:1789635214.892049:0:6514:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789635214.892109:0:6514:0:(import.c:65:import_set_state_nolock()) ffff8d04465c3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789635214.892190:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876568427222144:12345-0@lo:38: Request processed in 226us (4255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635214.892203:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:1.0:1789635214.892313:0:8451:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789635214.892327:0:8451:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8d0446468000) 00000020:00000080:1.0:1789635214.892343:0:8451:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1789635214.892424:0:8451:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d056f7ce800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789635214.892428:0:8451:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d056f7ce800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789635214.892430:0:8451:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d056f7ce800 3 00010000:00080000:1.0:1789635214.892457:0:8451:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d04465c5000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.120@tcp at head 00010000:00010000:1.0:1789635214.894571:0:8451:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00010000:00080000:3.0:1789635214.895282:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d04459ded80 x1876568427222144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789635224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635214.895294:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789635214.895303:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1789635214.895312:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789635214.895317:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789635214.895320:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d056e352000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789635214.895326:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1876568427222144:0@lo:38: 00000020:00000080:1.0:1789635214.895529:0:8451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1789635214.895569:0:8451:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789635214.895579:0:8451:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xb0c3a59caa40ecdc 00000100:00080000:1.0:1789635214.895585:0:8451:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789635214.895624:0:8451:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8d04465c5000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1789635214.895652:0:8451:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d04459dd880 x1876568427222784/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789635214.895674:0:8451:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789635214.897633:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1876568427222784:0@lo:38: 00000100:00100000:2.0:1789635214.897700:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635214.897763:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427222784 00000100:00100000:2.0:1789635214.897772:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427222784 00000100:00100000:2.0:1789635214.897805:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789635214.897812:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1876568427222784:12345-0@lo:38: 00010000:00080000:2.0:1789635214.897839:0:6515:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:2.0:1789635214.897867:0:6515:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xb0c3a59caa40ece3 00000004:00100000:2.0:1789635214.897880:0:6515:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789635214.897910:0:6515:0:(import.c:65:import_set_state_nolock()) ffff8d0446454800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789635214.897958:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876568427222784:12345-0@lo:38: Request processed in 145us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635214.897966:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789635214.898001:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d04459dd880 x1876568427222784/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789635224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635214.898018:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789635214.898025:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1789635214.898033:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789635214.898037:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789635214.898040:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d04465c5000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789635214.898045:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1876568427222784:0@lo:38: 00000040:00080000:2.0:1789635214.902045:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1789635214.903180:0:8423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1789635214.903213:0:8423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789635214.903247:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8200/0xb0c3a59caa40ecb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ecb9 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635214.903260:0:8423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8200/0xb0c3a59caa40ecb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ecb9 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789635214.903310:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789635214.903312:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789635214.903314:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789635214.903315:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789635214.903317:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789635214.903318:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789635214.903319:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789635214.903320:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789635214.903321:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789635214.903323:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789635214.903324:0:8423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789635214.903328:0:8423:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1789635214.903330:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789635214.903331:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789635214.903332:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789635214.903333:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789635214.903334:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789635214.903335:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789635214.903336:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789635214.903337:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789635214.903337:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789635214.903338:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789635214.903339:0:8423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789635214.903365:0:8423:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789635214.903382:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427222912:0@lo:253: 00000100:00100000:3.0:1789635214.903442:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635214.903485:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d054604acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635214.903588:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427222912 00000100:00100000:1.0:1789635214.903722:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427222912 00000100:00100000:1.0:1789635214.903773:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789635214.903782:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+16:8423:x1876568427222912:12345-0@lo:253: 20000000:01000000:1.0:1789635214.903807:0:6506:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789635214.903821:0:6506:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789635214.910556:0:6506:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789635214.910578:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789635214.911204:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:8423:1876568427222912:0@lo:253: 10000000:01000000:3.0:1789635214.911218:0:8423:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789635214.911232:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789635214.911233:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789635214.911235:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789635214.911236:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789635214.911237:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789635214.911238:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789635214.911240:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789635214.911241:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789635214.911242:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789635214.911256:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789635214.911258:0:8423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789635214.911272:0:8423:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1789635214.913510:0:6530:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789635214.913519:0:6530:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789635214.913549:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40ecea lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.913567:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d058214a000/0xb0c3a59caa40ec26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ec1f expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.913574:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d058214a400/0xb0c3a59caa40ec34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ec2d expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.913580:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40ecea lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635214.913586:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+16:8423:x1876568427222912:12345-0@lo:253: Request processed in 9804us (10142us total) trans 0 rc 0/0 00010000:00010000:2.0:1789635214.913636:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d058214a400/0xb0c3a59caa40ec34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40ec2d expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.913651:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d058214a400/0xb0c3a59caa40ec34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40ec2d expref: 16 pid: 6508 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635214.913664:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df2a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1876568427223040:0@lo:104: 00000100:00100000:2.0:1789635214.913733:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789635214.913785:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d058214a000/0xb0c3a59caa40ec26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40ec1f expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635214.913789:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1789635214.913794:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d058214a000/0xb0c3a59caa40ec26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40ec1f expref: 16 pid: 6506 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635214.913801:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df1f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1876568427223168:0@lo:104: 00000100:00100000:0.0:1789635214.913804:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427223040 00000100:00100000:0.0:1789635214.913810:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427223040 00000100:00100000:2.0:1789635214.913819:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635214.913837:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d056e17a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635214.913842:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427223168 00000100:00100000:0.0:1789635214.913845:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427223168 00000100:00100000:2.0:1789635214.913855:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789635214.913863:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057591ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+4:6530:x1876568427223040:12345-0@lo:104: 00010000:00010000:2.0:1789635214.913874:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d058214a200/0xb0c3a59caa40ec2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ec34 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635214.913874:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00010000:2.0:1789635214.913920:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789635214.913925:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057591ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+4:6530:x1876568427223040:12345-0@lo:104: Request processed in 64us (193us total) trans 0 rc 0/0 00010000:00010000:1.0:1789635214.913929:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635214.913935:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d058214a200/0xb0c3a59caa40ec2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ec34 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.913943:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d058214a200 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:1.0:1789635214.913947:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d058214a200/0xb0c3a59caa40ec2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40ec34 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.913959:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d058214a200/0xb0c3a59caa40ec2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40ec34 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789635214.913966:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d058214a200/0xb0c3a59caa40ec2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40ec34 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635214.913971:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789635214.913998:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d058214a200/0xb0c3a59caa40ec2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ec34 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.914004:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789635214.914020:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d058214a200/0xb0c3a59caa40ec2d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ec34 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.914027:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d058214a200/0xb0c3a59caa40ec2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ec34 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.914041:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635214.914043:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635214.914045:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635214.914055:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427223296:0@lo:103: 00000100:00100000:1.0:1789635214.914092:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635214.914198:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789635214.914233:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789635214.914240:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+3:6530:x1876568427223168:12345-0@lo:104: 00080000:10000000:3.0:1789635214.915236:0:8423:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00010000:00010000:2.0:1789635214.915346:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9200/0xb0c3a59caa40ec1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ec26 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.915413:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789635214.915420:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+3:6530:x1876568427223168:12345-0@lo:104: Request processed in 1180us (1598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635214.915428:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789635214.915485:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df2a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1876568427223040:0@lo:104: 00000100:00100000:2.0:1789635214.915494:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df1f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1876568427223168:0@lo:104: 00010000:00010000:2.0:1789635214.915514:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40ecea lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635214.915537:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427223296 00000100:00100000:2.0:1789635214.915543:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427223296 00010000:00010000:2.0:1789635214.915564:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d058214a400/0xb0c3a59caa40ec34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ec2d expref: 16 pid: 6508 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635214.915588:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789635214.915610:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+16:3643:x1876568427223296:12345-0@lo:103: 00010000:00010000:2.0:1789635214.915620:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635214.915625:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d058214a400/0xb0c3a59caa40ec34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ec2d expref: 16 pid: 6508 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.915634:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d058214a400/0xb0c3a59caa40ec34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40ec2d expref: 16 pid: 6508 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.915647:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d058214a400/0xb0c3a59caa40ec34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40ec2d expref: 16 pid: 6508 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.915659:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635214.915687:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+15:3643:x1876568427223296:12345-0@lo:103: Request processed in 93us (1595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635214.915693:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789635214.915722:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427223296:0@lo:103: 00010000:00010000:1.0:1789635214.915787:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635214.915798:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9200/0xb0c3a59caa40ec1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ec26 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.915805:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056f6e9200 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:1.0:1789635214.915810:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9200/0xb0c3a59caa40ec1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40ec26 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.915818:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9200/0xb0c3a59caa40ec1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40ec26 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789635214.915825:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9200/0xb0c3a59caa40ec1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40ec26 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635214.915830:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789635214.915858:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9200/0xb0c3a59caa40ec1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ec26 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.915865:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789635214.915881:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9200/0xb0c3a59caa40ec1f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ec26 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.915888:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9200/0xb0c3a59caa40ec1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ec26 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.915900:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635214.915902:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635214.915904:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635214.915916:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427223424:0@lo:103: 00000100:00100000:1.0:1789635214.915949:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635214.915989:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427223424 00000100:00100000:1.0:1789635214.915993:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427223424 00010000:00010000:1.0:1789635214.916013:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d058214a000/0xb0c3a59caa40ec26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ec1f expref: 15 pid: 6506 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1789635214.916022:0:8423:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00000100:00100000:1.0:1789635214.916032:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789635214.916037:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+15:3640:x1876568427223424:12345-0@lo:103: 00010000:00010000:1.0:1789635214.916044:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635214.916048:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d058214a000/0xb0c3a59caa40ec26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ec1f expref: 15 pid: 6506 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.916056:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d058214a000/0xb0c3a59caa40ec26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40ec1f expref: 15 pid: 6506 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.916079:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d058214a000/0xb0c3a59caa40ec26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40ec1f expref: 15 pid: 6506 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.916090:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40ecea lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.916099:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40ecea lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789635214.916113:0:6500:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003814006s 00010000:00010000:1.0:1789635214.916118:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40ecea lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.916125:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40ecea lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.916132:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40ecea lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.916138:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40ecea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.916161:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d054139c000 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:1.0:1789635214.916165:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40ecea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.916173:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40ecea lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.916184:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40ecea lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635214.916195:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00080000:10000000:3.0:1789635214.916216:0:8423:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00000100:00100000:1.0:1789635214.916222:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+14:3640:x1876568427223424:12345-0@lo:103: Request processed in 185us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635214.916229:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789635214.916258:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427223424:0@lo:103: 00010000:00010000:2.0:1789635214.916501:0:6530:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40ecea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.916517:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40ecea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635214.916523:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40ecea lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1789635214.916775:0:8423:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1789635214.917003:0:8423:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1789635214.917209:0:8423:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1789635214.918379:0:8423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789635214.930421:0:8423:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789635214.930430:0:8423:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789635214.930463:0:8423:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789635214.930503:0:8423:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.120@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789635214.930522:0:8423:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789635214.930543:0:8423:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1789635214.933135:0:8423:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789635214.933546:0:8423:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1789635215.399345:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789635215.802281:0:8507:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789635215.802525:0:8507:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789635216.422546:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635217.445749:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635218.469766:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635218.851923:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789635218.851948:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05446f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427223552:0@lo:41: 00000100:00100000:2.0:1789635218.852018:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635218.852186:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427223552 00000100:00100000:0.0:1789635218.852196:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427223552 00000100:00100000:0.0:1789635218.852248:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789635218.852257:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427223552:12345-0@lo:41: 00000004:00000024:0.0:1789635218.852301:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1789635218.852346:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427223552:12345-0@lo:41: Request processed in 90us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635218.852353:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789635218.852511:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05446f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427223552:0@lo:41: 00000100:00100000:2.0:1789635218.853674:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789635218.853693:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427223680:0@lo:41: 00000100:00100000:2.0:1789635218.853742:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635218.853879:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427223680 00000100:00100000:3.0:1789635218.853885:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427223680 00000100:00100000:3.0:1789635218.853924:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789635218.853933:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427223680:12345-0@lo:41: 00000004:00000024:3.0:1789635218.853960:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1789635218.854008:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427223680:12345-0@lo:41: Request processed in 76us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635218.854026:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789635218.856527:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427223680:0@lo:41: 00010000:00010000:3.0:1789635219.505402:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635220.389551:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427223936:0@lo:400: 00000100:00100000:0.0:1789635220.389551:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427223808:0@lo:400: 00000100:00100000:0.0:1789635220.389786:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635220.389791:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635220.389840:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876568427224320:0@lo:400: 00000100:00100000:1.0:1789635220.389841:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427224448:0@lo:400: 00000100:00100000:0.0:1789635220.389883:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635220.389890:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427224064:0@lo:400: 00000100:00100000:1.0:1789635220.389917:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635220.389921:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789635220.389931:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427224192:0@lo:400: 00000100:00100000:1.0:1789635220.389940:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1876568427224576:0@lo:400: 00000100:00100000:0.0:1789635220.389962:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635220.389984:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635220.390008:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427223808 00000100:00100000:0.0:1789635220.390025:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427223808 00000100:00100000:1.0:1789635220.390034:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427224064 00000100:00100000:1.0:1789635220.390039:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427224064 00000100:00100000:1.0:1789635220.390074:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427224192 00000100:00100000:0.0:1789635220.390077:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789635220.390078:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427224192 00000100:00100000:0.0:1789635220.390091:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+14:3643:x1876568427223808:12345-0@lo:400: 00000100:00100000:1.0:1789635220.390098:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789635220.390139:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+14:3643:x1876568427223808:12345-0@lo:400: Request processed in 51us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635220.390146:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789635220.390190:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427223936 00000100:00100000:0.0:1789635220.390194:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427223936 00000100:00100000:0.0:1789635220.390211:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427224320 00000100:00100000:0.0:1789635220.390215:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427224320 00000100:00100000:0.0:1789635220.390225:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427224576 00000100:00100000:0.0:1789635220.390227:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427224576 00000100:00100000:0.0:1789635220.390260:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789635220.390277:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427223936:12345-0@lo:400: 00000100:00100000:0.0:1789635220.390321:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427223936:12345-0@lo:400: Request processed in 54us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635220.390328:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789635220.390340:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789635220.390345:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05446f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876568427224320:12345-0@lo:400: 00000100:00100000:1.0:1789635220.390357:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427224064:12345-0@lo:400: 00000100:00100000:0.0:1789635220.390376:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05446f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876568427224320:12345-0@lo:400: Request processed in 29us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635220.390390:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789635220.390405:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427224064:12345-0@lo:400: Request processed in 298us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635220.390408:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789635220.390417:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789635220.390422:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876568427224576:12345-0@lo:400: 00000100:00100000:1.0:1789635220.390435:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789635220.390443:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05446f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427224192:12345-0@lo:400: 00000100:00100000:0.0:1789635220.390478:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876568427224576:12345-0@lo:400: Request processed in 59us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635220.390485:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789635220.390833:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789635220.390871:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d04459dc700 x1876568427223936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635220.390884:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427223936:0@lo:400: 00000100:00100000:0.0:1789635220.390906:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427224448 00000100:00100000:0.0:1789635220.390909:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427224448 00000100:00100000:0.0:1789635220.390932:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789635220.390939:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05446f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427224448:12345-0@lo:400: 00000100:00100000:0.0:1789635220.390972:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05446f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427224448:12345-0@lo:400: Request processed in 33us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635220.390977:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1789635220.391006:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d04459dc000 x1876568427224448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635220.391025:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427224448:0@lo:400: 00000100:00100000:0.0:1789635220.391049:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427223808:0@lo:400: 00010000:00080000:0.0:1789635220.391059:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d04459ddc00 x1876568427224320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635220.391067:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876568427224320:0@lo:400: 00000100:00100000:0.0:1789635220.391126:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427224064:0@lo:400: 00010000:00080000:0.0:1789635220.391139:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d04459df480 x1876568427224576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635220.391288:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1876568427224576:0@lo:400: 00000100:00080000:0.0:1789635220.391378:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789635220.391382:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789635220.391475:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05446f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427224192:12345-0@lo:400: Request processed in 1024us (1504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635220.391482:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789635220.391730:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427224192:0@lo:400: 00010000:00010000:1.0:1789635220.517956:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789635220.844815:0:8797:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789635221.543290:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789635221.866538:0:8849:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789635221.867110:0:8849:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1789635221.929987:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789635221.929994:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d0550107000 from 30 10000000:01000000:2.0:1789635221.929999:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789635221.931203:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d054139d200/0xb0c3a59caa40ecf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635221.931220:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d054139d200/0xb0c3a59caa40ecf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635221.931230:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d054139d200/0xb0c3a59caa40ecf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635221.931265:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427224704:0@lo:101: 00000100:00100000:2.0:1789635221.931327:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635221.932220:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d056e1e4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789635221.932887:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427224704 00000100:00100000:1.0:1789635221.932896:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427224704 00000100:00100000:1.0:1789635221.932993:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789635221.933015:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+14:6512:x1876568427224704:12345-0@lo:101: 00010000:00010000:1.0:1789635221.933032:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635221.933050:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0540031c00/0xb0c3a59caa40ecf8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ecf1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635221.933077:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0540031c00/0xb0c3a59caa40ecf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ecf1 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635221.933100:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0540031c00/0xb0c3a59caa40ecf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ecf1 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635221.933117:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0540031c00, rc 0) 00000100:00100000:1.0:1789635221.933185:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+15:6512:x1876568427224704:12345-0@lo:101: Request processed in 182us (1857us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635221.933192:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789635221.933266:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427224704:0@lo:101: 00010000:00010000:3.0:1789635221.933282:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d054139d200/0xb0c3a59caa40ecf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ecf8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635221.933291:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d054139d200/0xb0c3a59caa40ecf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ecf8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635221.933360:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427224832:0@lo:501: 00000100:00100000:3.0:1789635221.933392:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635221.937507:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b9116c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635221.937507:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427224832 00000100:00100000:2.0:1789635221.937528:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427224832 00000100:00100000:2.0:1789635221.937585:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789635221.937620:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+15:6512:x1876568427224832:12345-0@lo:501: 00000100:00100000:2.0:1789635221.937790:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+15:6512:x1876568427224832:12345-0@lo:501: Request processed in 195us (4396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635221.937799:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789635221.937820:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427224832:0@lo:501: 00000100:00100000:3.0:1789635221.937870:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427224960:0@lo:503: 00000100:00100000:3.0:1789635221.937916:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635221.937945:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b9116c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635221.938156:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427224960 00000100:00100000:0.0:1789635221.938162:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427224960 00000100:00100000:0.0:1789635221.938194:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789635221.938201:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+15:6512:x1876568427224960:12345-0@lo:503: 00000100:00100000:0.0:1789635221.938979:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+15:6512:x1876568427224960:12345-0@lo:503: Request processed in 777us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635221.938986:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789635221.942670:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427224960:0@lo:503: 00000100:00100000:1.0:1789635221.943220:0:8856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ded80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:8856:1876568427225088:0@lo:502: 00000100:00100000:1.0:1789635221.943290:0:8856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635221.943335:0:8856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05429e7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789635221.943348:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427225088 00000100:00100000:2.0:1789635221.943356:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427225088 00000100:00100000:2.0:1789635221.943410:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789635221.943421:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+15:8856:x1876568427225088:12345-0@lo:502: 00000100:00100000:2.0:1789635221.943576:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+15:8856:x1876568427225088:12345-0@lo:502: Request processed in 155us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635221.943584:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789635221.943863:0:8856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ded80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:8856:1876568427225088:0@lo:502: 00000100:00100000:1.0:1789635221.943920:0:8856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ded80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:8856:1876568427225216:0@lo:502: 00000100:00100000:1.0:1789635221.943954:0:8856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635221.943986:0:8856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0575963780 going to sleep for 11 seconds 00000100:00100000:2.0:1789635221.944044:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427225216 00000100:00100000:2.0:1789635221.944049:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427225216 00000100:00100000:2.0:1789635221.944085:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789635221.944092:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b811450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+15:8856:x1876568427225216:12345-0@lo:502: 00000100:00100000:2.0:1789635221.944316:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b811450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+15:8856:x1876568427225216:12345-0@lo:502: Request processed in 223us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635221.944323:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789635221.944368:0:8856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ded80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:8856:1876568427225216:0@lo:502: 00000040:00080000:0.0:1789635221.944390:0:8856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789635221.944615:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789635221.944640:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789635221.944649:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d054139d200/0xb0c3a59caa40ecf1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ecf8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635221.944659:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d054139d200/0xb0c3a59caa40ecf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ecf8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635221.944668:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789635221.944671:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d0550107000 from 5 10000000:01000000:2.0:1789635221.944674:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789635221.944701:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d054139ce00/0xb0c3a59caa40ecff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635221.944710:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d054139ce00/0xb0c3a59caa40ecff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635221.944720:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d054139ce00/0xb0c3a59caa40ecff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635221.944734:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427225344:0@lo:101: 00000100:00100000:2.0:1789635221.944767:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635221.944787:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d056e1e4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789635221.945878:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427225344 00000100:00100000:0.0:1789635221.945889:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427225344 00000100:00100000:0.0:1789635221.945948:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789635221.945957:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b811050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+15:6512:x1876568427225344:12345-0@lo:101: 00010000:00010000:0.0:1789635221.945969:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635221.945988:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056f6e9e00/0xb0c3a59caa40ed06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ecff expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635221.946025:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056f6e9e00/0xb0c3a59caa40ed06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ecff expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635221.946048:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056f6e9e00/0xb0c3a59caa40ed06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ecff expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635221.946056:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056f6e9e00, rc 0) 00000100:00100000:0.0:1789635221.946378:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b811050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+16:6512:x1876568427225344:12345-0@lo:101: Request processed in 421us (1609us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635221.946386:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789635221.950351:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427225344:0@lo:101: 00010000:00010000:2.0:1789635221.950378:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d054139ce00/0xb0c3a59caa40ecff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ed06 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635221.950390:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d054139ce00/0xb0c3a59caa40ecff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ed06 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635221.950468:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427225472:0@lo:256: 00000100:00100000:2.0:1789635221.950527:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635221.950559:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d056e1e4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789635221.951039:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427225472 00000100:00100000:1.0:1789635221.951047:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427225472 00000100:00100000:1.0:1789635221.951107:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789635221.951116:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+16:6512:x1876568427225472:12345-0@lo:256: 20000000:01000000:1.0:1789635221.951136:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789635221.951152:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789635221.951155:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1789635221.951251:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+16:6512:x1876568427225472:12345-0@lo:256: Request processed in 136us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635221.951259:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789635221.951346:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427225472:0@lo:256: 10000000:01000000:0.0:1789635221.951394:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789635221.951402:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d054139ce00/0xb0c3a59caa40ecff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ed06 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635221.951411:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d054139ce00/0xb0c3a59caa40ecff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ed06 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635221.951421:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789635221.951423:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1789635221.951425:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789635221.951449:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9600/0xb0c3a59caa40ed0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635221.951457:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9600/0xb0c3a59caa40ed0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635221.951466:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9600/0xb0c3a59caa40ed0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635221.951479:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05446f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427225600:0@lo:101: 00000100:00100000:0.0:1789635221.951515:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635221.951548:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05461e8180 going to sleep for 11 seconds 00000100:00100000:1.0:1789635221.954281:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427225600 00000100:00100000:1.0:1789635221.954295:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427225600 00000100:00100000:1.0:1789635221.954346:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789635221.954357:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+16:6512:x1876568427225600:12345-0@lo:101: 00010000:00010000:1.0:1789635221.954381:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635221.954400:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0540030200/0xb0c3a59caa40ed14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ed0d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635221.954428:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0540030200/0xb0c3a59caa40ed14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ed0d expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635221.954439:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0540030200/0xb0c3a59caa40ed14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ed0d expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635221.954448:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0540030200, rc 0) 00000100:00100000:1.0:1789635221.954522:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+17:6512:x1876568427225600:12345-0@lo:101: Request processed in 167us (3006us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635221.954529:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789635221.957214:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05446f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427225600:0@lo:101: 00010000:00010000:1.0:1789635221.957242:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9600/0xb0c3a59caa40ed0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ed14 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635221.957257:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9600/0xb0c3a59caa40ed0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ed14 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635221.957337:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427225728:0@lo:501: 00000100:00100000:1.0:1789635221.957392:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635221.957491:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0575963600 going to sleep for 11 seconds 00000100:00100000:2.0:1789635221.958840:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427225728 00000100:00100000:2.0:1789635221.958852:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427225728 00000100:00100000:2.0:1789635221.958970:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789635221.958981:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+17:6512:x1876568427225728:12345-0@lo:501: 00000100:00100000:2.0:1789635221.959425:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+17:6512:x1876568427225728:12345-0@lo:501: Request processed in 446us (2032us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635221.959433:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789635221.959515:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427225728:0@lo:501: 00000100:00100000:0.0:1789635221.959561:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05446f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427225856:0@lo:503: 00000100:00100000:0.0:1789635221.959638:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635221.965067:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05461e8480 going to sleep for 11 seconds 00000100:00100000:1.0:1789635221.968216:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427225856 00000100:00100000:1.0:1789635221.968233:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427225856 00000100:00100000:1.0:1789635221.968303:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789635221.968314:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+17:6512:x1876568427225856:12345-0@lo:503: 00000100:00100000:1.0:1789635221.968488:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+17:6512:x1876568427225856:12345-0@lo:503: Request processed in 176us (8849us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635221.968496:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789635221.970167:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05446f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427225856:0@lo:503: 00000100:00100000:3.0:1789635221.970929:0:8858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ebb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:8858:1876568427225984:0@lo:502: 00000100:00100000:3.0:1789635221.970995:0:8858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635221.971042:0:8858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b911b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789635221.971048:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427225984 00000100:00100000:1.0:1789635221.971056:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427225984 00000100:00100000:1.0:1789635221.971090:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789635221.971099:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+17:8858:x1876568427225984:12345-0@lo:502: 00000100:00100000:1.0:1789635221.971826:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+17:8858:x1876568427225984:12345-0@lo:502: Request processed in 721us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635221.971836:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789635221.972110:0:8858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ebb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:8858:1876568427225984:0@lo:502: 00000020:01000000:3.0:1789635221.972139:0:8858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789635221.972146:0:8858:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789635221.974064:0:8858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635221.974067:0:8858:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789635221.974079:0:8858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789635221.974085:0:8858:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:01000000:3.0:1789635221.974112:0:8858:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789635221.974115:0:8858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789635221.974130:0:8858:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8d05759219c0) 00000020:00000080:3.0:1789635221.974153:0:8858:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1789635221.974159:0:8858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789635221.974307:0:8858:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1789635221.974315:0:8858:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789635221.974322:0:8858:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb0c3a59caa40ed22 00010000:00080000:3.0:1789635221.974353:0:8858:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d05746d5000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.120@tcp at head 00010000:00010000:3.0:1789635221.974579:0:8858:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1789635221.986246:0:8858:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789635221.986282:0:8858:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1789635221.986478:0:8858:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789635221.986751:0:8858:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789635221.986844:0:8858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1789635221.986933:0:8858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1789635221.988807:0:8859:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789635221.988814:0:8859:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789635221.989549:0:8858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789635221.989563:0:8858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789635221.989822:0:8858:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789635221.989846:0:8858:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb0c3a59caa40ed29 00000100:00080000:1.0:1789635221.989856:0:8858:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789635221.989867:0:8858:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d05746d5000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1789635221.989903:0:8858:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d04459df800 x1876568427226112/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789635221.989921:0:8858:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789635221.990000:0:8858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789635221.990021:0:8858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635221.990023:0:8858:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789635221.990028:0:8858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789635221.990033:0:8858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635221.990034:0:8858:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789635221.990038:0:8858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789635221.990041:0:8858:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789635221.990071:0:8858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:8858:1876568427226240:0@lo:502: 00000100:00100000:0.0:1789635221.990136:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05446f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876568427226368:0@lo:400: 00000100:00100000:2.0:1789635221.990193:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1876568427226112:0@lo:8: 00000100:00100000:0.0:1789635221.990431:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635221.990463:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1876568427226880:0@lo:400: 00000100:00100000:0.0:1789635221.990488:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635221.990509:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789635221.990515:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427226496:0@lo:400: 00000100:00100000:0.0:1789635221.990538:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635221.990556:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427227008:0@lo:400: 00000100:00100000:0.0:1789635221.990577:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635221.990618:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05446f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427226624:0@lo:400: 00000100:00100000:0.0:1789635221.990641:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635221.990659:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789635221.990664:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427226752:0@lo:400: 00000100:00100000:0.0:1789635221.990684:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635221.990709:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427226368 00000100:00100000:0.0:1789635221.990716:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427226368 00000100:00100000:0.0:1789635221.990749:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427226880 00000100:00100000:0.0:1789635221.990752:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427226880 00000100:00100000:0.0:1789635221.990764:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427227008 00000100:00100000:0.0:1789635221.990766:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427227008 00000100:00100000:0.0:1789635221.990786:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427226752 00000100:00100000:0.0:1789635221.990789:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427226752 00000100:00100000:0.0:1789635221.990802:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789635221.990810:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876568427226368:12345-0@lo:400: 00000100:00100000:0.0:1789635221.990860:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876568427226368:12345-0@lo:400: Request processed in 49us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635221.990867:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789635221.990881:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789635221.990887:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876568427226880:12345-0@lo:400: 00000100:00100000:0.0:1789635221.990916:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876568427226880:12345-0@lo:400: Request processed in 29us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635221.990922:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789635221.990932:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789635221.990938:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427227008:12345-0@lo:400: 00000100:00100000:0.0:1789635221.990965:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427227008:12345-0@lo:400: Request processed in 28us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635221.990971:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789635221.990982:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789635221.990987:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427226752:12345-0@lo:400: 00000100:00100000:0.0:1789635221.991031:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427226752:12345-0@lo:400: Request processed in 44us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635221.991037:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789635221.991055:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427226496 00000100:00100000:0.0:1789635221.991059:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427226496 00000100:00100000:0.0:1789635221.991081:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427226624 00000100:00100000:0.0:1789635221.991084:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427226624 00000100:00100000:0.0:1789635221.991096:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789635221.991102:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427226496:12345-0@lo:400: 00000100:00100000:0.0:1789635221.991140:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427226496:12345-0@lo:400: Request processed in 38us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635221.991146:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789635221.991156:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789635221.991161:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427226624:12345-0@lo:400: 00000100:00100000:0.0:1789635221.991183:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427226624:12345-0@lo:400: Request processed in 22us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635221.991188:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1789635221.991225:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d05759d0000 x1876568427226752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635221.991238:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427226752:0@lo:400: 00000100:00100000:0.0:1789635221.991353:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05446f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427226624:0@lo:400: 00000100:00100000:0.0:1789635221.991382:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427226496:0@lo:400: 00010000:00080000:0.0:1789635221.991391:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d05759d3480 x1876568427227008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635221.991400:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427227008:0@lo:400: 00010000:00080000:0.0:1789635221.991410:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d05446f6d80 x1876568427226368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635221.991418:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05446f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876568427226368:0@lo:400: 00010000:00080000:0.0:1789635221.991428:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d05759d1880 x1876568427226880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635221.991436:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1876568427226880:0@lo:400: 00000100:00100000:1.0:1789635221.992042:0:8858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635221.992069:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635221.992142:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427226240 00000100:00100000:0.0:1789635221.992153:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427226240 00000100:00100000:0.0:1789635221.992185:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789635221.992191:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+17:8858:x1876568427226240:12345-0@lo:502: 00000100:00100000:0.0:1789635221.993443:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+17:8858:x1876568427226240:12345-0@lo:502: Request processed in 1247us (1399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635221.993452:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789635221.993503:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427226112 00000100:00100000:0.0:1789635221.993508:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427226112 00000100:00100000:0.0:1789635221.993532:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789635221.993538:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1876568427226112:12345-0@lo:8: 00010000:00080000:0.0:1789635221.993561:0:8430:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:0.0:1789635221.993586:0:8430:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb0c3a59caa40ed30 00002000:00100000:0.0:1789635221.993633:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8d0445993000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1789635221.993638:0:8430:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1789635221.993642:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1789635221.993692:0:8430:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789635221.993885:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1789635221.993909:0:8430:0:(import.c:65:import_set_state_nolock()) ffff8d0445995000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789635221.993948:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1876568427226112:12345-0@lo:8: Request processed in 409us (1881us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635221.993956:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789635221.994466:0:8858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0575963e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789635221.994491:0:8858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:8858:1876568427226240:0@lo:502: 00000020:01000000:1.0:1789635221.994525:0:8858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789635221.994531:0:8858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635221.994534:0:8858:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789635221.994538:0:8858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:0.0:1789635221.996386:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:0.0:1789635221.996417:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789635221.996427:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9600/0xb0c3a59caa40ed0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ed14 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635221.996439:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9600/0xb0c3a59caa40ed0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ed14 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635221.996460:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789635221.996462:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d0558960000 from 30 10000000:01000000:0.0:1789635221.996465:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789635221.996498:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8c00/0xb0c3a59caa40ed37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635221.996506:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8c00/0xb0c3a59caa40ed37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635221.996516:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8c00/0xb0c3a59caa40ed37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635221.996539:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427227136:0@lo:101: 00000100:00100000:0.0:1789635221.996742:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635221.996777:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05461e8840 going to sleep for 11 seconds 00000100:00100000:0.0:1789635221.996810:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427227136 00000100:00100000:0.0:1789635221.996817:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427227136 00000100:00100000:0.0:1789635221.996860:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789635221.996869:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+17:6512:x1876568427227136:12345-0@lo:101: 00010000:00010000:0.0:1789635221.996882:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635221.996894:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40ed3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ed37 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635221.996916:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40ed3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ed37 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635221.996926:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40ed3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ed37 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635221.996947:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056f6e9000, rc 0) 00000100:00100000:0.0:1789635221.996987:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+18:6512:x1876568427227136:12345-0@lo:101: Request processed in 118us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635221.996993:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789635221.997345:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427227136:0@lo:101: 00010000:00010000:0.0:1789635221.997358:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8c00/0xb0c3a59caa40ed37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ed3e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635221.997368:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8c00/0xb0c3a59caa40ed37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ed3e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635221.997423:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427227264:0@lo:501: 00000100:00100000:0.0:1789635221.997450:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635221.997464:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05461e8840 going to sleep for 11 seconds 00000100:00100000:0.0:1789635221.997477:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427227264 00000100:00100000:0.0:1789635221.997480:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427227264 00000100:00100000:0.0:1789635221.997500:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789635221.997507:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+18:6512:x1876568427227264:12345-0@lo:501: 00000100:00100000:0.0:1789635221.997897:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+18:6512:x1876568427227264:12345-0@lo:501: Request processed in 389us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635221.997905:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789635221.997939:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427227264:0@lo:501: 00000100:00100000:0.0:1789635221.997967:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427227392:0@lo:503: 00000100:00100000:0.0:1789635221.998014:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789635221.998215:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d04459df800 x1876568427226112/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789635231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635221.998227:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789635221.998234:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789635221.998241:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:0.0:1789635221.999061:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05461e8840 going to sleep for 11 seconds 00000100:00100000:0.0:1789635221.999096:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427227392 00000100:00100000:0.0:1789635221.999112:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427227392 00000100:00100000:0.0:1789635221.999212:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789635221.999221:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+18:6512:x1876568427227392:12345-0@lo:503: 00000100:00100000:0.0:1789635221.999395:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+18:6512:x1876568427227392:12345-0@lo:503: Request processed in 175us (1388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635221.999403:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789635221.999451:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427227392:0@lo:503: 00000100:00100000:0.0:1789635221.999814:0:8862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:8862:1876568427227520:0@lo:502: 00000100:00100000:0.0:1789635221.999856:0:8862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635221.999877:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427227520 00000100:00100000:0.0:1789635221.999882:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427227520 00000100:00100000:0.0:1789635221.999906:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789635221.999912:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+18:8862:x1876568427227520:12345-0@lo:502: 00000100:00100000:0.0:1789635221.999983:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+18:8862:x1876568427227520:12345-0@lo:502: Request processed in 71us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635221.999989:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789635222.000343:0:8862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05461e8540 going to sleep for 11 seconds 00000100:00100000:0.0:1789635222.000359:0:8862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:8862:1876568427227520:0@lo:502: 00000100:00100000:0.0:1789635222.000405:0:8862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:8862:1876568427227648:0@lo:502: 00000100:00100000:0.0:1789635222.000438:0:8862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635222.000464:0:8862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05461e8540 going to sleep for 11 seconds 00000100:00100000:1.0:1789635222.000622:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427227648 00000100:00100000:1.0:1789635222.000628:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427227648 00000100:00100000:1.0:1789635222.000656:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789635222.000663:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+18:8862:x1876568427227648:12345-0@lo:502: 00000100:00100000:1.0:1789635222.000742:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+18:8862:x1876568427227648:12345-0@lo:502: Request processed in 78us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635222.000748:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789635222.000918:0:8862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:8862:1876568427227648:0@lo:502: 00000040:00080000:0.0:1789635222.000936:0:8862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789635222.001327:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 00000100:00080000:2.0:1789635222.001336:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789635222.001342:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d05746d5000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789635222.001353:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789635222.001363:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8c00/0xb0c3a59caa40ed37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ed3e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789635222.001368:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789635222.001377:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1876568427226112:0@lo:8: 00010000:00010000:1.0:1789635222.001377:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8c00/0xb0c3a59caa40ed37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ed3e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635222.001405:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789635222.001409:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d0558960000 from 5 10000000:01000000:1.0:1789635222.001412:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789635222.001439:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d0540030a00/0xb0c3a59caa40ed45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635222.001446:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d0540030a00/0xb0c3a59caa40ed45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635222.001454:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d0540030a00/0xb0c3a59caa40ed45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635222.001467:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427227776:0@lo:101: 00000100:00100000:1.0:1789635222.001501:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635222.001534:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0575963900 going to sleep for 11 seconds 00000004:00080000:1.0:1789635222.001550:0:8859:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789635222.001746:0:8859:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 240685148982ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789635222.001753:0:8859:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1789635222.002346:0:8860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8860:1876568427227904:0@lo:700: 00000100:00100000:0.0:1789635222.002396:0:8860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635222.002416:0:8860:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0548df2540 going to sleep for 11 seconds 00000100:00100000:0.0:1789635222.002437:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427227904 00000100:00100000:0.0:1789635222.002442:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427227904 00000100:00100000:2.0:1789635222.002545:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427227776 00000100:00100000:2.0:1789635222.002551:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427227776 00000100:00100000:2.0:1789635222.002583:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789635222.002592:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+18:6512:x1876568427227776:12345-0@lo:101: 00010000:00010000:2.0:1789635222.002631:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635222.002646:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d054139c800/0xb0c3a59caa40ed4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ed45 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635222.002671:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d054139c800/0xb0c3a59caa40ed4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ed45 expref: 19 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635222.002683:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d054139c800/0xb0c3a59caa40ed4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ed45 expref: 19 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635222.002691:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d054139c800, rc 0) 00000100:00100000:2.0:1789635222.002732:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+19:6512:x1876568427227776:12345-0@lo:101: Request processed in 141us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635222.002738:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789635222.002782:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427227776:0@lo:101: 00010000:00010000:2.0:1789635222.002795:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d0540030a00/0xb0c3a59caa40ed45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ed4c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635222.002805:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d0540030a00/0xb0c3a59caa40ed45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ed4c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635222.002851:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427228032:0@lo:256: 00000100:00100000:2.0:1789635222.002881:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635222.002903:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d056e1e49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635222.002916:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427228032 00000100:00100000:2.0:1789635222.002919:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427228032 00000100:00100000:2.0:1789635222.002943:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789635222.002950:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+19:6512:x1876568427228032:12345-0@lo:256: 20000000:01000000:2.0:1789635222.002973:0:6508:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789635222.002988:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789635222.002991:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1789635222.003080:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+19:6512:x1876568427228032:12345-0@lo:256: Request processed in 130us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635222.003086:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789635222.003113:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427228032:0@lo:256: 10000000:01000000:2.0:1789635222.003151:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789635222.003157:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d0540030a00/0xb0c3a59caa40ed45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ed4c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635222.003165:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d0540030a00/0xb0c3a59caa40ed45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ed4c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635222.003173:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789635222.003176:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1789635222.003178:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789635222.003193:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d054139d000/0xb0c3a59caa40ed53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635222.003200:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d054139d000/0xb0c3a59caa40ed53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635222.003208:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d054139d000/0xb0c3a59caa40ed53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635222.003219:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427228160:0@lo:101: 00000100:00100000:2.0:1789635222.003244:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635222.003257:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d056e1e49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635222.003274:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427228160 00000100:00100000:2.0:1789635222.003277:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427228160 00000100:00100000:2.0:1789635222.003300:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789635222.003307:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+19:6512:x1876568427228160:12345-0@lo:101: 00010000:00010000:2.0:1789635222.003314:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635222.003323:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d054139c200/0xb0c3a59caa40ed5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ed53 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635222.003337:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d054139c200/0xb0c3a59caa40ed5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ed53 expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635222.003345:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d054139c200/0xb0c3a59caa40ed5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ed53 expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635222.003351:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d054139c200, rc 0) 00000100:00100000:2.0:1789635222.003377:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+20:6512:x1876568427228160:12345-0@lo:101: Request processed in 71us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635222.003383:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789635222.003407:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427228160:0@lo:101: 00010000:00010000:2.0:1789635222.003416:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d054139d000/0xb0c3a59caa40ed53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ed5a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635222.003423:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d054139d000/0xb0c3a59caa40ed53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ed5a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635222.003468:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427228288:0@lo:501: 00000100:00100000:2.0:1789635222.003489:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635222.003500:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d056e1e49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635222.003510:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427228288 00000100:00100000:2.0:1789635222.003518:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427228288 00000100:00100000:2.0:1789635222.003534:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789635222.003539:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+20:6512:x1876568427228288:12345-0@lo:501: 00000100:00100000:2.0:1789635222.003652:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+20:6512:x1876568427228288:12345-0@lo:501: Request processed in 112us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635222.003658:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789635222.003683:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427228288:0@lo:501: 00000100:00100000:2.0:1789635222.003707:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427228416:0@lo:503: 00000100:00100000:2.0:1789635222.003742:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635222.003755:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d056e1e49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635222.003767:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427228416 00000100:00100000:2.0:1789635222.003771:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427228416 00000100:00100000:2.0:1789635222.003788:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789635222.003792:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+20:6512:x1876568427228416:12345-0@lo:503: 00000100:00100000:2.0:1789635222.003863:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+20:6512:x1876568427228416:12345-0@lo:503: Request processed in 69us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635222.003870:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789635222.003906:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427228416:0@lo:503: 00000100:00100000:2.0:1789635222.004084:0:8863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:8863:1876568427228544:0@lo:502: 00000100:00100000:2.0:1789635222.004114:0:8863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635222.004132:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427228544 00000100:00100000:2.0:1789635222.004135:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427228544 00000100:00100000:2.0:1789635222.004154:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789635222.004160:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054645ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+20:8863:x1876568427228544:12345-0@lo:502: 00000100:00100000:2.0:1789635222.004225:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054645ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+20:8863:x1876568427228544:12345-0@lo:502: Request processed in 64us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635222.004239:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789635222.004265:0:8863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d056e1e4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789635222.004276:0:8863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:8863:1876568427228544:0@lo:502: 00000020:01000000:2.0:1789635222.004295:0:8863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789635222.004302:0:8863:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1789635222.004307:0:8863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635222.004310:0:8863:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789635222.004318:0:8863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789635222.004322:0:8863:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:01000000:2.0:1789635222.004342:0:8863:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789635222.004344:0:8863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789635222.004367:0:8863:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d0579bdb380) 00000020:00000080:2.0:1789635222.004386:0:8863:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1789635222.004392:0:8863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789635222.004460:0:8863:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789635222.004465:0:8863:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789635222.004472:0:8863:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb0c3a59caa40ed68 00010000:00080000:2.0:1789635222.004507:0:8863:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d056f553800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.120@tcp at head 00010000:00010000:2.0:1789635222.004752:0:8863:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:0.0:1789635222.004785:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789635222.004799:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8860:x1876568427227904:12345-0@lo:700: 00000100:00100000:0.0:1789635222.004835:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8438:1876568427228672:0@lo:700: 00000100:00100000:0.0:1789635222.004875:0:8438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635222.004894:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05461e89c0 going to sleep for 11 seconds 00000100:00080000:0.0:1789635222.004909:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789635222.009018:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427228672 00000100:00100000:1.0:1789635222.009034:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427228672 00000100:00100000:1.0:1789635222.009098:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789635222.009122:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8438:x1876568427228672:12345-0@lo:700: 00000100:00080000:1.0:1789635222.009547:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1789635222.011706:0:7446:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000040:01000000:0.0:1789635222.016526:0:8863:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789635222.016550:0:8863:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 40000000:02000000:3.0:1789635222.016677:0:6521:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000040:00080000:0.0:1789635222.016810:0:8863:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789635222.016986:0:8863:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789635222.017080:0:8863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1789635222.017366:0:8863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1789635222.018398:0:8865:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789635222.018403:0:8865:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789635222.019026:0:8863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789635222.019038:0:8863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789635222.019072:0:8863:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789635222.019093:0:8863:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb0c3a59caa40ed6f 00000100:00080000:0.0:1789635222.019103:0:8863:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789635222.019114:0:8863:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d056f553800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1789635222.019150:0:8863:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d05759d0380 x1876568427228800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789635222.019176:0:8863:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789635222.019257:0:8863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635222.019262:0:8863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635222.019268:0:8863:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789635222.019272:0:8863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789635222.019276:0:8863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635222.019278:0:8863:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789635222.019281:0:8863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789635222.019283:0:8863:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789635222.019308:0:8863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:8863:1876568427228928:0@lo:502: 00000100:00100000:0.0:1789635222.019373:0:8863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635222.019401:0:8863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d054a0cfd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789635222.019459:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427228800:0@lo:8: 00000100:00100000:2.0:1789635222.019495:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635222.019541:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427228928 00000100:00100000:2.0:1789635222.019549:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427228928 00000100:00100000:2.0:1789635222.019585:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789635222.019618:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546459850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+20:8863:x1876568427228928:12345-0@lo:502: 00000100:00100000:2.0:1789635222.019720:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546459850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+20:8863:x1876568427228928:12345-0@lo:502: Request processed in 126us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635222.019735:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789635222.019790:0:8863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:8863:1876568427228928:0@lo:502: 00000020:01000000:2.0:1789635222.019813:0:8863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789635222.019817:0:8863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635222.019819:0:8863:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789635222.019824:0:8863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1789635222.019875:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1789635222.019894:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789635222.019903:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d054139d000/0xb0c3a59caa40ed53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ed5a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635222.019912:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d054139d000/0xb0c3a59caa40ed53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ed5a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635222.019922:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789635222.019924:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d057ae4b380 from 1 10000000:01000000:2.0:1789635222.019927:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789635222.019950:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d054139cc00/0xb0c3a59caa40ed76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635222.019958:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d054139cc00/0xb0c3a59caa40ed76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635222.019969:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d054139cc00/0xb0c3a59caa40ed76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635222.019981:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427229056:0@lo:101: 00000100:00100000:2.0:1789635222.020018:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635222.020034:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0543fd5240 going to sleep for 11 seconds 00000100:00100000:2.0:1789635222.020053:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427229056 00000100:00100000:2.0:1789635222.020057:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427229056 00000100:00100000:2.0:1789635222.020083:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789635222.020091:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054645b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+20:6512:x1876568427229056:12345-0@lo:101: 00010000:00010000:2.0:1789635222.020099:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635222.020111:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40ed7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ed76 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635222.020132:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40ed7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ed76 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635222.020143:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40ed7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ed76 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635222.020151:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d054139c000, rc 0) 00000100:00100000:2.0:1789635222.020179:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054645b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+21:6512:x1876568427229056:12345-0@lo:101: Request processed in 90us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635222.020185:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789635222.020214:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427229056:0@lo:101: 00010000:00010000:2.0:1789635222.020226:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d054139cc00/0xb0c3a59caa40ed76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ed7d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635222.020234:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d054139cc00/0xb0c3a59caa40ed76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ed7d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635222.020276:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427229184:0@lo:501: 00000100:00100000:2.0:1789635222.020305:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635222.020319:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0543fd5240 going to sleep for 11 seconds 00000100:00100000:2.0:1789635222.020331:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427229184 00000100:00100000:2.0:1789635222.020342:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427229184 00000100:00100000:2.0:1789635222.020366:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789635222.020372:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546458850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+21:6512:x1876568427229184:12345-0@lo:501: 00000100:00100000:2.0:1789635222.020437:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546458850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+21:6512:x1876568427229184:12345-0@lo:501: Request processed in 65us (132us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789635222.020443:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789635222.020471:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427229184:0@lo:501: 10000000:01000000:2.0:1789635222.020493:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789635222.020499:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d054139cc00/0xb0c3a59caa40ed76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ed7d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635222.020506:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d054139cc00/0xb0c3a59caa40ed76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ed7d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635222.020817:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427228800 00000100:00100000:0.0:1789635222.020823:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427228800 00000100:00100000:0.0:1789635222.020855:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789635222.020860:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3639:x1876568427228800:12345-0@lo:8: 00010000:00080000:0.0:1789635222.020882:0:8432:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:0.0:1789635222.020908:0:8432:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb0c3a59caa40ed84 00002000:00100000:0.0:1789635222.020921:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d0445993800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789635222.020926:0:8432:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789635222.020928:0:8432:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789635222.020990:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789635222.021022:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8d0445994000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789635222.021066:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1876568427228800:12345-0@lo:8: Request processed in 204us (1571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635222.021074:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789635222.021172:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d05759d0380 x1876568427228800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789635232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635222.021182:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789635222.021188:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789635222.021195:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789635222.021200:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789635222.021202:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d056f553800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789635222.021213:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789635222.021217:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427228800:0@lo:8: 00000004:00080000:0.0:1789635222.022695:0:8865:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789635222.022758:0:8865:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 240706160806ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789635222.022766:0:8865:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1789635222.023408:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789635222.023426:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427229312:0@lo:13: 00000100:00100000:2.0:1789635222.023483:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635222.023529:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427229312 00000100:00100000:2.0:1789635222.023542:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427229312 00000100:00080000:1.0:1789635222.023575:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789635222.023623:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789635222.023633:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1876568427229312:12345-0@lo:13: 00002000:00000024:2.0:1789635222.023655:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1789635222.023697:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1876568427229312:12345-0@lo:13: Request processed in 66us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635222.023704:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789635222.023736:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0546df0e00 x1876568427229312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635222.023754:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427229312:0@lo:13: 00000004:00080000:2.0:1789635222.023776:0:8866:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789635222.023794:0:8866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8866:1876568427229440:0@lo:7: 00000100:00100000:2.0:1789635222.023821:0:8866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635222.023848:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427229440 00000100:00100000:2.0:1789635222.023852:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427229440 00000100:00100000:2.0:1789635222.023877:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789635222.023884:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8866:x1876568427229440:12345-0@lo:7: 00000004:00080000:0.0:1789635222.031132:0:6493:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:2.0:1789635222.031984:0:8431:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1789635222.031990:0:8431:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789635222.032051:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8866:x1876568427229440:12345-0@lo:7: Request processed in 8164us (8225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635222.032061:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789635222.032101:0:8866:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0543fd5240 going to sleep for 11 seconds 00010000:00080000:2.0:1789635222.032127:0:8866:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0546df0e00 x1876568427229440/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789635238 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635222.032141:0:8866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8866:1876568427229440:0@lo:7: 00000004:00080000:2.0:1789635222.032155:0:8866:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789635222.032196:0:8866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8866:1876568427229568:0@lo:5: 00000100:00100000:2.0:1789635222.032229:0:8866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635222.032258:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427229568 00000100:00100000:2.0:1789635222.032265:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427229568 00000100:00100000:2.0:1789635222.032298:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789635222.032306:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8866:x1876568427229568:12345-0@lo:5: 00002000:00080000:2.0:1789635222.032327:0:8430:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789635222.032330:0:8430:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1789635222.032536:0:8866:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0543298780 going to sleep for 11 seconds 00000100:00100000:3.0:1789635222.032957:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8438:x1876568427228672:12345-0@lo:700: Request processed in 23839us (28081us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635222.032967:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789635222.033015:0:8438:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d05759d0000 x1876568427228672/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789635238 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635222.033027:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8438:1876568427228672:0@lo:700: 40000000:02000000:3.0:1789635222.033036:0:8438:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000001:00080000:2.0:1789635222.037905:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1789635222.037924:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789635222.037928:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789635222.038361:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8866:x1876568427229568:12345-0@lo:5: Request processed in 6051us (6127us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789635222.038377:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789635222.038404:0:8866:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0546df0e00 x1876568427229568/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789635238 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635222.038417:0:8866:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789635222.038423:0:8866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8866:1876568427229568:0@lo:5: 00000004:00080000:2.0:1789635222.038438:0:8866:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789635222.038482:0:8866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8866:1876568427229696:0@lo:700: 00000100:00100000:2.0:1789635222.038516:0:8866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635222.038548:0:8866:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0543298780 going to sleep for 11 seconds 00000100:00100000:1.0:1789635222.038640:0:8439:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 2 min 2 max 16 00000100:00100000:1.0:1789635222.038659:0:8439:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_002' 00000100:00100000:0.0:1789635222.038950:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427229696 00000100:00100000:0.0:1789635222.038958:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427229696 00000100:00100000:1.0:1789635222.042981:0:8868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789635222.042999:0:8868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8866:x1876568427229696:12345-0@lo:700: 00000100:00100000:3.0:1789635222.054574:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8860:x1876568427227904:12345-0@lo:700: Request processed in 49773us (52170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635222.054621:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789635222.054671:0:8860:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d05759d1880 x1876568427227904/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789635238 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635222.054684:0:8860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8860:1876568427227904:0@lo:700: 00000004:00080000:1.0:1789635222.065407:0:8860:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789635222.065440:0:8860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ddc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8860:1876568427229952:0@lo:7: 00000100:00100000:1.0:1789635222.065505:0:8860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635222.065533:0:8860:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0575963600 going to sleep for 11 seconds 00000100:00100000:2.0:1789635222.065841:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427229824:0@lo:13: 00000100:00100000:2.0:1789635222.065881:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635222.066414:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427229952 00000100:00100000:2.0:1789635222.066424:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427229952 00000100:00100000:2.0:1789635222.066471:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789635222.066480:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8860:x1876568427229952:12345-0@lo:7: 00000100:00100000:0.0:1789635222.067995:0:8868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8866:x1876568427229696:12345-0@lo:700: Request processed in 24997us (29474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635222.068018:0:8868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789635222.076677:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427229824 00000100:00100000:1.0:1789635222.076691:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427229824 00000100:00100000:1.0:1789635222.076741:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789635222.076751:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1876568427229824:12345-0@lo:13: 00002000:00000024:1.0:1789635222.076777:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1789635222.076861:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1876568427229824:12345-0@lo:13: Request processed in 110us (10980us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635222.076869:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00002000:00080000:2.0:1789635222.080486:0:8432:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1789635222.080495:0:8432:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789635222.080588:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8860:x1876568427229952:12345-0@lo:7: Request processed in 14105us (15079us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635222.080616:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789635222.080721:0:8860:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d04459ddc00 x1876568427229952/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789635238 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635222.080736:0:8860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ddc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8860:1876568427229952:0@lo:7: 00000004:00080000:1.0:1789635222.080751:0:8860:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789635222.080787:0:8860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ddc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8860:1876568427230080:0@lo:5: 00000100:00100000:1.0:1789635222.080818:0:8860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635222.080845:0:8860:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0575963600 going to sleep for 11 seconds 00000100:00100000:1.0:1789635222.080862:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427230080 00000100:00100000:1.0:1789635222.080870:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427230080 00000100:00100000:1.0:1789635222.080906:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789635222.080928:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8860:x1876568427230080:12345-0@lo:5: 00002000:00080000:1.0:1789635222.080961:0:8430:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1789635222.080994:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8860:x1876568427230080:12345-0@lo:5: Request processed in 81us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635222.081001:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789635222.081052:0:8860:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d04459ddc00 x1876568427230080/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789635238 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635222.081073:0:8860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ddc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8860:1876568427230080:0@lo:5: 00000004:00080000:1.0:1789635222.081082:0:8860:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00010000:00080000:2.0:1789635222.081665:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d04459dfb80 x1876568427229824/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635222.081685:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427229824:0@lo:13: 00010000:00080000:1.0:1789635222.087711:0:8866:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0546df0e00 x1876568427229696/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789635238 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635222.087730:0:8866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8866:1876568427229696:0@lo:700: 00000004:02000040:1.0:1789635222.093407:0:8866:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:1.0:1789635222.101420:0:8866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ddc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8866:1876568427230208:0@lo:5: 00000100:00100000:1.0:1789635222.101483:0:8866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635222.101518:0:8866:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0575963600 going to sleep for 11 seconds 00000100:00100000:1.0:1789635222.101860:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427230208 00000100:00100000:1.0:1789635222.101867:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427230208 00000100:00100000:1.0:1789635222.101913:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789635222.101933:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8866:x1876568427230208:12345-0@lo:5: 00002000:00080000:1.0:1789635222.111068:0:8432:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1789635222.111090:0:8432:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:1.0:1789635222.112900:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8866:x1876568427230208:12345-0@lo:5: Request processed in 10961us (11411us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789635222.112913:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789635222.112980:0:8866:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d04459ddc00 x1876568427230208/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789635238 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635222.113000:0:8866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ddc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8866:1876568427230208:0@lo:5: 00000004:00080000:2.0:1789635222.113029:0:8866:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:3.0:1789635222.565913:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789635222.639375:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1789635223.587921:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635223.972087:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789635223.972111:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427230336:0@lo:41: 00000100:00100000:0.0:1789635223.972183:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635223.972244:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427230336 00000100:00100000:0.0:1789635223.972252:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427230336 00000100:00100000:0.0:1789635223.972297:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789635223.972306:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427230336:12345-0@lo:41: 00000004:00000024:0.0:1789635223.972372:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1789635223.972416:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427230336:12345-0@lo:41: Request processed in 110us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635223.972423:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789635223.972466:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427230336:0@lo:41: 00000100:00100000:1.0:1789635223.976408:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789635223.976433:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427230464:0@lo:41: 00000100:00100000:1.0:1789635223.976499:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635223.976564:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427230464 00000100:00100000:0.0:1789635223.976572:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427230464 00000100:00100000:0.0:1789635223.976659:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789635223.976670:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427230464:12345-0@lo:41: 00000004:00000024:0.0:1789635223.976701:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789635223.976758:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427230464:12345-0@lo:41: Request processed in 90us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635223.976765:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789635223.976822:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427230464:0@lo:41: 00000020:00000004:2.0:1789635224.485457:0:8959:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789635224.485930:0:8959:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789635224.614421:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789635225.475290:0:9007:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789635225.475299:0:9007:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1789635225.636821:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635226.660361:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635227.043860:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789635227.043885:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427230592:0@lo:13: 00000100:00100000:3.0:1789635227.043955:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635227.044184:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427230592 00000100:00100000:1.0:1789635227.044192:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427230592 00000100:00100000:1.0:1789635227.044256:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789635227.044266:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427230592:12345-0@lo:13: 00002000:00000024:1.0:1789635227.044293:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789635227.044340:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427230592:12345-0@lo:13: Request processed in 77us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635227.044347:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789635227.044386:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0546df0380 x1876568427230592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635227.044396:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789635227.044412:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427230592:0@lo:13: 00000100:00080000:2.0:1789635227.044483:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789635227.053902:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427230720:0@lo:400: 00000100:00100000:1.0:1789635227.053984:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635227.054029:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876568427231232:0@lo:400: 00000100:00100000:1.0:1789635227.054073:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635227.054101:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789635227.054107:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427231104:0@lo:400: 00000100:00100000:1.0:1789635227.054136:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635227.054154:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427231616:0@lo:400: 00000100:00100000:1.0:1789635227.054174:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635227.054212:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427231232 00000100:00100000:1.0:1789635227.054220:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427231232 00000100:00100000:1.0:1789635227.054266:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789635227.054275:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876568427231232:12345-0@lo:400: 00000100:00100000:1.0:1789635227.054329:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876568427231232:12345-0@lo:400: Request processed in 54us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635227.054336:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789635227.054358:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427231104 00000100:00100000:1.0:1789635227.054362:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427231104 00000100:00100000:1.0:1789635227.054386:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789635227.054391:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427231104:12345-0@lo:400: 00000100:00100000:1.0:1789635227.054420:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427231104:12345-0@lo:400: Request processed in 29us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635227.054426:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789635227.054441:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427231616 00000100:00100000:1.0:1789635227.054444:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427231616 00000100:00100000:1.0:1789635227.054475:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789635227.054481:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427231616:12345-0@lo:400: 00000100:00100000:1.0:1789635227.054512:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427231616:12345-0@lo:400: Request processed in 31us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635227.054517:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789635227.054538:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789635227.054573:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427231104:0@lo:400: 00010000:00080000:1.0:1789635227.054587:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d05759c8a80 x1876568427231616/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635227.054910:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427231616:0@lo:400: 00010000:00080000:1.0:1789635227.054926:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d05759c9f80 x1876568427231232/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635227.054942:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876568427231232:0@lo:400: 00000100:00100000:0.0:1789635227.055061:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427230976:0@lo:400: 00000100:00100000:0.0:1789635227.055090:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635227.055120:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427231488:0@lo:400: 00000100:00100000:0.0:1789635227.055137:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635227.055162:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789635227.055167:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876568427230848:0@lo:400: 00000100:00100000:0.0:1789635227.055186:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635227.055199:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1876568427231360:0@lo:400: 00000100:00100000:0.0:1789635227.055217:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635227.055241:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427231488 00000100:00100000:0.0:1789635227.055245:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427231488 00000100:00100000:0.0:1789635227.055270:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427230848 00000100:00100000:0.0:1789635227.055273:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427230848 00000100:00100000:0.0:1789635227.055284:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427231360 00000100:00100000:0.0:1789635227.055286:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427231360 00000100:00100000:0.0:1789635227.055303:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789635227.055309:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876568427231488:12345-0@lo:400: 00000100:00100000:0.0:1789635227.055345:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876568427231488:12345-0@lo:400: Request processed in 37us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635227.055350:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789635227.055363:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789635227.055369:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876568427230848:12345-0@lo:400: 00000100:00100000:0.0:1789635227.055394:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876568427230848:12345-0@lo:400: Request processed in 26us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635227.055401:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789635227.055411:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789635227.055416:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876568427231360:12345-0@lo:400: 00000100:00100000:0.0:1789635227.055438:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876568427231360:12345-0@lo:400: Request processed in 23us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635227.055444:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1789635227.055466:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0546df0e00 x1876568427230848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635227.055486:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876568427230848:0@lo:400: 00010000:00080000:0.0:1789635227.055498:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d05759caa00 x1876568427231360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635227.055505:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1876568427231360:0@lo:400: 00010000:00080000:0.0:1789635227.055513:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d05759cad80 x1876568427231488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635227.055520:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427231488:0@lo:400: 00000100:00100000:1.0:1789635227.055649:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427230976 00000100:00100000:1.0:1789635227.055655:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427230976 00000100:00100000:1.0:1789635227.055688:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789635227.055694:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427230976:12345-0@lo:400: 00000100:00100000:1.0:1789635227.055729:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427230976:12345-0@lo:400: Request processed in 36us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635227.055735:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1789635227.055752:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789635227.055755:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789635227.055771:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427230976:0@lo:400: 00000100:00100000:2.0:1789635227.056153:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427230720 00000100:00100000:2.0:1789635227.056158:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427230720 00000100:00100000:2.0:1789635227.056198:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789635227.056206:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054645bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+21:3641:x1876568427230720:12345-0@lo:400: 00000100:00100000:2.0:1789635227.056331:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054645bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+21:3641:x1876568427230720:12345-0@lo:400: Request processed in 126us (2347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635227.056337:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789635227.056736:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427230720:0@lo:400: 00000100:00100000:3.0:1789635227.565472:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427231744:0@lo:13: 00000100:00100000:3.0:1789635227.565549:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635227.565742:0:8860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d057b59a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8860:1876568427231872:0@lo:5: 00000100:00100000:1.0:1789635227.565771:0:8860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635227.565789:0:8860:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0565a289c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635227.565809:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427231872 00000100:00100000:1.0:1789635227.565817:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427231872 00000100:00100000:1.0:1789635227.565866:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789635227.565875:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8860:x1876568427231872:12345-0@lo:5: 00002000:00080000:1.0:1789635227.565922:0:8432:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1789635227.569039:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8860:x1876568427231872:12345-0@lo:5: Request processed in 3158us (3260us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789635227.569107:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789635227.569112:0:8860:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d057b59a680 x1876568427231872/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789635243 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635227.569129:0:8860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d057b59a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8860:1876568427231872:0@lo:5: 00000004:00080000:0.0:1789635227.569143:0:8860:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1789635227.569183:0:8860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8860:1876568427232000:0@lo:900: 00000100:00100000:0.0:1789635227.569219:0:8860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635227.569253:0:8860:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549c0f000 going to sleep for 11 seconds 00000100:00100000:3.0:1789635227.569454:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427231744 00000100:00100000:3.0:1789635227.569461:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427231744 00000100:00100000:3.0:1789635227.569496:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789635227.569505:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1876568427231744:12345-0@lo:13: 00000100:00100000:1.0:1789635227.569551:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427232000 00000100:00100000:1.0:1789635227.569555:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427232000 00000100:00100000:1.0:1789635227.569589:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00002000:00000024:3.0:1789635227.569590:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789635227.569622:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8860:x1876568427232000:12345-0@lo:900: 00000100:00100000:1.0:1789635227.569663:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8860:x1876568427232000:12345-0@lo:900: Request processed in 68us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635227.569670:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789635227.569699:0:8860:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d05759d0e00 x1876568427232000/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789635243 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635227.569709:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1876568427231744:12345-0@lo:13: Request processed in 206us (4160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635227.569710:0:8860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8860:1876568427232000:0@lo:900: 00000100:00100000:3.0:1789635227.569715:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789635227.572388:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d04459ded80 x1876568427231744/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635227.572416:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427231744:0@lo:13: 00010000:00010000:1.0:1789635227.683862:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635228.708193:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635229.091991:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d057b598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427232128:0@lo:41: 00000100:00100000:3.0:1789635229.092215:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635229.092386:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427232128 00000100:00100000:2.0:1789635229.092397:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427232128 00000100:00100000:2.0:1789635229.092460:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789635229.092471:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427232128:12345-0@lo:41: 00000004:00000024:2.0:1789635229.092524:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1789635229.092739:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427232128:12345-0@lo:41: Request processed in 269us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635229.092748:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789635229.092879:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575adb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427232256:0@lo:41: 00000100:00100000:2.0:1789635229.092913:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635229.093168:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d057b598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427232128:0@lo:41: 00000100:00100000:1.0:1789635229.093269:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427232256 00000100:00100000:1.0:1789635229.093275:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427232256 00000100:00100000:1.0:1789635229.093347:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789635229.093358:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427232256:12345-0@lo:41: 00000004:00000024:1.0:1789635229.093385:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1789635229.093441:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427232256:12345-0@lo:41: Request processed in 86us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635229.093448:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789635229.093505:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575adb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427232256:0@lo:41: 00010000:00010000:3.0:1789635229.732189:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635230.756993:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789635231.155325:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:3.0:1789635231.779773:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635232.164211:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427232384:0@lo:13: 00000100:00100000:0.0:1789635232.164300:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635232.164419:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427232384 00000100:00100000:1.0:1789635232.164428:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427232384 00000100:00100000:1.0:1789635232.164500:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789635232.164511:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427232384:12345-0@lo:13: 00002000:00000024:1.0:1789635232.164541:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789635232.164591:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427232384:12345-0@lo:13: Request processed in 82us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635232.164623:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789635232.164900:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789635232.164956:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0575ad8e00 x1876568427232384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635232.164976:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427232384:0@lo:13: 00000100:00100000:0.0:1789635232.171490:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876568427232640:0@lo:400: 00000100:00100000:0.0:1789635232.171580:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635232.171641:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05446f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1876568427233152:0@lo:400: 00000100:00100000:0.0:1789635232.171665:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635232.171699:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789635232.171706:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427232768:0@lo:400: 00000100:00100000:0.0:1789635232.171730:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635232.171752:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427233280:0@lo:400: 00000100:00100000:0.0:1789635232.171775:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635232.171811:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427232640 00000100:00100000:0.0:1789635232.171818:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427232640 00000100:00100000:0.0:1789635232.171857:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427233152 00000100:00100000:0.0:1789635232.171861:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427233152 00000100:00100000:0.0:1789635232.171885:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427233280 00000100:00100000:0.0:1789635232.171888:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427233280 00000100:00100000:0.0:1789635232.171904:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789635232.171913:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876568427232640:12345-0@lo:400: 00000100:00100000:0.0:1789635232.171987:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876568427232640:12345-0@lo:400: Request processed in 74us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635232.171994:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789635232.172013:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789635232.172020:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876568427233152:12345-0@lo:400: 00000100:00100000:0.0:1789635232.172052:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876568427233152:12345-0@lo:400: Request processed in 33us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635232.172058:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789635232.172073:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789635232.172081:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427233280:12345-0@lo:400: 00000100:00100000:0.0:1789635232.172108:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427233280:12345-0@lo:400: Request processed in 28us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635232.172121:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789635232.172143:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427232768 00000100:00100000:0.0:1789635232.172147:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427232768 00000100:00100000:0.0:1789635232.172172:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789635232.172179:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427232768:12345-0@lo:400: 00000100:00100000:0.0:1789635232.172217:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427232768:12345-0@lo:400: Request processed in 38us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635232.172223:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1789635232.172243:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789635232.172248:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635232.172272:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427232768:0@lo:400: 00010000:00080000:0.0:1789635232.172288:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d05446f7480 x1876568427233280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635232.172298:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427233280:0@lo:400: 00010000:00080000:0.0:1789635232.172311:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d05759d2680 x1876568427232640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635232.172318:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876568427232640:0@lo:400: 00010000:00080000:0.0:1789635232.172327:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d05446f6d80 x1876568427233152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635232.172334:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05446f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1876568427233152:0@lo:400: 00000100:00100000:1.0:1789635232.172460:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427232896:0@lo:400: 00000100:00100000:1.0:1789635232.172506:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635232.172547:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05446f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427233408:0@lo:400: 00000100:00100000:1.0:1789635232.172578:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635232.172622:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789635232.172629:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427232512:0@lo:400: 00000100:00100000:1.0:1789635232.172657:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635232.172683:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427233024:0@lo:400: 00000100:00100000:1.0:1789635232.172707:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635232.172826:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427232896 00000100:00100000:0.0:1789635232.172832:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427232896 00000100:00100000:0.0:1789635232.172870:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789635232.172878:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427232896:12345-0@lo:400: 00000100:00100000:0.0:1789635232.173042:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427232896:12345-0@lo:400: Request processed in 164us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635232.173050:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789635232.173070:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427233408 00000100:00100000:0.0:1789635232.173074:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427233408 00000100:00100000:0.0:1789635232.173118:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789635232.173125:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427233408:12345-0@lo:400: 00000100:00100000:0.0:1789635232.173159:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427233408:12345-0@lo:400: Request processed in 35us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635232.173165:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789635232.173184:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427233024 00000100:00100000:0.0:1789635232.173187:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427233024 00000100:00100000:0.0:1789635232.173211:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789635232.173218:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575adb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427233024:12345-0@lo:400: 00000100:00100000:0.0:1789635232.173253:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575adb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427233024:12345-0@lo:400: Request processed in 35us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635232.173260:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1789635232.173297:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0546df0e00 x1876568427233024/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635232.173310:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427233024:0@lo:400: 00000100:00100000:0.0:1789635232.173321:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427232896:0@lo:400: 00010000:00080000:0.0:1789635232.173332:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d05446f5500 x1876568427233408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635232.173339:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1789635232.173351:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05446f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427233408:0@lo:400: 00000100:00080000:1.0:1789635232.173415:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789635232.177312:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427232512 00000100:00100000:2.0:1789635232.177328:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427232512 00000100:00100000:2.0:1789635232.177438:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789635232.177448:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546459450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+21:3640:x1876568427232512:12345-0@lo:400: 00000100:00100000:2.0:1789635232.177535:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546459450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+21:3640:x1876568427232512:12345-0@lo:400: Request processed in 89us (4877us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635232.177541:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789635232.177608:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427232512:0@lo:400: 00000100:00100000:0.0:1789635232.677947:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0446c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427233536:0@lo:13: 00000100:00100000:0.0:1789635232.678017:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635232.678082:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427233536 00000100:00100000:0.0:1789635232.678089:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427233536 00000100:00100000:0.0:1789635232.678135:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789635232.678145:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427233536:12345-0@lo:13: 00002000:00000024:0.0:1789635232.678168:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635232.678218:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427233536:12345-0@lo:13: Request processed in 75us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635232.678225:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789635232.678268:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0446c3d500 x1876568427233536/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635232.678287:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0446c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427233536:0@lo:13: 00010000:00010000:2.0:1789635232.803760:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635233.827758:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635234.212731:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427233664:0@lo:41: 00000100:00100000:2.0:1789635234.212796:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635234.212898:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427233664 00000100:00100000:3.0:1789635234.212907:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427233664 00000100:00100000:0.0:1789635234.212940:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0446c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427233792:0@lo:41: 00000100:00100000:3.0:1789635234.212957:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789635234.212965:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427233664:12345-0@lo:41: 00000100:00100000:0.0:1789635234.212977:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635234.214441:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427233792 00000100:00100000:2.0:1789635234.214452:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427233792 00000100:00100000:2.0:1789635234.214486:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789635234.214495:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427233792:12345-0@lo:41: 00000004:00000024:2.0:1789635234.214523:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1789635234.214583:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427233792:12345-0@lo:41: Request processed in 90us (1615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635234.214590:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789635234.214655:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0446c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427233792:0@lo:41: 00000004:00000024:3.0:1789635234.214978:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1789635234.215029:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427233664:12345-0@lo:41: Request processed in 2064us (2232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635234.215037:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789635234.215168:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427233664:0@lo:41: 00000020:01000004:2.0:1789635234.311489:0:9507:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789635234.311493:0:9507:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789635234.311495:0:9507:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789635234.311813:0:9507:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d0577690000 00000020:01000004:2.0:1789635234.311828:0:9507:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789635234.311841:0:9507:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789635234.311854:0:9507:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d0579bd8000) 00000020:00000080:2.0:1789635234.311869:0:9507:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789635234.354361:0:9507:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789635234.354416:0:9507:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1789635234.392324:0:9507:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789635234.392535:0:9507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789635234.392549:0:9507:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789635234.392563:0:9507:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb0c3a59caa40ed92 00000020:01000004:3.0:1789635234.392570:0:9507:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789635234.392591:0:9507:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.120@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789635234.392618:0:9507:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789635234.392625:0:9507:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789635234.392654:0:9507:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1789635234.392658:0:9507:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.120@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1789635234.447957:0:9507:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789635234.448013:0:9507:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.120@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1789635234.448017:0:9507:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789635234.448019:0:9507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789635234.448021:0:9507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789635234.448022:0:9507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789635234.448023:0:9507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789635234.448024:0:9507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789635234.448026:0:9507:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789635234.448027:0:9507:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789635234.448028:0:9507:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789635234.448030:0:9507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789635234.448031:0:9507:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789635234.448035:0:9507:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1789635234.448043:0:9507:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789635234.448044:0:9507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789635234.448045:0:9507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789635234.448046:0:9507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789635234.448047:0:9507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789635234.448048:0:9507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789635234.448049:0:9507:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789635234.448050:0:9507:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789635234.448051:0:9507:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789635234.448051:0:9507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789635234.448052:0:9507:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789635234.448077:0:9507:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789635234.448094:0:9507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0446c3f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427233920:0@lo:253: 00000100:00100000:0.0:1789635234.448156:0:9507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635234.448196:0:9507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446ce06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635234.449142:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427233920 00000100:00100000:2.0:1789635234.449153:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427233920 00000100:00100000:2.0:1789635234.449206:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789635234.449216:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546459050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+21:9507:x1876568427233920:12345-0@lo:253: 20000000:01000000:2.0:1789635234.449260:0:6509:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789635234.449264:0:6509:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1789635234.449269:0:6509:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1789635234.449272:0:6509:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1789635234.449658:0:6509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789635234.449802:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:2.0:1789635234.449815:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1789635234.449830:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:2.0:1789635234.449835:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1789635234.449846:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:2.0:1789635234.449860:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:2.0:1789635234.449951:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:2.0:1789635234.449965:0:6509:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.120@tcp 20000000:01000000:2.0:1789635234.449967:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.120@tcp (null) (null) (null) 00000040:00080000:2.0:1789635234.449979:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:2.0:1789635234.449984:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789635234.450007:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:2.0:1789635234.450013:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.120@tcp (null) (null) 00000040:00080000:2.0:1789635234.450025:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:2.0:1789635234.450031:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789635234.450041:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:2.0:1789635234.450054:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:2.0:1789635234.450117:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:2.0:1789635234.450127:0:6509:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.120@tcp 20000000:01000000:2.0:1789635234.450129:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.120@tcp (null) (null) (null) 00000040:00080000:2.0:1789635234.450141:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:2.0:1789635234.450145:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789635234.450156:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:2.0:1789635234.450161:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.120@tcp (null) (null) 00000040:00080000:2.0:1789635234.450171:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:2.0:1789635234.450176:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789635234.450185:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:2.0:1789635234.450196:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:2.0:1789635234.453025:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:2.0:1789635234.453053:0:6509:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.120@tcp 20000000:01000000:2.0:1789635234.453055:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.120@tcp (null) (null) (null) 00000040:00080000:2.0:1789635234.453072:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:2.0:1789635234.453079:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789635234.453091:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:2.0:1789635234.453096:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.120@tcp (null) (null) 00000040:00080000:2.0:1789635234.453110:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:2.0:1789635234.453117:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789635234.453131:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:2.0:1789635234.453146:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:2.0:1789635234.453161:0:6509:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789635234.453163:0:6509:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789635234.453180:0:6509:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789635234.453227:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789635234.453230:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789635234.454878:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1789635234.454958:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1789635234.454979:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:2.0:1789635234.456742:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:2.0:1789635234.456777:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:2.0:1789635234.456795:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:2.0:1789635234.456807:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789635234.456809:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789635234.457223:0:9514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1789635234.457254:0:9514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1789635234.457267:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1789635234.457436:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1789635234.457457:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:2.0:1789635234.457471:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:2.0:1789635234.457480:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789635234.457482:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789635234.459031:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1789635234.459069:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1789635234.459083:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:2.0:1789635234.459263:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:2.0:1789635234.459286:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:2.0:1789635234.459302:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:2.0:1789635234.459312:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789635234.459314:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789635234.459668:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1789635234.459821:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1789635234.459843:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1789635234.459860:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:2.0:1789635234.459868:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1789635234.459870:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789635234.460753:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:0.0:1789635234.460780:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:0.0:1789635234.460795:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:1.0:1789635234.463675:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:1.0:1789635234.463876:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:1.0:1789635234.463897:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 10000000:01000000:1.0:1789635234.463930:0:6509:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789635234.463952:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d0540031800/0xb0c3a59caa40ed99 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.463970:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d054139c400/0xb0c3a59caa40ec8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ec88 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.463979:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d054139c600/0xb0c3a59caa40ecb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ecb2 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.463986:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0540031c00/0xb0c3a59caa40ecf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ecf1 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.463993:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0540030200/0xb0c3a59caa40ed14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ed0d expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.464000:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40ed3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ed37 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.464023:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d054139c200/0xb0c3a59caa40ed5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ed53 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.464030:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40ed7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ed76 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.464038:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d0540031800/0xb0c3a59caa40ed99 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.464079:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40ed7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40ed76 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.464094:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40ed7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40ed76 expref: 21 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635234.464109:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad9f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6509:1876568427234048:0@lo:104: 00000100:00100000:1.0:1789635234.464171:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789635234.464222:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d054139c200/0xb0c3a59caa40ed5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40ed53 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.464230:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d054139c200/0xb0c3a59caa40ed5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40ed53 expref: 21 pid: 6506 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635234.464238:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575adad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6509:1876568427234176:0@lo:104: 00000100:00100000:1.0:1789635234.464261:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789635234.464293:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40ed3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40ed37 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.464301:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40ed3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40ed37 expref: 21 pid: 6506 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635234.464420:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575adb100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6509:1876568427234304:0@lo:104: 00000100:00100000:1.0:1789635234.464629:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789635234.464674:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0540030200/0xb0c3a59caa40ed14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40ed0d expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.464684:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d0540030200/0xb0c3a59caa40ed14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40ed0d expref: 21 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635234.464850:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ada300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6509:1876568427234432:0@lo:104: 00000100:00100000:1.0:1789635234.464876:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789635234.464896:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0540031c00/0xb0c3a59caa40ecf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40ecf1 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.464905:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d0540031c00/0xb0c3a59caa40ecf8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40ecf1 expref: 21 pid: 6506 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635234.464925:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ada680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6509:1876568427234560:0@lo:104: 00000100:00100000:1.0:1789635234.464948:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789635234.464968:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d054139c600/0xb0c3a59caa40ecb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40ecb2 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.464977:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d054139c600/0xb0c3a59caa40ecb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40ecb2 expref: 21 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635234.464984:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427234048 00000100:00100000:1.0:1789635234.464988:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6509:1876568427234688:0@lo:104: 00000100:00100000:2.0:1789635234.464994:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427234048 00000100:00100000:1.0:1789635234.465015:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789635234.465037:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d054139c400/0xb0c3a59caa40ec8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40ec88 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635234.465045:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789635234.465058:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427234176 00010000:00010000:1.0:1789635234.465061:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d054139c400/0xb0c3a59caa40ec8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40ec88 expref: 21 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635234.465063:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427234176 00000100:00100000:1.0:1789635234.465075:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad8700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6509:1876568427234816:0@lo:104: 00000100:00100000:2.0:1789635234.465079:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427234304 00000100:00100000:2.0:1789635234.465083:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427234304 00000100:00100000:2.0:1789635234.465097:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427234432 00000100:00100000:2.0:1789635234.465100:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427234432 00000100:00100000:1.0:1789635234.465106:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635234.465113:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427234560 00000100:00100000:2.0:1789635234.465117:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427234560 00000100:00100000:1.0:1789635234.465121:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0441455c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789635234.465140:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427234688 00000100:00100000:2.0:1789635234.465145:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427234688 00000100:00100000:2.0:1789635234.465155:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427234816 00000100:00100000:2.0:1789635234.465157:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427234816 00000100:00100000:2.0:1789635234.465170:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789635234.465178:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575adaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+9:6509:x1876568427234048:12345-0@lo:104: 00010000:00010000:2.0:1789635234.465190:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d054139cc00/0xb0c3a59caa40ed76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ed7d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.465251:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789635234.465257:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575adaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+9:6509:x1876568427234048:12345-0@lo:104: Request processed in 80us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635234.465264:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789635234.465279:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789635234.465285:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+8:6509:x1876568427234176:12345-0@lo:104: 00010000:00010000:2.0:1789635234.465292:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d054139d000/0xb0c3a59caa40ed53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ed5a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.465323:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789635234.465327:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+8:6509:x1876568427234176:12345-0@lo:104: Request processed in 43us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635234.465333:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789635234.465342:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789635234.465347:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+7:6509:x1876568427234304:12345-0@lo:104: 00010000:00010000:2.0:1789635234.465354:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8c00/0xb0c3a59caa40ed37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ed3e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.465381:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789635234.465392:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+7:6509:x1876568427234304:12345-0@lo:104: Request processed in 44us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635234.465398:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789635234.465413:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789635234.465421:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+6:6509:x1876568427234432:12345-0@lo:104: 00010000:00010000:2.0:1789635234.465428:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9600/0xb0c3a59caa40ed0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ed14 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635234.465490:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789635234.465497:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d054139cc00/0xb0c3a59caa40ed76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ed7d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635234.465503:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad9f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6509:1876568427234048:0@lo:104: 00010000:00010000:3.0:1789635234.465506:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d054139cc00 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:3.0:1789635234.465512:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d054139cc00/0xb0c3a59caa40ed76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40ed7d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635234.465521:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d054139cc00/0xb0c3a59caa40ed76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40ed7d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789635234.465534:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d054139cc00/0xb0c3a59caa40ed76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40ed7d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635234.465540:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789635234.465569:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d054139cc00/0xb0c3a59caa40ed76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ed7d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635234.465575:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789635234.465591:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d054139cc00/0xb0c3a59caa40ed76 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ed7d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635234.465611:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d054139cc00/0xb0c3a59caa40ed76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ed7d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635234.465624:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789635234.465628:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d054139d000/0xb0c3a59caa40ed53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ed5a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635234.465633:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d054139d000 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:3.0:1789635234.465637:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d054139d000/0xb0c3a59caa40ed53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40ed5a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635234.465644:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d054139d000/0xb0c3a59caa40ed53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40ed5a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789635234.465651:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d054139d000/0xb0c3a59caa40ed53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40ed5a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635234.465656:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789635234.465741:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635234.465746:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8c00/0xb0c3a59caa40ed37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ed3e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635234.465752:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056f6e8c00 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:0.0:1789635234.465761:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8c00/0xb0c3a59caa40ed37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40ed3e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635234.465767:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8c00/0xb0c3a59caa40ed37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40ed3e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789635234.465773:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8c00/0xb0c3a59caa40ed37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40ed3e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635234.465777:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789635234.465791:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8c00/0xb0c3a59caa40ed37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ed3e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635234.465796:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789635234.465801:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8c00/0xb0c3a59caa40ed37 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ed3e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635234.465807:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8c00/0xb0c3a59caa40ed37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ed3e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635234.465815:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635234.465816:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635234.465818:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635234.465885:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d054139d000/0xb0c3a59caa40ed53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ed5a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635234.465891:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789635234.465906:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d054139d000/0xb0c3a59caa40ed53 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ed5a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635234.465924:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d054139d000/0xb0c3a59caa40ed53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ed5a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635234.465934:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635234.465936:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635234.465937:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635234.465956:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427234944:0@lo:103: 00010000:00010000:2.0:1789635234.469166:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789635234.469182:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+6:6509:x1876568427234432:12345-0@lo:104: Request processed in 3758us (4301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635234.469193:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789635234.469229:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789635234.469240:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+5:6509:x1876568427234560:12345-0@lo:104: 00010000:00010000:2.0:1789635234.469256:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d054139d200/0xb0c3a59caa40ecf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ecf8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.469307:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789635234.469313:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+5:6509:x1876568427234560:12345-0@lo:104: Request processed in 77us (4365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635234.469319:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789635234.469332:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789635234.469338:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459f1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+4:6509:x1876568427234688:12345-0@lo:104: 00010000:00010000:2.0:1789635234.469346:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8200/0xb0c3a59caa40ecb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ecb9 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.469373:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789635234.469390:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459f1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+4:6509:x1876568427234688:12345-0@lo:104: Request processed in 53us (4375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635234.469396:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789635234.469426:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789635234.469433:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+3:6509:x1876568427234816:12345-0@lo:104: 00010000:00010000:2.0:1789635234.469442:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8e00/0xb0c3a59caa40ec88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ec8f expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.469469:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789635234.469474:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+3:6509:x1876568427234816:12345-0@lo:104: Request processed in 42us (4370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635234.469479:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1789635234.469513:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789635234.469520:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9600/0xb0c3a59caa40ed0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ed14 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.469528:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056f6e9600 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:2.0:1789635234.469532:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9600/0xb0c3a59caa40ed0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40ed14 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.469540:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9600/0xb0c3a59caa40ed0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40ed14 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789635234.469547:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9600/0xb0c3a59caa40ed0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40ed14 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635234.469554:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789635234.469588:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9600/0xb0c3a59caa40ed0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ed14 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.469623:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789635234.469635:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9600/0xb0c3a59caa40ed0d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ed14 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.469641:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9600/0xb0c3a59caa40ed0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ed14 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.469653:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789635234.469657:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d054139d200/0xb0c3a59caa40ecf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ecf8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.469662:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d054139d200 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:2.0:1789635234.469666:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d054139d200/0xb0c3a59caa40ecf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40ecf8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.469672:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d054139d200/0xb0c3a59caa40ecf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40ecf8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789635234.469678:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d054139d200/0xb0c3a59caa40ecf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40ecf8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635234.469683:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789635234.469697:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d054139d200/0xb0c3a59caa40ecf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ecf8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.469702:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789635234.469707:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d054139d200/0xb0c3a59caa40ecf1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ecf8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.469712:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d054139d200/0xb0c3a59caa40ecf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ecf8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.469727:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789635234.469730:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8200/0xb0c3a59caa40ecb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ecb9 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.469736:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056f6e8200 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:2.0:1789635234.469739:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8200/0xb0c3a59caa40ecb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40ecb9 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.469746:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8200/0xb0c3a59caa40ecb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40ecb9 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789635234.469752:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8200/0xb0c3a59caa40ecb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40ecb9 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635234.469757:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789635234.469769:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8200/0xb0c3a59caa40ecb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ecb9 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.469774:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789635234.469779:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8200/0xb0c3a59caa40ecb2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ecb9 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.469785:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8200/0xb0c3a59caa40ecb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ecb9 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.469793:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635234.469796:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8e00/0xb0c3a59caa40ec88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ec8f expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.469811:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056f6e8e00 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:2.0:1789635234.469814:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8e00/0xb0c3a59caa40ec88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40ec8f expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.469820:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8e00/0xb0c3a59caa40ec88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40ec8f expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789635234.469826:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8e00/0xb0c3a59caa40ec88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40ec8f expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635234.469831:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789635234.469843:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8e00/0xb0c3a59caa40ec88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ec8f expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.469848:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789635234.469853:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8e00/0xb0c3a59caa40ec88 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ec8f expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.469858:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8e00/0xb0c3a59caa40ec88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ec8f expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.469870:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635234.469872:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635234.469874:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635234.470019:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635234.470448:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575adad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6509:1876568427234176:0@lo:104: 00000100:00100000:1.0:1789635234.470464:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575adb100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6509:1876568427234304:0@lo:104: 00000100:00100000:1.0:1789635234.470473:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ada300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6509:1876568427234432:0@lo:104: 00000100:00100000:1.0:1789635234.470480:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ada680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6509:1876568427234560:0@lo:104: 00000100:00100000:1.0:1789635234.470488:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6509:1876568427234688:0@lo:104: 00000100:00100000:1.0:1789635234.470495:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad8700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6509:1876568427234816:0@lo:104: 00010000:00010000:1.0:1789635234.470525:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d0540031800/0xb0c3a59caa40ed99 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635234.471260:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427235328:0@lo:103: 00000100:00100000:0.0:1789635234.471316:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635234.471373:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789635234.471380:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427235200:0@lo:103: 00000100:00100000:0.0:1789635234.471401:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635234.471417:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427235712:0@lo:103: 00000100:00100000:0.0:1789635234.471452:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635234.471480:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0446c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427235072:0@lo:103: 00000100:00100000:0.0:1789635234.471516:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635234.471533:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427235584:0@lo:103: 00000100:00100000:0.0:1789635234.471552:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635234.471565:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789635234.471571:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427235456:0@lo:103: 00000100:00100000:0.0:1789635234.471589:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635234.471786:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427235328 00000100:00100000:1.0:1789635234.471794:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427235328 00010000:00010000:1.0:1789635234.471821:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0540030200/0xb0c3a59caa40ed14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ed0d expref: 22 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635234.471841:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427235200 00000100:00100000:1.0:1789635234.471844:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427235200 00010000:00010000:1.0:1789635234.471856:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d054139c200/0xb0c3a59caa40ed5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ed53 expref: 23 pid: 6506 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635234.471866:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427235712 00000100:00100000:1.0:1789635234.471875:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427235712 00010000:00010000:1.0:1789635234.471889:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d054139c400/0xb0c3a59caa40ec8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ec88 expref: 24 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635234.471901:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427235072 00000100:00100000:1.0:1789635234.471903:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427235072 00010000:00010000:1.0:1789635234.471927:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40ed3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ed37 expref: 25 pid: 6506 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635234.471938:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427235584 00000100:00100000:1.0:1789635234.471940:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427235584 00010000:00010000:1.0:1789635234.471950:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d054139c600/0xb0c3a59caa40ecb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ecb2 expref: 26 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635234.471960:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427235456 00000100:00100000:1.0:1789635234.471962:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427235456 00010000:00010000:1.0:1789635234.471971:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0540031c00/0xb0c3a59caa40ecf8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ecf1 expref: 27 pid: 6506 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635234.471983:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789635234.471990:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+27:3643:x1876568427235328:12345-0@lo:103: 00010000:00010000:1.0:1789635234.472003:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635234.472008:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0540030200/0xb0c3a59caa40ed14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ed0d expref: 27 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.472018:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0540030200/0xb0c3a59caa40ed14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40ed0d expref: 27 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.472035:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0540030200/0xb0c3a59caa40ed14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40ed0d expref: 27 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.472050:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635234.472100:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+26:3643:x1876568427235328:12345-0@lo:103: Request processed in 110us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635234.472108:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789635234.472124:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789635234.472131:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+25:3643:x1876568427235200:12345-0@lo:103: 00010000:00010000:1.0:1789635234.472138:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635234.472142:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d054139c200/0xb0c3a59caa40ed5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ed53 expref: 25 pid: 6506 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.472151:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d054139c200/0xb0c3a59caa40ed5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40ed53 expref: 25 pid: 6506 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.472161:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d054139c200/0xb0c3a59caa40ed5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40ed53 expref: 25 pid: 6506 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.472170:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635234.472192:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3643:x1876568427235200:12345-0@lo:103: Request processed in 62us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635234.472197:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789635234.472210:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789635234.472216:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+23:3643:x1876568427235712:12345-0@lo:103: 00010000:00010000:1.0:1789635234.472222:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635234.472226:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d054139c400/0xb0c3a59caa40ec8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ec88 expref: 23 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.472234:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d054139c400/0xb0c3a59caa40ec8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40ec88 expref: 23 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.472243:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d054139c400/0xb0c3a59caa40ec8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40ec88 expref: 23 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.472257:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635234.472280:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+22:3643:x1876568427235712:12345-0@lo:103: Request processed in 64us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635234.472285:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789635234.472297:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789635234.472302:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b404c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+21:3641:x1876568427235072:12345-0@lo:103: 00010000:00010000:1.0:1789635234.472309:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635234.472313:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40ed3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ed37 expref: 21 pid: 6506 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.472320:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40ed3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40ed37 expref: 21 pid: 6506 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.472329:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40ed3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40ed37 expref: 21 pid: 6506 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.472337:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635234.472406:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b404c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+20:3641:x1876568427235072:12345-0@lo:103: Request processed in 104us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635234.472414:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789635234.472446:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789635234.472452:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+19:3641:x1876568427235584:12345-0@lo:103: 00010000:00010000:1.0:1789635234.472458:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635234.472462:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d054139c600/0xb0c3a59caa40ecb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ecb2 expref: 19 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.472469:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d054139c600/0xb0c3a59caa40ecb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40ecb2 expref: 19 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.472484:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d054139c600/0xb0c3a59caa40ecb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40ecb2 expref: 19 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.472492:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635234.472584:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+18:3641:x1876568427235584:12345-0@lo:103: Request processed in 132us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635234.472591:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789635234.472632:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789635234.472639:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+17:3641:x1876568427235456:12345-0@lo:103: 00010000:00010000:1.0:1789635234.472647:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635234.472651:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0540031c00/0xb0c3a59caa40ecf8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ecf1 expref: 17 pid: 6506 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.472659:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0540031c00/0xb0c3a59caa40ecf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40ecf1 expref: 17 pid: 6506 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.472669:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0540031c00/0xb0c3a59caa40ecf8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40ecf1 expref: 17 pid: 6506 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.472677:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635234.472700:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+16:3641:x1876568427235456:12345-0@lo:103: Request processed in 62us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635234.472706:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789635234.472794:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427235200:0@lo:103: 00000100:00100000:0.0:1789635234.472804:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427235712:0@lo:103: 00000100:00100000:0.0:1789635234.472812:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427235328:0@lo:103: 00010000:00010000:3.0:1789635234.472881:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635234.472944:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635234.473051:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427234944 00000100:00100000:1.0:1789635234.473056:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427234944 00010000:00010000:1.0:1789635234.473072:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40ed7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ed76 expref: 16 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635234.473098:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789635234.473113:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+16:3640:x1876568427234944:12345-0@lo:103: 00010000:00010000:1.0:1789635234.473121:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635234.473126:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40ed7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ed76 expref: 16 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.473137:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40ed7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40ed76 expref: 16 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.473148:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40ed7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40ed76 expref: 16 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.473159:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d0540031800/0xb0c3a59caa40ed99 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.473167:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0540031800/0xb0c3a59caa40ed99 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.473182:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d0540031800/0xb0c3a59caa40ed99 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.473189:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d0540031800/0xb0c3a59caa40ed99 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.473196:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d0540031800/0xb0c3a59caa40ed99 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.473204:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d0540031800/0xb0c3a59caa40ed99 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.473210:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540031800 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:1.0:1789635234.473215:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d0540031800/0xb0c3a59caa40ed99 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.473229:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d0540031800/0xb0c3a59caa40ed99 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.473251:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d0540031800/0xb0c3a59caa40ed99 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.473262:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635234.473290:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+15:3640:x1876568427234944:12345-0@lo:103: Request processed in 178us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635234.473296:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1789635234.473344:0:6509:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d0540031800/0xb0c3a59caa40ed99 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635234.473352:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d0540031800/0xb0c3a59caa40ed99 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635234.473358:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0540031800/0xb0c3a59caa40ed99 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789635234.473371:0:6509:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789635234.473442:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427234944:0@lo:103: 00000100:00100000:2.0:1789635234.477670:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0446c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427235072:0@lo:103: 00000100:00100000:2.0:1789635234.477688:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427235584:0@lo:103: 00000100:00100000:2.0:1789635234.477716:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427235456:0@lo:103: 00000100:00100000:2.0:1789635234.483025:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546459050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+14:9507:x1876568427233920:12345-0@lo:253: Request processed in 33802us (34859us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635234.483039:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789635234.483170:0:9507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0446c3f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427233920:0@lo:253: 10000000:01000000:3.0:1789635234.483183:0:9507:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789635234.483186:0:9507:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789635234.483188:0:9507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789635234.483189:0:9507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789635234.483190:0:9507:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1789635234.483192:0:9507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789635234.483193:0:9507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789635234.483194:0:9507:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789635234.483195:0:9507:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789635234.483196:0:9507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789635234.483198:0:9507:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789635234.483250:0:9507:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d0577690000 from lustre-OST0001 10000000:01000000:3.0:1789635234.483278:0:9507:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789635234.483280:0:9507:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789635234.483297:0:9507:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d057ae4b380 local copy 10000000:01000000:3.0:1789635234.483301:0:9507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789635234.483336:0:9507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40eda0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635234.483347:0:9507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40eda0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635234.483356:0:9507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40eda0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635234.483374:0:9507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427235840:0@lo:101: 00000100:00100000:3.0:1789635234.483411:0:9507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635234.483448:0:9507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0546451c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789635234.483664:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427235840 00000100:00100000:1.0:1789635234.483671:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427235840 00000100:00100000:1.0:1789635234.483717:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789635234.483725:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054645b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+14:9507:x1876568427235840:12345-0@lo:101: 00010000:00010000:1.0:1789635234.483737:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635234.483750:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0540031c00/0xb0c3a59caa40eda7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40eda0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.483773:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0540031c00/0xb0c3a59caa40eda7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40eda0 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.483784:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0540031c00/0xb0c3a59caa40eda7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40eda0 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.483793:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0540031c00, rc 0) 00000100:00100000:1.0:1789635234.483833:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054645b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+15:9507:x1876568427235840:12345-0@lo:101: Request processed in 108us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635234.483839:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789635234.483880:0:9507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427235840:0@lo:101: 00010000:00010000:0.0:1789635234.483896:0:9507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40eda0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xb0c3a59caa40eda7 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635234.483906:0:9507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40eda0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb0c3a59caa40eda7 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635234.484029:0:9507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0446c3ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427235968:0@lo:501: 00000100:00100000:0.0:1789635234.484057:0:9507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635234.484085:0:9507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446ce0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789635234.484117:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427235968 00000100:00100000:1.0:1789635234.484123:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427235968 00000100:00100000:1.0:1789635234.484157:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789635234.484164:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054645a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+15:9507:x1876568427235968:12345-0@lo:501: 00000100:00100000:1.0:1789635234.484234:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054645a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+15:9507:x1876568427235968:12345-0@lo:501: Request processed in 70us (175us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789635234.484240:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789635234.484272:0:9507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0446c3ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427235968:0@lo:501: 10000000:01000000:0.0:1789635234.484286:0:9507:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789635234.484303:0:9507:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789635234.484308:0:9507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40eda0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb0c3a59caa40eda7 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635234.484315:0:9507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40eda0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb0c3a59caa40eda7 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635234.484333:0:9507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40eda0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb0c3a59caa40eda7 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635234.484409:0:9507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789635234.484433:0:9507:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d0577690000 10000000:01000000:0.0:1789635234.484438:0:9507:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789635234.484443:0:9507:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789635234.484445:0:9507:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789635234.484449:0:9507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1789635234.484451:0:9507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789635234.484467:0:9507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8c00/0xb0c3a59caa40edae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635234.484474:0:9507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8c00/0xb0c3a59caa40edae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635234.484492:0:9507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8c00/0xb0c3a59caa40edae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635234.484503:0:9507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0446c3ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427236096:0@lo:101: 00000100:00100000:0.0:1789635234.484529:0:9507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635234.484550:0:9507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446ce0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789635234.484659:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427236096 00000100:00100000:1.0:1789635234.484664:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427236096 00000100:00100000:1.0:1789635234.484693:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789635234.484700:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054645a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+15:9507:x1876568427236096:12345-0@lo:101: 00010000:00010000:1.0:1789635234.484708:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635234.484718:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0540030200/0xb0c3a59caa40edb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40edae expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.484734:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0540030200/0xb0c3a59caa40edb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40edae expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.484743:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0540030200/0xb0c3a59caa40edb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40edae expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.484751:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0540030200, rc 0) 00000100:00100000:1.0:1789635234.484794:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054645a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+16:9507:x1876568427236096:12345-0@lo:101: Request processed in 95us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635234.484801:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789635234.484954:0:9507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0446c3ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427236096:0@lo:101: 00010000:00010000:3.0:1789635234.484966:0:9507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8c00/0xb0c3a59caa40edae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40edb5 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635234.484974:0:9507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8c00/0xb0c3a59caa40edae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40edb5 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635234.485042:0:9507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427236224:0@lo:501: 00000100:00100000:3.0:1789635234.485069:0:9507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635234.485099:0:9507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05464513c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635234.485441:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427236224 00000100:00100000:0.0:1789635234.485448:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427236224 00000100:00100000:0.0:1789635234.485528:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789635234.485537:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0565a0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+16:9507:x1876568427236224:12345-0@lo:501: 00000100:00100000:0.0:1789635234.485662:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0565a0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+16:9507:x1876568427236224:12345-0@lo:501: Request processed in 126us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635234.485669:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789635234.485757:0:9507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427236224:0@lo:501: 00000100:00100000:3.0:1789635234.485809:0:9507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427236352:0@lo:503: 00000100:00100000:3.0:1789635234.485848:0:9507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789635234.487154:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635234.487164:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40eda0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb0c3a59caa40eda7 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.487175:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05820d3800 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:2.0:1789635234.487180:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40eda0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb0c3a59caa40eda7 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.487190:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40eda0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xb0c3a59caa40eda7 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789635234.487197:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40eda0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xb0c3a59caa40eda7 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635234.487203:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789635234.487232:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40eda0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb0c3a59caa40eda7 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.487243:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789635234.487259:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40eda0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb0c3a59caa40eda7 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.487267:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40eda0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb0c3a59caa40eda7 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.487281:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635234.487282:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635234.487292:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635234.488497:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427236352 00000100:00100000:3.0:1789635234.488545:0:9507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05464513c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635234.489876:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427236352 00000100:00100000:1.0:1789635234.490625:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789635234.490638:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0565a08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+16:9507:x1876568427236352:12345-0@lo:503: 00000100:00100000:0.0:1789635234.490687:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427236480:0@lo:103: 00000100:00100000:0.0:1789635234.490753:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635234.490888:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427236480 00000100:00100000:0.0:1789635234.490895:0:7457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427236480 00000100:00100000:1.0:1789635234.490900:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0565a08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+16:9507:x1876568427236352:12345-0@lo:503: Request processed in 263us (5047us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635234.490919:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789635234.490945:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789635234.490955:0:7457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6356ed01-c755-4f9e-b839-20feb7c3f098+16:3643:x1876568427236480:12345-0@lo:103: 00010000:00010000:0.0:1789635234.490967:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635234.490985:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0540031c00/0xb0c3a59caa40eda7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb0c3a59caa40eda0 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635234.491000:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635234.491246:0:7457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6356ed01-c755-4f9e-b839-20feb7c3f098+15:3643:x1876568427236480:12345-0@lo:103: Request processed in 292us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635234.491263:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789635234.491353:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427236480:0@lo:103: 00000100:00100000:3.0:1789635234.491659:0:9507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427236352:0@lo:503: 00000040:00080000:3.0:1789635234.491929:0:9507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789635234.492004:0:9507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427236608:0@lo:502: 00000100:00100000:3.0:1789635234.492044:0:9507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635234.492082:0:9507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05464513c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635234.493023:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427236608 00000100:00100000:0.0:1789635234.493032:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427236608 00000100:00100000:0.0:1789635234.493071:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789635234.493079:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0565a0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+15:9507:x1876568427236608:12345-0@lo:502: 00000100:00100000:0.0:1789635234.493210:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0565a0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+15:9507:x1876568427236608:12345-0@lo:502: Request processed in 131us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635234.493217:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789635234.493322:0:9507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427236608:0@lo:502: 00000040:00080000:3.0:1789635234.493517:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789635234.493544:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789635234.493556:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789635234.493566:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789635234.493576:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789635234.493586:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789635234.493639:0:9507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427236736:0@lo:502: 00000100:00100000:3.0:1789635234.493677:0:9507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635234.493711:0:9507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05464513c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635234.493976:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427236736 00000100:00100000:0.0:1789635234.493982:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427236736 00000100:00100000:0.0:1789635234.494003:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789635234.494009:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0565a09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+15:9507:x1876568427236736:12345-0@lo:502: 00000100:00100000:0.0:1789635234.494094:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0565a09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+15:9507:x1876568427236736:12345-0@lo:502: Request processed in 84us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635234.494101:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789635234.494639:0:9507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427236736:0@lo:502: 00000040:00080000:3.0:1789635234.494699:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789635234.494709:0:9507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:1.0:1789635234.496752:0:9518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789635234.496763:0:9518:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1789635234.496769:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635234.496771:0:9518:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789635234.496777:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789635234.496792:0:9518:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d04464699c0) 00000020:00000080:1.0:1789635234.497375:0:9518:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789635234.497385:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789635234.497473:0:9518:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d0577690000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789635234.497481:0:9518:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789635234.497488:0:9518:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb0c3a59caa40edc3 00010000:00010000:1.0:1789635234.507417:0:9518:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:1.0:1789635234.508566:0:9518:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1789635234.522281:0:9518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789635234.522657:0:9518:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1789635234.530570:0:9518:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1789635234.530827:0:9518:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1789635234.541417:0:9518:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1789635234.544236:0:9518:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789635234.544249:0:9518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789635234.544255:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635234.544258:0:9518:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789635234.544262:0:9518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789635234.544266:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635234.544267:0:9518:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789635234.544270:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789635234.544272:0:9518:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789635234.544295:0:9518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789635234.544299:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635234.544300:0:9518:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789635234.544303:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789635234.546835:0:9507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1789635234.546873:0:9507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789635234.546897:0:9507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8c00/0xb0c3a59caa40edae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40edb5 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635234.546919:0:9507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8c00/0xb0c3a59caa40edae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40edb5 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635234.551292:0:9507:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0577690000 from 1 10000000:01000000:3.0:1789635234.551301:0:9507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789635234.551362:0:9507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05820d3000/0xb0c3a59caa40edca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635234.551375:0:9507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d05820d3000/0xb0c3a59caa40edca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635234.551385:0:9507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d05820d3000/0xb0c3a59caa40edca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635234.551408:0:9507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427236864:0@lo:101: 00000100:00100000:3.0:1789635234.551478:0:9507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635234.551521:0:9507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05464513c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635234.552145:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427236864 00000100:00100000:0.0:1789635234.552155:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427236864 00000100:00100000:0.0:1789635234.552252:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789635234.552264:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0565a09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+15:9507:x1876568427236864:12345-0@lo:101: 00010000:00010000:0.0:1789635234.552278:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635234.552293:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40edd1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40edca expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635234.552320:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40edd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40edca expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635234.552332:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40edd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40edca expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635234.552350:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056f6e9000, rc 0) 00000100:00100000:0.0:1789635234.552407:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0565a09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+16:9507:x1876568427236864:12345-0@lo:101: Request processed in 145us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635234.552413:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789635234.552948:0:9507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427236864:0@lo:101: 00010000:00010000:1.0:1789635234.552966:0:9507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d05820d3000/0xb0c3a59caa40edca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40edd1 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.552976:0:9507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d05820d3000/0xb0c3a59caa40edca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40edd1 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635234.553175:0:9507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427236992:0@lo:501: 00000100:00100000:1.0:1789635234.553223:0:9507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635234.556187:0:9507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0441455480 going to sleep for 11 seconds 00000100:00100000:0.0:1789635234.556272:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427236992 00000100:00100000:0.0:1789635234.556281:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427236992 00000100:00100000:0.0:1789635234.556327:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789635234.556336:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0565a0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+16:9507:x1876568427236992:12345-0@lo:501: 00000100:00100000:0.0:1789635234.556582:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0565a0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+16:9507:x1876568427236992:12345-0@lo:501: Request processed in 247us (3358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635234.556590:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789635234.556869:0:9507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427236992:0@lo:501: 00000100:00100000:1.0:1789635234.556925:0:9507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427237120:0@lo:503: 00000100:00100000:1.0:1789635234.556979:0:9507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635234.557053:0:9507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0441455480 going to sleep for 11 seconds 00000100:00100000:2.0:1789635234.557990:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427237120 00000100:00100000:2.0:1789635234.557998:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427237120 00000100:00100000:0.0:1789635234.560860:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789635234.560873:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+16:9507:x1876568427237120:12345-0@lo:503: 00000100:00100000:0.0:1789635234.561046:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+16:9507:x1876568427237120:12345-0@lo:503: Request processed in 174us (4065us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635234.561054:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789635234.561267:0:9507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427237120:0@lo:503: 00000040:00080000:1.0:1789635234.561503:0:9507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789635234.561586:0:9507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427237248:0@lo:502: 00000100:00100000:1.0:1789635234.561777:0:9507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635234.561813:0:9507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0441455480 going to sleep for 11 seconds 00000100:00100000:3.0:1789635234.561868:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427237248 00000100:00100000:3.0:1789635234.561875:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427237248 00000100:00100000:3.0:1789635234.561905:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789635234.561925:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+16:9507:x1876568427237248:12345-0@lo:502: 00000100:00100000:3.0:1789635234.562059:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+16:9507:x1876568427237248:12345-0@lo:502: Request processed in 135us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635234.562066:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789635234.565779:0:9507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427237248:0@lo:502: 00000040:00080000:3.0:1789635234.568461:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789635234.568496:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789635234.568544:0:9507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427237376:0@lo:502: 00000100:00100000:3.0:1789635234.569763:0:9507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635234.569872:0:9507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0546451240 going to sleep for 11 seconds 00000100:00100000:0.0:1789635234.573227:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427237376 00000100:00100000:0.0:1789635234.573243:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427237376 00000100:00100000:0.0:1789635234.573360:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789635234.573371:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+16:9507:x1876568427237376:12345-0@lo:502: 00000100:00100000:0.0:1789635234.573557:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+16:9507:x1876568427237376:12345-0@lo:502: Request processed in 187us (3796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635234.573565:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789635234.573691:0:9507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427237376:0@lo:502: 00000040:00080000:1.0:1789635234.573771:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789635234.573783:0:9507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789635234.579372:0:9522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789635234.579385:0:9522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635234.579388:0:9522:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789635234.579396:0:9522:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d0577690000 00000020:00000080:1.0:1789635234.579400:0:9522:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789635234.579412:0:9522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789635234.579415:0:9522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635234.579416:0:9522:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789635234.579418:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789635234.579532:0:9507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789635234.579564:0:9507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789635234.579584:0:9507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05820d3000/0xb0c3a59caa40edca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40edd1 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.579618:0:9507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d05820d3000/0xb0c3a59caa40edca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40edd1 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635234.579688:0:9507:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789635234.579691:0:9507:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d0577690000 10000000:01000000:2.0:1789635234.579694:0:9507:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d0577690000 10000000:01000000:2.0:1789635234.579697:0:9507:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789635234.579702:0:9507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d0577690000 from 1 10000000:01000000:2.0:1789635234.579704:0:9507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789635234.579749:0:9507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2600/0xb0c3a59caa40edd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.579770:0:9507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2600/0xb0c3a59caa40edd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.579782:0:9507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2600/0xb0c3a59caa40edd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635234.579805:0:9507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427237504:0@lo:101: 00000100:00100000:2.0:1789635234.579864:0:9507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635234.579920:0:9507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d04410f9300 going to sleep for 11 seconds 00000100:00100000:3.0:1789635234.580156:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427237504 00000100:00100000:3.0:1789635234.580164:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427237504 00000100:00100000:3.0:1789635234.580211:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789635234.580222:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+16:9507:x1876568427237504:12345-0@lo:101: 00010000:00010000:3.0:1789635234.580235:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635234.580256:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d05820d3e00/0xb0c3a59caa40eddf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40edd8 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635234.580281:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d05820d3e00/0xb0c3a59caa40eddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40edd8 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635234.580292:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d05820d3e00/0xb0c3a59caa40eddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40edd8 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635234.580301:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05820d3e00, rc 0) 00000100:00100000:3.0:1789635234.580353:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+17:9507:x1876568427237504:12345-0@lo:101: Request processed in 133us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635234.580359:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789635234.580729:0:9507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427237504:0@lo:101: 00010000:00010000:2.0:1789635234.580745:0:9507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2600/0xb0c3a59caa40edd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40eddf expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.580755:0:9507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2600/0xb0c3a59caa40edd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40eddf expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635234.580843:0:9507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427237632:0@lo:501: 00000100:00100000:2.0:1789635234.580873:0:9507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635234.580904:0:9507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d04410f9300 going to sleep for 11 seconds 00000100:00100000:3.0:1789635234.581178:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427237632 00000100:00100000:3.0:1789635234.581184:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427237632 00000100:00100000:3.0:1789635234.581218:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789635234.581226:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+17:9507:x1876568427237632:12345-0@lo:501: 00000100:00100000:3.0:1789635234.581339:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+17:9507:x1876568427237632:12345-0@lo:501: Request processed in 112us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635234.581346:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789635234.583363:0:9507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427237632:0@lo:501: 00000100:00100000:2.0:1789635234.583421:0:9507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427237760:0@lo:503: 00000100:00100000:2.0:1789635234.583494:0:9507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635234.583527:0:9507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d04410f9300 going to sleep for 11 seconds 00000100:00100000:0.0:1789635234.583693:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427237760 00000100:00100000:0.0:1789635234.583699:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427237760 00000100:00100000:0.0:1789635234.583776:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789635234.583786:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+17:9507:x1876568427237760:12345-0@lo:503: 00000100:00100000:0.0:1789635234.583903:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+17:9507:x1876568427237760:12345-0@lo:503: Request processed in 119us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635234.583923:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789635234.584138:0:9507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427237760:0@lo:503: 00000040:00080000:2.0:1789635234.584391:0:9507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789635234.584472:0:9507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427237888:0@lo:502: 00000100:00100000:2.0:1789635234.584514:0:9507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635234.584550:0:9507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d04410f9300 going to sleep for 11 seconds 00000100:00100000:1.0:1789635234.584827:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427237888 00000100:00100000:1.0:1789635234.584834:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427237888 00000100:00100000:0.0:1789635234.585165:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789635234.585175:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+17:9507:x1876568427237888:12345-0@lo:502: 00000100:00100000:0.0:1789635234.585282:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+17:9507:x1876568427237888:12345-0@lo:502: Request processed in 108us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635234.585290:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789635234.585546:0:9507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427237888:0@lo:502: 00000040:00080000:2.0:1789635234.585779:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789635234.585807:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789635234.585822:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789635234.585835:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789635234.585847:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789635234.585859:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789635234.585871:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789635234.585882:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789635234.585894:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789635234.585905:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789635234.585932:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789635234.585945:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789635234.585973:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789635234.585988:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789635234.586220:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789635234.586243:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789635234.586258:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789635234.586272:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789635234.586287:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789635234.586300:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789635234.586314:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789635234.586328:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789635234.586356:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789635234.586368:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789635234.586380:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1789635234.586395:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1789635234.586409:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1789635234.586435:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1789635234.586463:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1789635234.586479:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1789635234.586493:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1789635234.586506:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1789635234.586520:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1789635234.586533:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1789635234.586546:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1789635234.586560:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1789635234.586573:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:2.0:1789635234.586584:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1789635234.586625:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:2.0:1789635234.586643:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:2.0:1789635234.586656:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:2.0:1789635234.586669:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:2.0:1789635234.586682:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:2.0:1789635234.586693:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:2.0:1789635234.586967:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:2.0:1789635234.586987:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:2.0:1789635234.587135:0:9507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427238016:0@lo:502: 00000100:00100000:2.0:1789635234.587201:0:9507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635234.590009:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427238016 00000100:00100000:3.0:1789635234.590022:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427238016 00000100:00100000:2.0:1789635234.590062:0:9507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d04410f9300 going to sleep for 11 seconds 00000100:00100000:0.0:1789635234.590141:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789635234.590152:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+17:9507:x1876568427238016:12345-0@lo:502: 00000100:00100000:0.0:1789635234.590303:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+17:9507:x1876568427238016:12345-0@lo:502: Request processed in 152us (3100us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635234.590311:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789635234.590415:0:9507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427238016:0@lo:502: 00000040:00080000:2.0:1789635234.590489:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:2.0:1789635234.590501:0:9507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:2.0:1789635234.591777:0:9523:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789635234.591792:0:9523:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d0579bd99c0) 00000020:00000080:2.0:1789635234.591816:0:9523:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:2.0:1789635234.591923:0:9523:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d0577690000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789635234.591927:0:9523:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d0577690000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789635234.591930:0:9523:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d0577690000 3 00010000:00080000:2.0:1789635234.591963:0:9523:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d0447569800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.120@tcp at head 00010000:00010000:1.0:1789635234.595706:0:9523:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:1.0:1789635234.595931:0:9523:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789635234.595979:0:9523:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789635234.595991:0:9523:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xb0c3a59caa40eded 00000100:00080000:1.0:1789635234.596001:0:9523:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789635234.596012:0:9523:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d0447569800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1789635234.596045:0:9523:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0575ad8700 x1876568427238144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789635234.596077:0:9523:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789635234.596651:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1876568427238144:0@lo:38: 00000100:00100000:3.0:1789635234.596715:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635234.596775:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427238144 00000100:00100000:3.0:1789635234.596783:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427238144 00000100:00100000:3.0:1789635234.596824:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789635234.596832:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1876568427238144:12345-0@lo:38: 00010000:00080000:3.0:1789635234.596857:0:6516:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 253 last 0 00000020:00000080:3.0:1789635234.596893:0:6516:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xb0c3a59caa40edf4 00000004:00100000:3.0:1789635234.596916:0:6516:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789635234.596945:0:6516:0:(import.c:65:import_set_state_nolock()) ffff8d0576048800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789635234.596995:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876568427238144:12345-0@lo:38: Request processed in 162us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635234.597002:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789635234.597044:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0575ad8700 x1876568427238144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789635244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635234.597052:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789635234.597057:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1789635234.597063:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789635234.597066:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789635234.597068:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d0447569800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789635234.597071:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1876568427238144:0@lo:38: 00000020:01000004:1.0:1789635234.597413:0:9523:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789635234.597427:0:9523:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8d044646cd40) 00000020:00000080:1.0:1789635234.597444:0:9523:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:1.0:1789635234.597532:0:9523:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d0577690000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789635234.597537:0:9523:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d0577690000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789635234.597539:0:9523:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d0577690000 3 00010000:00080000:1.0:1789635234.597567:0:9523:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d0445981000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.120@tcp at head 00000100:00100000:3.0:1789635234.599025:0:9524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e8a80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9524:1876568427238272:0@lo:901: 00000100:00100000:3.0:1789635234.599078:0:9524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635234.599108:0:9524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0546451b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789635234.599115:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427238272 00000100:00100000:2.0:1789635234.599121:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427238272 00000100:00100000:2.0:1789635234.599182:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789635234.599191:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9524:x1876568427238272:12345-0@lo:901: 00000100:00100000:0.0:1789635234.599242:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0446c3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427238528:0@lo:400: 00000100:00100000:0.0:1789635234.599273:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635234.599293:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0446c3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1876568427239040:0@lo:400: 00000100:00100000:0.0:1789635234.599314:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635234.599335:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789635234.599342:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0446c3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876568427238400:0@lo:400: 00000100:00100000:0.0:1789635234.599362:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635234.599375:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0446c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1876568427238912:0@lo:400: 00000100:00100000:0.0:1789635234.599393:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635234.599406:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0446c3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876568427238784:0@lo:400: 00000100:00100000:0.0:1789635234.599417:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0446c3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427238656:0@lo:400: 00000100:00100000:1.0:1789635234.599445:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635234.599462:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635234.599467:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0446c3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427239296:0@lo:400: 00000100:00100000:0.0:1789635234.599485:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0446c3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427239168:0@lo:400: 00000100:00100000:1.0:1789635234.599502:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635234.599520:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427238528 00000100:00080000:3.0:1789635234.599557:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635234.599564:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427239040 00000100:00100000:1.0:1789635234.599570:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427239040 00000100:00100000:3.0:1789635234.599579:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427238400 00000100:00100000:3.0:1789635234.599585:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427238400 00000100:00100000:1.0:1789635234.599626:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427238912 00000100:00100000:1.0:1789635234.599630:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427238912 00000100:00100000:2.0:1789635234.599632:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9524:x1876568427238272:12345-0@lo:901: Request processed in 351us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635234.599636:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427238784 00000100:00100000:3.0:1789635234.599640:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427238784 00000100:00100000:2.0:1789635234.599642:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789635234.599661:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789635234.599670:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876568427239040:12345-0@lo:400: 00000100:00100000:0.0:1789635234.599698:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427238528 00000100:00100000:1.0:1789635234.599726:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876568427239040:12345-0@lo:400: Request processed in 56us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635234.599734:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427238656 00000100:00100000:0.0:1789635234.599738:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427238656 00000100:00100000:0.0:1789635234.599752:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789635234.599758:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427238528:12345-0@lo:400: 00010000:00080000:2.0:1789635234.599790:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0446c3c000 x1876568427239040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635234.599802:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427238528:12345-0@lo:400: Request processed in 41us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635234.599809:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0446c3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1876568427239040:0@lo:400: 00000100:00100000:0.0:1789635234.599814:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789635234.599833:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789635234.599840:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0446c3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427238528:0@lo:400: 00000100:00100000:0.0:1789635234.599845:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05446f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427238656:12345-0@lo:400: 00000100:00100000:0.0:1789635234.599878:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05446f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427238656:12345-0@lo:400: Request processed in 39us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635234.599884:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789635234.599930:0:6515:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789635234.599936:0:6515:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789635234.600135:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789635234.600147:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789635234.600149:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876568427238400:12345-0@lo:400: 00000100:00100000:1.0:1789635234.600170:0:6514:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789635234.600180:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789635234.600189:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876568427238912:12345-0@lo:400: 00000100:00100000:3.0:1789635234.600192:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876568427238400:12345-0@lo:400: Request processed in 45us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635234.600201:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789635234.600222:0:6516:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789635234.600230:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789635234.600235:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876568427238912:12345-0@lo:400: Request processed in 47us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635234.600241:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876568427238784:12345-0@lo:400: 00000100:00100000:1.0:1789635234.600248:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789635234.600277:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427239296 00000100:00100000:1.0:1789635234.600282:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427239296 00000100:00100000:3.0:1789635234.600283:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876568427238784:12345-0@lo:400: Request processed in 44us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635234.600290:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789635234.600321:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789635234.600328:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0446c3f100 x1876568427238400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635234.600332:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427239296:12345-0@lo:400: 00000100:00100000:3.0:1789635234.600342:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0446c3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876568427238400:0@lo:400: 00010000:00080000:3.0:1789635234.600353:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0446c3ce00 x1876568427238912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635234.600361:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0446c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1876568427238912:0@lo:400: 00010000:00080000:3.0:1789635234.600385:0:9524:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d04459e8a80 x1876568427238272/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789635250 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635234.600394:0:9524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e8a80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9524:1876568427238272:0@lo:901: 00000100:00100000:1.0:1789635234.600451:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427239296:12345-0@lo:400: Request processed in 122us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635234.600458:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789635234.600485:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635234.600522:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0446c3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427238656:0@lo:400: 00010000:00080000:1.0:1789635234.600558:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0446c3f800 x1876568427238784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635234.600568:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0446c3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876568427238784:0@lo:400: 00010000:00080000:1.0:1789635234.600578:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0446c3f480 x1876568427239296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635234.600586:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0446c3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427239296:0@lo:400: 00000100:00100000:1.0:1789635234.600632:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427239168 00000100:00100000:1.0:1789635234.600636:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427239168 00000100:00100000:1.0:1789635234.600668:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789635234.600676:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ada300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427239168:12345-0@lo:400: 00000100:00100000:1.0:1789635234.600715:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ada300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427239168:12345-0@lo:400: Request processed in 40us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635234.600729:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1789635234.600750:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789635234.600754:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789635234.600756:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789635234.600775:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0446c3d880 x1876568427239168/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635234.600785:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0446c3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427239168:0@lo:400: 00010000:00010000:1.0:1789635234.601862:0:9523:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:0.0:1789635234.603863:0:9523:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1789635234.603935:0:9523:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789635234.603948:0:9523:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xb0c3a59caa40ee02 00000100:00080000:0.0:1789635234.603959:0:9523:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789635234.603970:0:9523:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8d0445981000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1789635234.604006:0:9523:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d05446f6d80 x1876568427239424/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789635234.604058:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05446f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3639:1876568427239424:0@lo:38: 00000100:00100000:3.0:1789635234.604120:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789635234.604175:0:9523:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789635234.604361:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427239424 00000100:00100000:2.0:1789635234.604368:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427239424 00000100:00100000:2.0:1789635234.604405:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789635234.604412:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1876568427239424:12345-0@lo:38: 00010000:00080000:2.0:1789635234.604438:0:6514:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 253 last 0 00000020:00000080:2.0:1789635234.605083:0:6514:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xb0c3a59caa40ee09 00000004:00100000:2.0:1789635234.605100:0:6514:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789635234.605130:0:6514:0:(import.c:65:import_set_state_nolock()) ffff8d044756f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789635234.605314:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876568427239424:12345-0@lo:38: Request processed in 901us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635234.605323:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789635234.605441:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d05446f6d80 x1876568427239424/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789635244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635234.605452:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789635234.605458:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1789635234.605464:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789635234.605469:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789635234.605471:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d0445981000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789635234.605476:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05446f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3639:1876568427239424:0@lo:38: 00000040:00080000:1.0:1789635234.607177:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:1.0:1789635234.607251:0:9507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:1.0:1789635234.607279:0:9507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789635234.607297:0:9507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2600/0xb0c3a59caa40edd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40eddf expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.607308:0:9507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2600/0xb0c3a59caa40edd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40eddf expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789635234.607366:0:9507:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789635234.607369:0:9507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789635234.607371:0:9507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789635234.607372:0:9507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789635234.607374:0:9507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789635234.607375:0:9507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789635234.607377:0:9507:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789635234.607378:0:9507:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789635234.607380:0:9507:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789635234.607381:0:9507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789635234.607383:0:9507:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789635234.607386:0:9507:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1789635234.607389:0:9507:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789635234.607390:0:9507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789635234.607391:0:9507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789635234.607398:0:9507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789635234.607399:0:9507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789635234.607400:0:9507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789635234.607401:0:9507:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789635234.607402:0:9507:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789635234.607403:0:9507:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789635234.607404:0:9507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789635234.607405:0:9507:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789635234.607431:0:9507:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789635234.607448:0:9507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575adb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427239552:0@lo:253: 00000100:00100000:1.0:1789635234.607510:0:9507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635234.607547:0:9507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0441455900 going to sleep for 11 seconds 00000100:00100000:1.0:1789635234.607579:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427239552 00000100:00100000:1.0:1789635234.607586:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427239552 00000100:00100000:1.0:1789635234.607646:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789635234.607655:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+17:9507:x1876568427239552:12345-0@lo:253: 20000000:01000000:1.0:1789635234.607678:0:6506:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789635234.607692:0:6506:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789635234.617989:0:6506:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789635234.618019:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789635234.618174:0:6530:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789635234.618180:0:6530:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789635234.618201:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa40ee10 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.618237:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d056f6e9e00/0xb0c3a59caa40ed06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ecff expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.618244:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d054139c800/0xb0c3a59caa40ed4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ed45 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.618251:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa40ee10 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.618290:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d054139c800/0xb0c3a59caa40ed4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40ed45 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.618303:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d054139c800/0xb0c3a59caa40ed4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40ed45 expref: 17 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635234.618316:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759ca680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1876568427239680:0@lo:104: 00000100:00100000:2.0:1789635234.618389:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789635234.618442:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d056f6e9e00/0xb0c3a59caa40ed06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40ecff expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.618450:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d056f6e9e00/0xb0c3a59caa40ed06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40ecff expref: 17 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635234.618459:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1876568427239808:0@lo:104: 00000100:00100000:2.0:1789635234.618479:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635234.618504:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d04410f99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635234.618582:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427239680 00000100:00100000:0.0:1789635234.618615:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427239680 00000100:00100000:0.0:1789635234.618654:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427239808 00000100:00100000:0.0:1789635234.618658:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427239808 00000100:00100000:0.0:1789635234.618677:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789635234.618688:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+4:6530:x1876568427239680:12345-0@lo:104: 00010000:00010000:0.0:1789635234.618699:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d0540030a00/0xb0c3a59caa40ed45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ed4c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635234.618746:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+17:9507:x1876568427239552:12345-0@lo:253: Request processed in 11090us (11235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635234.618757:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00010000:00010000:0.0:1789635234.618782:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789635234.618790:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+4:6530:x1876568427239680:12345-0@lo:104: Request processed in 105us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635234.618798:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789635234.618813:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789635234.618820:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+3:6530:x1876568427239808:12345-0@lo:104: 00010000:00010000:0.0:1789635234.618828:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d054139ce00/0xb0c3a59caa40ecff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ed06 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635234.618997:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789635234.619003:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+3:6530:x1876568427239808:12345-0@lo:104: Request processed in 183us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635234.619009:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1789635234.619026:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789635234.619032:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d0540030a00/0xb0c3a59caa40ed45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ed4c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635234.619039:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540030a00 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:0.0:1789635234.619043:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d0540030a00/0xb0c3a59caa40ed45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40ed4c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635234.619060:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d0540030a00/0xb0c3a59caa40ed45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40ed4c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789635234.619067:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d0540030a00/0xb0c3a59caa40ed45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40ed4c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635234.619072:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789635234.619096:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d0540030a00/0xb0c3a59caa40ed45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ed4c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635234.619102:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789635234.619115:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d0540030a00/0xb0c3a59caa40ed45 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ed4c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635234.619134:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d0540030a00/0xb0c3a59caa40ed45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ed4c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635234.619147:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635234.619151:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d054139ce00/0xb0c3a59caa40ecff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ed06 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635234.619155:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d054139ce00 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:0.0:1789635234.619158:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d054139ce00/0xb0c3a59caa40ecff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40ed06 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635234.619163:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d054139ce00/0xb0c3a59caa40ecff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40ed06 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789635234.619169:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d054139ce00/0xb0c3a59caa40ecff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40ed06 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635234.619179:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789635234.619194:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d054139ce00/0xb0c3a59caa40ecff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ed06 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635234.619199:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789635234.619204:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d054139ce00/0xb0c3a59caa40ecff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ed06 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635234.619209:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d054139ce00/0xb0c3a59caa40ecff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ed06 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635234.619219:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635234.619221:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635234.619222:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635234.619246:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759ca680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1876568427239680:0@lo:104: 00000100:00100000:0.0:1789635234.619254:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6530:1876568427239808:0@lo:104: 00010000:00010000:0.0:1789635234.619270:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa40ee10 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635234.619476:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427239936:0@lo:103: 00000100:00100000:3.0:1789635234.619510:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635234.619538:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789635234.619544:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05446f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427240064:0@lo:103: 00000100:00100000:3.0:1789635234.619578:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789635234.620411:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635234.620436:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427239936 00000100:00100000:1.0:1789635234.620443:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427239936 00010000:00010000:1.0:1789635234.620473:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d054139c800/0xb0c3a59caa40ed4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ed45 expref: 17 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635234.620505:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427240064 00000100:00100000:1.0:1789635234.620509:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427240064 00010000:00010000:1.0:1789635234.620521:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d056f6e9e00/0xb0c3a59caa40ed06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ecff expref: 18 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635234.620556:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789635234.620565:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+18:3640:x1876568427239936:12345-0@lo:103: 00010000:00010000:1.0:1789635234.620578:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635234.620583:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d054139c800/0xb0c3a59caa40ed4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ed45 expref: 18 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.620610:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d054139c800/0xb0c3a59caa40ed4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40ed45 expref: 18 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.620626:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d054139c800/0xb0c3a59caa40ed4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40ed45 expref: 18 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.620639:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635234.620675:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+17:3640:x1876568427239936:12345-0@lo:103: Request processed in 112us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635234.620682:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789635234.620699:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789635234.620705:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+16:3640:x1876568427240064:12345-0@lo:103: 00010000:00010000:1.0:1789635234.620714:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635234.620718:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d056f6e9e00/0xb0c3a59caa40ed06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ecff expref: 16 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.620727:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d056f6e9e00/0xb0c3a59caa40ed06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40ecff expref: 16 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.620737:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056f6e9e00/0xb0c3a59caa40ed06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40ecff expref: 16 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.620758:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa40ee10 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.620767:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa40ee10 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789635234.620781:0:6501:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003814006s 00010000:00010000:1.0:1789635234.620785:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa40ee10 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.620793:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa40ee10 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.620799:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa40ee10 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.620807:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa40ee10 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.620812:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a2800 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:1.0:1789635234.620816:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa40ee10 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.620823:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa40ee10 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.620836:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa40ee10 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.620845:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635234.620871:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+15:3640:x1876568427240064:12345-0@lo:103: Request processed in 166us (1292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635234.620877:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1789635234.620903:0:6530:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa40ee10 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.621477:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa40ee10 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.621484:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa40ee10 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635234.622869:0:9507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575adb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6356ed01-c755-4f9e-b839-20feb7c3f098:9507:1876568427239552:0@lo:253: 10000000:01000000:2.0:1789635234.622886:0:9507:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789635234.622903:0:9507:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789635234.623000:0:9507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789635234.623003:0:9507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789635234.623004:0:9507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789635234.623042:0:9507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789635234.623044:0:9507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789635234.623045:0:9507:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789635234.623047:0:9507:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789635234.623048:0:9507:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789635234.623050:0:9507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789635234.623051:0:9507:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789635234.623067:0:9507:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789635234.624674:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05446f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427240064:0@lo:103: 00000100:00100000:3.0:1789635234.624689:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427239936:0@lo:103: 00080000:10000000:2.0:1789635234.636581:0:9507:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1789635234.637143:0:9507:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1789635234.638046:0:9507:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1789635234.638378:0:9507:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1789635234.638850:0:9507:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1789635234.639870:0:9507:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1789635234.641988:0:9507:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789635234.655432:0:9507:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789635234.655440:0:9507:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789635234.655478:0:9507:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789635234.655528:0:9507:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.120@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789635234.655546:0:9507:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1789635234.655577:0:9507:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1789635234.656507:0:9507:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789635234.656882:0:9507:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1789635234.856146:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789635235.551058:0:9580:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789635235.551313:0:9580:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789635235.875779:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635236.899843:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635237.285724:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575adad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427240192:0@lo:13: 00000100:00100000:3.0:1789635237.285794:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635237.285912:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427240192 00000100:00100000:1.0:1789635237.285921:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427240192 00000100:00100000:1.0:1789635237.285978:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789635237.285989:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427240192:12345-0@lo:13: 00002000:00000024:1.0:1789635237.286019:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789635237.286066:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427240192:12345-0@lo:13: Request processed in 79us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635237.286072:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789635237.286118:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0575adad80 x1876568427240192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635237.286134:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575adad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427240192:0@lo:13: 00000100:00080000:3.0:1789635237.286193:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789635237.798811:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427240320:0@lo:13: 00000100:00100000:2.0:1789635237.799059:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635237.802827:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427240320 00000100:00100000:0.0:1789635237.802843:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427240320 00000100:00100000:0.0:1789635237.803167:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789635237.803178:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427240320:12345-0@lo:13: 00002000:00000024:0.0:1789635237.803204:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635237.803310:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427240320:12345-0@lo:13: Request processed in 133us (4251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635237.803317:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789635237.805672:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05446f7480 x1876568427240320/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635237.805722:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427240320:0@lo:13: 00000100:00080000:3.0:1789635237.811799:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789635237.923929:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635238.949193:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635239.332639:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427240448:0@lo:41: 00000100:00100000:0.0:1789635239.332710:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635239.332801:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789635239.332807:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427240576:0@lo:41: 00000100:00100000:0.0:1789635239.332832:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635239.333171:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427240448 00000100:00100000:1.0:1789635239.333180:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427240448 00000100:00100000:1.0:1789635239.333241:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427240576 00000100:00100000:1.0:1789635239.333244:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427240576 00000100:00100000:1.0:1789635239.333260:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789635239.333279:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05446f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427240448:12345-0@lo:41: 00000004:00000024:1.0:1789635239.333312:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1789635239.333357:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05446f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427240448:12345-0@lo:41: Request processed in 80us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635239.333364:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789635239.333379:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789635239.333385:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427240576:12345-0@lo:41: 00000004:00000024:1.0:1789635239.333401:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1789635239.333430:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427240576:12345-0@lo:41: Request processed in 45us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635239.333435:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789635239.333568:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427240576:0@lo:41: 00000100:00100000:0.0:1789635239.333582:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427240448:0@lo:41: 00000100:00100000:0.0:1789635239.843814:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876568427240832:0@lo:400: 00000100:00100000:0.0:1789635239.843899:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635239.843957:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044791a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427241344:0@lo:400: 00000100:00100000:0.0:1789635239.843982:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635239.844014:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789635239.844020:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427240704:0@lo:400: 00000100:00100000:0.0:1789635239.844047:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635239.844067:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427241216:0@lo:400: 00000100:00100000:0.0:1789635239.844088:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635239.844101:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1876568427241728:0@lo:400: 00000100:00100000:0.0:1789635239.844123:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635239.844148:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427240960:0@lo:400: 00000100:00100000:0.0:1789635239.844169:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635239.844196:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447918380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427241472:0@lo:400: 00000100:00100000:0.0:1789635239.844217:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635239.844235:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789635239.844240:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044791b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427241088:0@lo:400: 00000100:00100000:0.0:1789635239.844260:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635239.844270:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044791a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427241600:0@lo:400: 00000100:00100000:0.0:1789635239.844292:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635239.844317:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427241344 00000100:00100000:0.0:1789635239.844325:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427241344 00000100:00100000:0.0:1789635239.844372:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427241472 00000100:00100000:0.0:1789635239.844375:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427241472 00000100:00100000:0.0:1789635239.844393:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789635239.844401:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427241344:12345-0@lo:400: 00000100:00100000:0.0:1789635239.844451:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427241344:12345-0@lo:400: Request processed in 50us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635239.844458:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789635239.844474:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789635239.844479:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427241472:12345-0@lo:400: 00000100:00100000:0.0:1789635239.844521:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427241472:12345-0@lo:400: Request processed in 42us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635239.844527:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789635239.844544:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427240704 00000100:00100000:0.0:1789635239.844548:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427240704 00000100:00100000:0.0:1789635239.844571:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789635239.844577:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+15:3643:x1876568427240704:12345-0@lo:400: 00000100:00100000:0.0:1789635239.844627:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+15:3643:x1876568427240704:12345-0@lo:400: Request processed in 49us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635239.844642:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789635239.844670:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427240832 00000100:00100000:0.0:1789635239.844673:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427240832 00000100:00100000:0.0:1789635239.844690:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427241216 00000100:00100000:0.0:1789635239.844693:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427241216 00000100:00100000:0.0:1789635239.844705:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427241728 00000100:00100000:0.0:1789635239.844708:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427241728 00000100:00100000:0.0:1789635239.844719:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427240960 00000100:00100000:0.0:1789635239.844722:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427240960 00000100:00100000:0.0:1789635239.844731:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427241088 00000100:00100000:0.0:1789635239.844733:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427241088 00000100:00100000:0.0:1789635239.844745:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427241600 00000100:00100000:0.0:1789635239.844747:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427241600 00000100:00100000:0.0:1789635239.844761:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789635239.844767:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876568427240832:12345-0@lo:400: 00000100:00100000:0.0:1789635239.844797:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876568427240832:12345-0@lo:400: Request processed in 31us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635239.844803:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789635239.844816:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789635239.844822:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044791bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876568427241216:12345-0@lo:400: 00000100:00100000:0.0:1789635239.844845:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044791bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876568427241216:12345-0@lo:400: Request processed in 24us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635239.844850:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789635239.844860:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789635239.844865:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044791b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876568427241728:12345-0@lo:400: 00000100:00100000:0.0:1789635239.844902:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044791b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876568427241728:12345-0@lo:400: Request processed in 37us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635239.844907:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789635239.844926:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789635239.844932:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427240960:12345-0@lo:400: 00000100:00100000:0.0:1789635239.844959:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427240960:12345-0@lo:400: Request processed in 28us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635239.844965:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789635239.844981:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789635239.844987:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427241088:12345-0@lo:400: 00000100:00100000:0.0:1789635239.845012:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427241088:12345-0@lo:400: Request processed in 26us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635239.845018:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789635239.845029:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789635239.845034:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044791b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427241600:12345-0@lo:400: 00000100:00100000:0.0:1789635239.845060:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044791b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427241600:12345-0@lo:400: Request processed in 26us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635239.845065:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1789635239.845109:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d044791b100 x1876568427241088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635239.845123:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044791b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427241088:0@lo:400: 00010000:00080000:0.0:1789635239.845134:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d044791a680 x1876568427241600/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635239.845142:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044791a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427241600:0@lo:400: 00010000:00080000:0.0:1789635239.845151:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05446f7480 x1876568427240960/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635239.845160:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427240960:0@lo:400: 00010000:00080000:0.0:1789635239.845181:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447918380 x1876568427241472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635239.845189:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447918380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427241472:0@lo:400: 00000100:00100000:0.0:1789635239.845222:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427240704:0@lo:400: 00010000:00080000:0.0:1789635239.845231:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447919c00 x1876568427241216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635239.845238:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427241216:0@lo:400: 00010000:00080000:0.0:1789635239.845246:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447919180 x1876568427241728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635239.845253:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1876568427241728:0@lo:400: 00010000:00080000:0.0:1789635239.845261:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05759d0e00 x1876568427240832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635239.845268:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876568427240832:0@lo:400: 00010000:00080000:0.0:1789635239.845277:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d044791a300 x1876568427241344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635239.845284:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044791a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427241344:0@lo:400: 00000100:00080000:3.0:1789635239.845656:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789635239.845660:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789635239.845663:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789635239.972659:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789635240.753810:0:9870:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:1.0:1789635240.870794:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789635240.870802:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d056f7ce800 from 39 10000000:01000000:1.0:1789635240.870807:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789635240.870853:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d0540031c00/0xb0c3a59caa40ee17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635240.870879:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d0540031c00/0xb0c3a59caa40ee17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635240.870892:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d0540031c00/0xb0c3a59caa40ee17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635240.870917:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575adad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427241856:0@lo:101: 00000100:00100000:1.0:1789635240.870994:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635240.871038:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05746cf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635240.873970:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427241856 00000100:00100000:0.0:1789635240.873986:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427241856 00000100:00100000:0.0:1789635240.874051:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789635240.874062:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+15:6512:x1876568427241856:12345-0@lo:101: 00010000:00010000:0.0:1789635240.874080:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635240.874097:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056f6e8200/0xb0c3a59caa40ee1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ee17 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635240.874136:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056f6e8200/0xb0c3a59caa40ee1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ee17 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635240.874148:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056f6e8200/0xb0c3a59caa40ee1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ee17 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635240.874158:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056f6e8200, rc 0) 00000100:00100000:0.0:1789635240.874241:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+16:6512:x1876568427241856:12345-0@lo:101: Request processed in 181us (3245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635240.874248:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789635240.874640:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575adad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427241856:0@lo:101: 00010000:00010000:3.0:1789635240.874661:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d0540031c00/0xb0c3a59caa40ee17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ee1e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635240.874673:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d0540031c00/0xb0c3a59caa40ee17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ee1e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635240.874758:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427241984:0@lo:501: 00000100:00100000:3.0:1789635240.874801:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635240.874838:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d04477df000 going to sleep for 11 seconds 00000100:00100000:0.0:1789635240.874881:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427241984 00000100:00100000:0.0:1789635240.874887:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427241984 00000100:00100000:0.0:1789635240.874930:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789635240.874938:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+16:6512:x1876568427241984:12345-0@lo:501: 00000100:00100000:0.0:1789635240.875059:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+16:6512:x1876568427241984:12345-0@lo:501: Request processed in 122us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635240.875066:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789635240.876066:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427241984:0@lo:501: 00000100:00100000:3.0:1789635240.876106:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427242112:0@lo:503: 00000100:00100000:3.0:1789635240.876171:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635240.876200:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d04477df000 going to sleep for 11 seconds 00000100:00100000:0.0:1789635240.876968:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427242112 00000100:00100000:0.0:1789635240.876977:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427242112 00000100:00100000:0.0:1789635240.877019:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789635240.877027:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+16:6512:x1876568427242112:12345-0@lo:503: 00000100:00100000:0.0:1789635240.877175:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+16:6512:x1876568427242112:12345-0@lo:503: Request processed in 126us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635240.877182:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789635240.877344:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427242112:0@lo:503: 00000100:00100000:1.0:1789635240.877781:0:9881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:9881:1876568427242240:0@lo:502: 00000100:00100000:1.0:1789635240.877828:0:9881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635240.877870:0:9881:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05746cf3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635240.878068:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427242240 00000100:00100000:3.0:1789635240.878074:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427242240 00000100:00100000:3.0:1789635240.878111:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789635240.878119:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+16:9881:x1876568427242240:12345-0@lo:502: 00000100:00100000:3.0:1789635240.878361:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+16:9881:x1876568427242240:12345-0@lo:502: Request processed in 243us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635240.878369:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789635240.879903:0:9881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:9881:1876568427242240:0@lo:502: 00000100:00100000:1.0:1789635240.879987:0:9881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:9881:1876568427242368:0@lo:502: 00000100:00100000:1.0:1789635240.880050:0:9881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635240.880095:0:9881:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05746cf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635240.880410:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427242368 00000100:00100000:2.0:1789635240.880418:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427242368 00000100:00100000:2.0:1789635240.880468:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789635240.880477:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b817c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+16:9881:x1876568427242368:12345-0@lo:502: 00000100:00100000:2.0:1789635240.880619:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b817c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+16:9881:x1876568427242368:12345-0@lo:502: Request processed in 120us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635240.880627:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789635240.880715:0:9881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:9881:1876568427242368:0@lo:502: 00000040:00080000:0.0:1789635240.880749:0:9881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1789635240.881062:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1789635240.881081:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789635240.881090:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d0540031c00/0xb0c3a59caa40ee17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ee1e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635240.881110:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d0540031c00/0xb0c3a59caa40ee17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ee1e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635240.881119:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789635240.881122:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1789635240.881124:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789635240.881149:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3800/0xb0c3a59caa40ee25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635240.881157:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3800/0xb0c3a59caa40ee25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635240.881167:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3800/0xb0c3a59caa40ee25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635240.881182:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427242496:0@lo:101: 00000100:00100000:2.0:1789635240.881213:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635240.881243:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549fa8300 going to sleep for 11 seconds 00000100:00100000:1.0:1789635240.881303:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427242496 00000100:00100000:1.0:1789635240.881308:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427242496 00000100:00100000:1.0:1789635240.881897:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789635240.881908:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+16:6512:x1876568427242496:12345-0@lo:101: 00010000:00010000:1.0:1789635240.881990:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635240.882004:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0540031800/0xb0c3a59caa40ee2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ee25 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635240.882026:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0540031800/0xb0c3a59caa40ee2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ee25 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635240.882036:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0540031800/0xb0c3a59caa40ee2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ee25 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635240.882044:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0540031800, rc 0) 00000100:00100000:1.0:1789635240.883674:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+17:6512:x1876568427242496:12345-0@lo:101: Request processed in 1759us (2450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635240.883686:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789635240.892743:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427242496:0@lo:101: 00010000:00010000:3.0:1789635240.892773:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3800/0xb0c3a59caa40ee25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ee2c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635240.892785:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3800/0xb0c3a59caa40ee25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ee2c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635240.892903:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427242624:0@lo:501: 00000100:00100000:3.0:1789635240.892959:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635240.892992:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d04477df540 going to sleep for 11 seconds 00000100:00100000:3.0:1789635240.893010:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427242624 00000100:00100000:3.0:1789635240.893017:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427242624 00000100:00100000:3.0:1789635240.893051:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789635240.893059:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+17:6512:x1876568427242624:12345-0@lo:501: 00000100:00100000:3.0:1789635240.893181:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+17:6512:x1876568427242624:12345-0@lo:501: Request processed in 122us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635240.893188:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789635240.893223:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427242624:0@lo:501: 00000100:00100000:3.0:1789635240.893246:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427242752:0@lo:503: 00000100:00100000:3.0:1789635240.893280:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635240.893295:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d04477df540 going to sleep for 11 seconds 00000100:00100000:3.0:1789635240.893304:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427242752 00000100:00100000:3.0:1789635240.893307:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427242752 00000100:00100000:3.0:1789635240.893321:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789635240.893326:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+17:6512:x1876568427242752:12345-0@lo:503: 00000100:00100000:3.0:1789635240.893391:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+17:6512:x1876568427242752:12345-0@lo:503: Request processed in 64us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635240.893397:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789635240.893428:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427242752:0@lo:503: 00000100:00100000:0.0:1789635240.895302:0:9883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044791a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:9883:1876568427242880:0@lo:502: 00000100:00100000:0.0:1789635240.895386:0:9883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635240.895424:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427242880 00000100:00100000:0.0:1789635240.895431:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427242880 00000100:00100000:0.0:1789635240.895463:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789635240.895471:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+17:9883:x1876568427242880:12345-0@lo:502: 00000100:00100000:0.0:1789635240.895573:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+17:9883:x1876568427242880:12345-0@lo:502: Request processed in 102us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635240.895580:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789635240.895641:0:9883:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446ce0240 going to sleep for 11 seconds 00000100:00100000:0.0:1789635240.895659:0:9883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044791a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:9883:1876568427242880:0@lo:502: 00000020:01000000:0.0:1789635240.895681:0:9883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789635240.895689:0:9883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635240.895692:0:9883:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789635240.895696:0:9883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789635240.895698:0:9883:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789635240.895711:0:9883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044791a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:9883:1876568427243008:0@lo:502: 00000100:00100000:0.0:1789635240.896346:0:9883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635240.896374:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427243008 00000100:00100000:0.0:1789635240.896379:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427243008 00000100:00100000:0.0:1789635240.896401:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789635240.896407:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+17:9883:x1876568427243008:12345-0@lo:502: 00000100:00100000:0.0:1789635240.896488:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+17:9883:x1876568427243008:12345-0@lo:502: Request processed in 80us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635240.896495:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789635240.896528:0:9883:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446ce0240 going to sleep for 11 seconds 00000100:00100000:0.0:1789635240.896541:0:9883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044791a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:9883:1876568427243008:0@lo:502: 00000020:01000000:0.0:1789635240.896569:0:9883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635240.896574:0:9883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635240.896576:0:9883:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789635240.896580:0:9883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1789635240.896705:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1789635240.898068:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789635240.898083:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3800/0xb0c3a59caa40ee25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ee2c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635240.898094:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3800/0xb0c3a59caa40ee25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ee2c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635240.898103:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789635240.898106:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d0550107000 from 39 10000000:01000000:0.0:1789635240.898109:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789635240.898143:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8e00/0xb0c3a59caa40ee33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635240.898151:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8e00/0xb0c3a59caa40ee33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635240.898162:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8e00/0xb0c3a59caa40ee33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635240.898180:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044791a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427243136:0@lo:101: 00000100:00100000:0.0:1789635240.898226:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635240.898303:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446ce0240 going to sleep for 11 seconds 00000100:00100000:1.0:1789635240.898340:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427243136 00000100:00100000:1.0:1789635240.898347:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427243136 00000100:00100000:1.0:1789635240.898417:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789635240.898435:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+17:6512:x1876568427243136:12345-0@lo:101: 00010000:00010000:1.0:1789635240.898454:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635240.898466:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0540031400/0xb0c3a59caa40ee3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ee33 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635240.898486:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0540031400/0xb0c3a59caa40ee3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ee33 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635240.898495:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0540031400/0xb0c3a59caa40ee3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ee33 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635240.898503:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0540031400, rc 0) 00000100:00100000:1.0:1789635240.898549:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+18:6512:x1876568427243136:12345-0@lo:101: Request processed in 125us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635240.898556:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789635240.898643:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044791a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427243136:0@lo:101: 00010000:00010000:2.0:1789635240.898658:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8e00/0xb0c3a59caa40ee33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ee3a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635240.898666:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8e00/0xb0c3a59caa40ee33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ee3a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635240.898720:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427243264:0@lo:501: 00000100:00100000:2.0:1789635240.898759:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635240.899155:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549fa8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789635240.899194:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427243264 00000100:00100000:0.0:1789635240.899199:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427243264 00000100:00100000:0.0:1789635240.899232:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789635240.899239:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+18:6512:x1876568427243264:12345-0@lo:501: 00000100:00100000:0.0:1789635240.899358:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+18:6512:x1876568427243264:12345-0@lo:501: Request processed in 118us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635240.899365:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789635240.899457:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427243264:0@lo:501: 00000100:00100000:2.0:1789635240.899486:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427243392:0@lo:503: 00000100:00100000:2.0:1789635240.899524:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635240.899575:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549fa8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789635240.900346:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427243392 00000100:00100000:1.0:1789635240.900353:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427243392 00000100:00100000:1.0:1789635240.900431:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789635240.900440:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+18:6512:x1876568427243392:12345-0@lo:503: 00000100:00100000:1.0:1789635240.900543:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+18:6512:x1876568427243392:12345-0@lo:503: Request processed in 103us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635240.900550:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789635240.903533:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427243392:0@lo:503: 00000100:00100000:1.0:1789635240.906139:0:9885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:9885:1876568427243520:0@lo:502: 00000100:00100000:1.0:1789635240.906218:0:9885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635240.906269:0:9885:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05746cfe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789635240.906659:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427243520 00000100:00100000:3.0:1789635240.906674:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427243520 00000100:00100000:3.0:1789635240.906733:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789635240.906743:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+18:9885:x1876568427243520:12345-0@lo:502: 00000100:00100000:3.0:1789635240.907992:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+18:9885:x1876568427243520:12345-0@lo:502: Request processed in 1247us (1770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635240.908004:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789635240.908025:0:9885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:9885:1876568427243520:0@lo:502: 00000100:00100000:0.0:1789635240.908095:0:9885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447919180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:9885:1876568427243648:0@lo:502: 00000100:00100000:0.0:1789635240.908147:0:9885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635240.908186:0:9885:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446ce0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789635240.908228:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427243648 00000100:00100000:2.0:1789635240.908235:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427243648 00000100:00100000:2.0:1789635240.908273:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789635240.908281:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+18:9885:x1876568427243648:12345-0@lo:502: 00000100:00100000:2.0:1789635240.908389:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+18:9885:x1876568427243648:12345-0@lo:502: Request processed in 108us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635240.908396:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789635240.908512:0:9885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447919180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:9885:1876568427243648:0@lo:502: 00000040:00080000:3.0:1789635240.908530:0:9885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1789635240.908908:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1789635240.908939:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789635240.908950:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8e00/0xb0c3a59caa40ee33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ee3a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635240.908961:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8e00/0xb0c3a59caa40ee33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ee3a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635240.908969:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789635240.908971:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d0550107000 from 6 10000000:01000000:2.0:1789635240.908974:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789635240.908999:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2a00/0xb0c3a59caa40ee41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635240.909007:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2a00/0xb0c3a59caa40ee41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635240.909028:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2a00/0xb0c3a59caa40ee41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635240.909041:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427243776:0@lo:101: 00000100:00100000:2.0:1789635240.909071:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635240.909103:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549fa8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789635240.909205:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427243776 00000100:00100000:0.0:1789635240.909210:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427243776 00000100:00100000:0.0:1789635240.909244:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789635240.909252:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+18:6512:x1876568427243776:12345-0@lo:101: 00010000:00010000:0.0:1789635240.909261:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635240.909274:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056f6e9e00/0xb0c3a59caa40ee48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ee41 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635240.909294:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056f6e9e00/0xb0c3a59caa40ee48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ee41 expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635240.909304:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056f6e9e00/0xb0c3a59caa40ee48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ee41 expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635240.909312:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056f6e9e00, rc 0) 00000100:00100000:0.0:1789635240.909344:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+19:6512:x1876568427243776:12345-0@lo:101: Request processed in 93us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635240.909363:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789635240.909922:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427243776:0@lo:101: 00010000:00010000:2.0:1789635240.909939:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2a00/0xb0c3a59caa40ee41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ee48 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635240.909949:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2a00/0xb0c3a59caa40ee41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ee48 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635240.909999:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427243904:0@lo:256: 00000100:00100000:2.0:1789635240.910039:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635240.910071:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549fa8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789635240.910178:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427243904 00000100:00100000:0.0:1789635240.910184:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427243904 00000100:00100000:0.0:1789635240.910228:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789635240.910236:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+19:6512:x1876568427243904:12345-0@lo:256: 20000000:01000000:0.0:1789635240.910251:0:6508:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789635240.910269:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789635240.910273:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1789635240.910357:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+19:6512:x1876568427243904:12345-0@lo:256: Request processed in 121us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635240.910364:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789635240.910477:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427243904:0@lo:256: 10000000:01000000:2.0:1789635240.910523:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789635240.910531:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2a00/0xb0c3a59caa40ee41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ee48 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635240.910539:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2a00/0xb0c3a59caa40ee41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ee48 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635240.910548:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789635240.910551:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:2.0:1789635240.910558:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789635240.910577:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3c00/0xb0c3a59caa40ee4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635240.910584:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3c00/0xb0c3a59caa40ee4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635240.910592:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3c00/0xb0c3a59caa40ee4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635240.910635:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427244032:0@lo:101: 00000100:00100000:2.0:1789635240.910661:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635240.910680:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549fa8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789635240.910741:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427244032 00000100:00100000:0.0:1789635240.910746:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427244032 00000100:00100000:0.0:1789635240.910787:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789635240.910794:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+19:6512:x1876568427244032:12345-0@lo:101: 00010000:00010000:0.0:1789635240.910802:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635240.910813:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056f6e9600/0xb0c3a59caa40ee56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ee4f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635240.910828:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056f6e9600/0xb0c3a59caa40ee56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ee4f expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635240.910836:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056f6e9600/0xb0c3a59caa40ee56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ee4f expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635240.910844:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056f6e9600, rc 0) 00000100:00100000:0.0:1789635240.910883:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+20:6512:x1876568427244032:12345-0@lo:101: Request processed in 90us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635240.910889:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789635240.911085:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427244032:0@lo:101: 00010000:00010000:2.0:1789635240.911096:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3c00/0xb0c3a59caa40ee4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ee56 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635240.911103:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3c00/0xb0c3a59caa40ee4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ee56 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635240.911151:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427244160:0@lo:501: 00000100:00100000:2.0:1789635240.911176:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635240.911207:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549fa8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789635240.911218:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427244160 00000100:00100000:2.0:1789635240.911221:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427244160 00000100:00100000:2.0:1789635240.911241:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789635240.911247:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+20:6512:x1876568427244160:12345-0@lo:501: 00000100:00100000:2.0:1789635240.911353:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+20:6512:x1876568427244160:12345-0@lo:501: Request processed in 105us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635240.911369:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789635240.911391:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427244160:0@lo:501: 00000100:00100000:2.0:1789635240.911415:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427244288:0@lo:503: 00000100:00100000:2.0:1789635240.911450:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635240.911458:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549fa8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789635240.911474:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427244288 00000100:00100000:2.0:1789635240.911478:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427244288 00000100:00100000:2.0:1789635240.911494:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789635240.911499:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+20:6512:x1876568427244288:12345-0@lo:503: 00000100:00100000:2.0:1789635240.911572:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+20:6512:x1876568427244288:12345-0@lo:503: Request processed in 72us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635240.911578:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789635240.911639:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427244288:0@lo:503: 00000100:00100000:1.0:1789635240.922020:0:9886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575adad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:9886:1876568427244416:0@lo:502: 00000100:00100000:1.0:1789635240.922098:0:9886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635240.922143:0:9886:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d04410f9780 going to sleep for 11 seconds 00000100:00100000:0.0:1789635240.922255:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427244416 00000100:00100000:0.0:1789635240.922264:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427244416 00000100:00100000:0.0:1789635240.922314:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789635240.922331:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b811450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+20:9886:x1876568427244416:12345-0@lo:502: 00000100:00100000:0.0:1789635240.922473:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b811450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+20:9886:x1876568427244416:12345-0@lo:502: Request processed in 144us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635240.922482:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789635240.923065:0:9886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575adad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:9886:1876568427244416:0@lo:502: 00000020:01000000:1.0:1789635240.923106:0:9886:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789635240.923114:0:9886:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789635240.923120:0:9886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635240.923123:0:9886:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789635240.923128:0:9886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789635240.923132:0:9886:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:01000000:1.0:1789635240.923154:0:9886:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789635240.923157:0:9886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789635240.923183:0:9886:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8d04478a3380) 00000020:00000080:1.0:1789635240.923217:0:9886:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1789635240.923223:0:9886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789635240.923299:0:9886:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1789635240.923305:0:9886:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789635240.923311:0:9886:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb0c3a59caa40ee64 00010000:00080000:1.0:1789635240.923340:0:9886:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d0447652800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.120@tcp at head 00010000:00010000:1.0:1789635240.923555:0:9886:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1789635240.926006:0:9886:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1789635240.926027:0:9886:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1789635240.926190:0:9886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789635240.926297:0:9886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789635240.926431:0:9886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1789635240.926518:0:9886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1789635240.931211:0:9888:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789635240.931220:0:9888:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789635240.933269:0:9886:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789635240.933282:0:9886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789635240.933321:0:9886:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789635240.933346:0:9886:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb0c3a59caa40ee6b 00000100:00080000:1.0:1789635240.933357:0:9886:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789635240.933369:0:9886:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d0447652800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1789635240.933423:0:9886:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0575adad80 x1876568427244544/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789635240.933454:0:9886:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789635240.933509:0:9886:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789635240.933514:0:9886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635240.933516:0:9886:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789635240.933519:0:9886:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789635240.933523:0:9886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635240.933524:0:9886:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789635240.933527:0:9886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789635240.933529:0:9886:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789635240.933554:0:9886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575adb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:9886:1876568427244672:0@lo:502: 00000100:00100000:1.0:1789635240.933654:0:9886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635240.933692:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427244672 00000100:00100000:1.0:1789635240.933699:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427244672 00000100:00100000:0.0:1789635240.934080:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575adad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1876568427244544:0@lo:8: 00000100:00100000:0.0:1789635240.934118:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635240.934172:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789635240.934184:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b811050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+20:9886:x1876568427244672:12345-0@lo:502: 00000100:00100000:1.0:1789635240.934294:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b811050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+20:9886:x1876568427244672:12345-0@lo:502: Request processed in 112us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635240.934301:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789635240.935105:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876568427244800:0@lo:400: 00000100:00100000:3.0:1789635240.935144:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635240.937420:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427244544 00000100:00100000:0.0:1789635240.937433:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427244544 00000100:00100000:0.0:1789635240.937475:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789635240.937483:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1876568427244544:12345-0@lo:8: 00010000:00080000:0.0:1789635240.937515:0:8430:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:0.0:1789635240.937541:0:8430:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb0c3a59caa40ee72 00002000:00100000:0.0:1789635240.937555:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8d0577696000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1789635240.937560:0:8430:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:0.0:1789635240.937563:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1789635240.937639:0:8430:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789635240.938093:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1789635240.938120:0:8430:0:(import.c:65:import_set_state_nolock()) ffff8d0549fb0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789635240.938198:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1876568427244544:12345-0@lo:8: Request processed in 714us (4078us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635240.938206:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789635240.938258:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0575adad80 x1876568427244544/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789635250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635240.938269:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789635240.938276:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1789635240.938284:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789635240.938295:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789635240.938298:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d0447652800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789635240.938308:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789635240.938313:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575adad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1876568427244544:0@lo:8: 00000100:00100000:0.0:1789635240.938365:0:9890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447918380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9890:1876568427246080:0@lo:700: 00000100:00100000:0.0:1789635240.938398:0:9890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635240.938428:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427246080 00000100:00100000:0.0:1789635240.938432:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427246080 00000100:00100000:0.0:1789635240.938471:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789635240.938479:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044791a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9890:x1876568427246080:12345-0@lo:700: 00000100:00100000:0.0:1789635240.938507:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044791b100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8438:1876568427246208:0@lo:700: 00000100:00100000:0.0:1789635240.938536:0:8438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635240.938555:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446ce0840 going to sleep for 11 seconds 00000100:00080000:0.0:1789635240.938566:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789635240.938578:0:9890:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446ce0d80 going to sleep for 11 seconds 00000004:00080000:0.0:1789635240.938640:0:9888:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789635240.938694:0:9888:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 259622096889ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789635240.938701:0:9888:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789635240.940878:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427246208 00000100:00100000:2.0:1789635240.940889:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427246208 00000100:00100000:2.0:1789635240.940942:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789635240.940951:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8438:x1876568427246208:12345-0@lo:700: 00000100:00100000:0.0:1789635240.942680:0:9886:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0550647d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789635240.942721:0:9886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575adb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:9886:1876568427244672:0@lo:502: 00000020:01000000:0.0:1789635240.942773:0:9886:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635240.942780:0:9886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635240.942783:0:9886:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789635240.942788:0:9886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:0.0:1789635240.942854:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:0.0:1789635240.942888:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789635240.942898:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3c00/0xb0c3a59caa40ee4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ee56 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635240.942931:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3c00/0xb0c3a59caa40ee4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ee56 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635240.942942:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789635240.942944:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d0558960000 from 39 10000000:01000000:0.0:1789635240.942947:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789635240.942981:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8a00/0xb0c3a59caa40ee79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635240.942990:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8a00/0xb0c3a59caa40ee79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635240.942999:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8a00/0xb0c3a59caa40ee79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635240.943018:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044791aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427246336:0@lo:101: 00000100:00100000:0.0:1789635240.943073:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635240.943098:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446ce0240 going to sleep for 11 seconds 00000100:00100000:1.0:1789635240.943500:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427246336 00000100:00100000:1.0:1789635240.943507:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427246336 00000100:00100000:1.0:1789635240.943549:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789635240.943558:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+20:6512:x1876568427246336:12345-0@lo:101: 00010000:00010000:1.0:1789635240.943571:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635240.943585:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0540030a00/0xb0c3a59caa40ee80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ee79 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635240.943632:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0540030a00/0xb0c3a59caa40ee80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ee79 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635240.943651:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0540030a00/0xb0c3a59caa40ee80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ee79 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635240.943661:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0540030a00, rc 0) 00000100:00100000:1.0:1789635240.943705:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+21:6512:x1876568427246336:12345-0@lo:101: Request processed in 149us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635240.943713:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000004:00080000:1.0:1789635240.944471:0:7446:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:1.0:1789635240.944526:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044791aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427246336:0@lo:101: 00010000:00010000:1.0:1789635240.944544:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8a00/0xb0c3a59caa40ee79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ee80 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635240.944555:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8a00/0xb0c3a59caa40ee79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ee80 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635240.944647:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427246464:0@lo:501: 00000100:00100000:1.0:1789635240.944685:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635240.944705:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b5ebf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789635240.944719:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427246464 00000100:00100000:1.0:1789635240.944788:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427246464 00000100:00100000:1.0:1789635240.944819:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789635240.944826:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+21:6512:x1876568427246464:12345-0@lo:501: 00000100:00100000:1.0:1789635240.946101:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+21:6512:x1876568427246464:12345-0@lo:501: Request processed in 1271us (1411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635240.946110:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789635240.946162:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427246464:0@lo:501: 00000100:00100000:1.0:1789635240.946206:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427246592:0@lo:503: 00000100:00100000:1.0:1789635240.946242:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635240.946258:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b5ebf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789635240.946272:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427246592 00000100:00100000:1.0:1789635240.946276:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427246592 00000100:00100000:1.0:1789635240.946301:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789635240.946307:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+21:6512:x1876568427246592:12345-0@lo:503: 00000100:00100000:1.0:1789635240.946385:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+21:6512:x1876568427246592:12345-0@lo:503: Request processed in 77us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635240.946391:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789635240.946424:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427246592:0@lo:503: 00000100:00100000:3.0:1789635240.950368:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1876568427245312:0@lo:400: 00000100:00100000:3.0:1789635240.950443:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635240.950477:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d057b598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1876568427245824:0@lo:400: 00000100:00100000:3.0:1789635240.950499:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635240.950525:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789635240.950533:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876568427245184:0@lo:400: 00000100:00100000:3.0:1789635240.950555:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635240.950570:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d057b59a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427245696:0@lo:400: 00000100:00100000:3.0:1789635240.950592:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635240.951197:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427244800 00000100:00100000:0.0:1789635240.951207:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427244800 00000100:00100000:0.0:1789635240.951248:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427245312 00000100:00100000:0.0:1789635240.951251:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427245312 00000100:00100000:0.0:1789635240.951264:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427245824 00000100:00100000:0.0:1789635240.951267:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427245824 00000100:00100000:0.0:1789635240.951278:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427245184 00000100:00100000:0.0:1789635240.951281:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427245184 00000100:00100000:0.0:1789635240.951296:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789635240.951305:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876568427244800:12345-0@lo:400: 00000100:00100000:0.0:1789635240.952045:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876568427244800:12345-0@lo:400: Request processed in 610us (16768us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635240.952065:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789635240.952090:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789635240.952098:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876568427245312:12345-0@lo:400: 00000100:00100000:0.0:1789635240.952134:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876568427245312:12345-0@lo:400: Request processed in 39us (1692us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635240.952140:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789635240.952151:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789635240.952156:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3643:x1876568427245824:12345-0@lo:400: 00000100:00100000:0.0:1789635240.952183:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3643:x1876568427245824:12345-0@lo:400: Request processed in 28us (1684us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635240.952189:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789635240.952201:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789635240.952207:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e017480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876568427245184:12345-0@lo:400: 00000100:00100000:0.0:1789635240.952232:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e017480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876568427245184:12345-0@lo:400: Request processed in 26us (1676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635240.952238:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1789635240.952797:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04459e8700 x1876568427244800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635240.952812:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876568427244800:0@lo:400: 00010000:00080000:3.0:1789635240.952826:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04459e9c00 x1876568427245312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635240.952833:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1876568427245312:0@lo:400: 00010000:00080000:3.0:1789635240.952855:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d057b598380 x1876568427245824/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635240.952873:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d057b598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1876568427245824:0@lo:400: 00010000:00080000:3.0:1789635240.952896:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04459ea300 x1876568427245184/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635240.952904:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876568427245184:0@lo:400: 00000100:00100000:3.0:1789635240.953928:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427244928:0@lo:400: 00000100:00100000:3.0:1789635240.954092:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635240.954128:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1876568427245440:0@lo:400: 00000100:00100000:3.0:1789635240.954155:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635240.954171:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1876568427245952:0@lo:400: 00000100:00100000:3.0:1789635240.954189:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635240.954205:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789635240.954210:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427245056:0@lo:400: 00000100:00100000:3.0:1789635240.954227:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635240.954240:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427245568:0@lo:400: 00000100:00100000:3.0:1789635240.954260:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635240.954290:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427245440 00000100:00100000:3.0:1789635240.954297:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427245440 00000100:00100000:3.0:1789635240.954329:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427245952 00000100:00100000:3.0:1789635240.954332:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427245952 00000100:00100000:3.0:1789635240.954347:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789635240.954355:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e014e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876568427245440:12345-0@lo:400: 00000100:00100000:3.0:1789635240.954402:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e014e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876568427245440:12345-0@lo:400: Request processed in 48us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635240.954422:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789635240.954437:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789635240.954444:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876568427245952:12345-0@lo:400: 00000100:00100000:3.0:1789635240.954473:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876568427245952:12345-0@lo:400: Request processed in 30us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635240.954478:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789635240.954669:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427244928 00000100:00100000:0.0:1789635240.954674:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427244928 00000100:00100000:0.0:1789635240.954707:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427245056 00000100:00100000:0.0:1789635240.954710:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427245056 00000100:00100000:0.0:1789635240.954866:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789635240.954876:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e015f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427244928:12345-0@lo:400: 00000100:00100000:0.0:1789635240.954926:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e015f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427244928:12345-0@lo:400: Request processed in 53us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635240.957912:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427245696 00000100:00100000:3.0:1789635240.957928:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427245696 00000100:00100000:3.0:1789635240.957993:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427245568 00000100:00100000:3.0:1789635240.957997:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427245568 00000100:00100000:3.0:1789635240.958016:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789635240.958025:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427245696:12345-0@lo:400: 00000100:00100000:3.0:1789635240.958112:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427245696:12345-0@lo:400: Request processed in 88us (7518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635240.958119:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789635240.958135:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789635240.958141:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427245568:12345-0@lo:400: 00000100:00100000:3.0:1789635240.958167:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427245568:12345-0@lo:400: Request processed in 27us (3906us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635240.958172:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789635240.958208:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04459ebb80 x1876568427245568/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635240.958223:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427245568:0@lo:400: 00000100:00100000:3.0:1789635240.958237:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427244928:0@lo:400: 00010000:00080000:3.0:1789635240.958249:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04459e8380 x1876568427245440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635240.958267:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1876568427245440:0@lo:400: 00010000:00080000:3.0:1789635240.958282:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04459ddf80 x1876568427245952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635240.958290:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1876568427245952:0@lo:400: 00010000:00080000:3.0:1789635240.958328:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d057b59a680 x1876568427245696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635240.958338:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d057b59a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427245696:0@lo:400: 00000100:00100000:2.0:1789635240.961562:0:9891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:9891:1876568427246720:0@lo:502: 00000100:00100000:2.0:1789635240.961660:0:9891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635240.961699:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427246720 00000100:00100000:2.0:1789635240.961707:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427246720 00000100:00100000:1.0:1789635240.962116:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789635240.962131:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e016680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427245056:12345-0@lo:400: 00000100:00100000:1.0:1789635240.962215:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e016680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427245056:12345-0@lo:400: Request processed in 88us (7985us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635240.962223:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789635240.962326:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789635240.962335:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+21:9891:x1876568427246720:12345-0@lo:502: 00000100:00100000:2.0:1789635240.962440:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+21:9891:x1876568427246720:12345-0@lo:502: Request processed in 107us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635240.962457:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789635240.962506:0:9891:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549fa8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789635240.962528:0:9891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:9891:1876568427246720:0@lo:502: 00000100:00100000:2.0:1789635240.962582:0:9891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:9891:1876568427246848:0@lo:502: 00000100:00100000:2.0:1789635240.962638:0:9891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635240.962652:0:9891:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d056e1e4780 going to sleep for 11 seconds 00000100:00100000:0.0:1789635240.962767:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 40000000:02000000:0.0:1789635240.963081:0:6521:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:1.0:1789635240.964035:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427246848 00000100:00100000:1.0:1789635240.964046:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427246848 00000100:00100000:1.0:1789635240.964091:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789635240.964100:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+21:9891:x1876568427246848:12345-0@lo:502: 00000100:00100000:1.0:1789635240.964240:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+21:9891:x1876568427246848:12345-0@lo:502: Request processed in 140us (1601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635240.964247:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789635240.964393:0:9891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:9891:1876568427246848:0@lo:502: 00000040:00080000:2.0:1789635240.964424:0:9891:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1789635240.964809:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1789635240.964830:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789635240.964840:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8a00/0xb0c3a59caa40ee79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ee80 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635240.964874:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8a00/0xb0c3a59caa40ee79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ee80 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635240.964885:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789635240.964888:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d0558960000 from 6 10000000:01000000:1.0:1789635240.964890:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789635240.964919:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d058214a000/0xb0c3a59caa40ee87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635240.964926:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d058214a000/0xb0c3a59caa40ee87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635240.964944:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d058214a000/0xb0c3a59caa40ee87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635240.964961:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427246976:0@lo:101: 00000100:00100000:1.0:1789635240.964998:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635240.965027:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446c536c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635240.965847:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427246976 00000100:00100000:2.0:1789635240.965856:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427246976 00000100:00100000:2.0:1789635240.965905:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789635240.965913:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+21:6512:x1876568427246976:12345-0@lo:101: 00010000:00010000:2.0:1789635240.965927:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635240.965972:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056e1a2200/0xb0c3a59caa40ee8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ee87 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635240.965997:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e1a2200/0xb0c3a59caa40ee8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ee87 expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635240.966009:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056e1a2200/0xb0c3a59caa40ee8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ee87 expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635240.966018:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a2200, rc 0) 00000100:00100000:2.0:1789635240.966073:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+22:6512:x1876568427246976:12345-0@lo:101: Request processed in 160us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635240.966079:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789635240.966127:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427246976:0@lo:101: 00010000:00010000:2.0:1789635240.966152:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d058214a000/0xb0c3a59caa40ee87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ee8e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635240.966161:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d058214a000/0xb0c3a59caa40ee87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ee8e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635240.966211:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427247104:0@lo:256: 00000100:00100000:2.0:1789635240.966245:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635240.966262:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d056e1e43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635240.966276:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427247104 00000100:00100000:2.0:1789635240.966280:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427247104 00000100:00100000:2.0:1789635240.966303:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789635240.966309:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+22:6512:x1876568427247104:12345-0@lo:256: 20000000:01000000:2.0:1789635240.966322:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789635240.966340:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789635240.966343:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789635240.966422:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+22:6512:x1876568427247104:12345-0@lo:256: Request processed in 113us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635240.966430:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789635240.966459:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427247104:0@lo:256: 10000000:01000000:2.0:1789635240.966499:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789635240.966507:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d058214a000/0xb0c3a59caa40ee87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ee8e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635240.966515:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d058214a000/0xb0c3a59caa40ee87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ee8e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635240.966522:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789635240.966529:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1789635240.966532:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789635240.966549:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2400/0xb0c3a59caa40ee95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635240.966557:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2400/0xb0c3a59caa40ee95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635240.966566:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2400/0xb0c3a59caa40ee95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635240.966578:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427247232:0@lo:101: 00000100:00100000:2.0:1789635240.966625:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635240.966639:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d056e1e43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635240.966649:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427247232 00000100:00100000:2.0:1789635240.966653:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427247232 00000100:00100000:2.0:1789635240.966671:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789635240.966678:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+22:6512:x1876568427247232:12345-0@lo:101: 00010000:00010000:2.0:1789635240.966685:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635240.966694:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056e1a2000/0xb0c3a59caa40ee9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ee95 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635240.966710:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e1a2000/0xb0c3a59caa40ee9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ee95 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635240.966719:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056e1a2000/0xb0c3a59caa40ee9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ee95 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635240.968167:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427245056:0@lo:400: 00010000:00010000:2.0:1789635240.970016:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a2000, rc 0) 00000100:00100000:2.0:1789635240.971043:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+23:6512:x1876568427247232:12345-0@lo:101: Request processed in 4360us (4412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635240.971065:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789635240.978221:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8438:x1876568427246208:12345-0@lo:700: Request processed in 37266us (39679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635240.978239:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789635240.978293:0:8438:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d044791b100 x1876568427246208/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789635256 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635240.978307:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044791b100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8438:1876568427246208:0@lo:700: 40000000:02000000:0.0:1789635240.978320:0:8438:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:1.0:1789635240.983059:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427247232:0@lo:101: 00010000:00010000:1.0:1789635240.983089:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2400/0xb0c3a59caa40ee95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ee9c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635240.983103:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2400/0xb0c3a59caa40ee95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ee9c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635240.983183:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575adaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427247360:0@lo:501: 00000100:00100000:1.0:1789635240.983241:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635240.983299:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427247360 00000100:00100000:1.0:1789635240.983305:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427247360 00000100:00100000:1.0:1789635240.983344:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789635240.983353:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+23:6512:x1876568427247360:12345-0@lo:501: 00000100:00100000:1.0:1789635240.983469:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+23:6512:x1876568427247360:12345-0@lo:501: Request processed in 116us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635240.983476:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789635240.983516:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446c53b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789635240.983530:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575adaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427247360:0@lo:501: 00000100:00100000:1.0:1789635240.983556:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575adaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427247488:0@lo:503: 00000100:00100000:1.0:1789635240.983628:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635240.983649:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446c53b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789635240.983745:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427247488 00000100:00100000:2.0:1789635240.983750:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427247488 00000100:00100000:2.0:1789635240.983783:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789635240.983790:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+23:6512:x1876568427247488:12345-0@lo:503: 00000100:00100000:2.0:1789635240.983878:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+23:6512:x1876568427247488:12345-0@lo:503: Request processed in 89us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635240.983885:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789635240.984033:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575adaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427247488:0@lo:503: 00000100:00100000:1.0:1789635240.987199:0:9893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575adaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:9893:1876568427247616:0@lo:502: 00000100:00100000:1.0:1789635240.987273:0:9893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635240.987308:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427247616 00000100:00100000:1.0:1789635240.987314:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427247616 00000100:00100000:1.0:1789635240.987357:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789635240.987366:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+23:9893:x1876568427247616:12345-0@lo:502: 00000100:00100000:1.0:1789635240.987470:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+23:9893:x1876568427247616:12345-0@lo:502: Request processed in 105us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635240.987477:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789635240.987519:0:9893:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446c53600 going to sleep for 11 seconds 00000100:00100000:1.0:1789635240.987535:0:9893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575adaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:9893:1876568427247616:0@lo:502: 00000020:01000000:1.0:1789635240.987564:0:9893:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789635240.987572:0:9893:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789635240.987583:0:9893:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635240.987586:0:9893:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789635240.987591:0:9893:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789635240.987614:0:9893:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:01000000:1.0:1789635240.987636:0:9893:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789635240.987639:0:9893:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789635240.987653:0:9893:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d04478a0000) 00000020:00000080:1.0:1789635240.987676:0:9893:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:1.0:1789635240.987681:0:9893:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789635240.987759:0:9893:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789635240.987765:0:9893:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1789635240.987772:0:9893:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb0c3a59caa40eeaa 00010000:00080000:1.0:1789635240.987807:0:9893:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d057603f000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.120@tcp at head 00010000:00010000:1.0:1789635240.989155:0:9893:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:1.0:1789635240.989287:0:9893:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1789635240.989300:0:9893:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789635240.989470:0:9893:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789635240.989579:0:9893:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789635240.989721:0:9893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1789635240.995137:0:9893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000001:00100000:0.0:1789635240.997909:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1789635240.998140:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044791a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9890:x1876568427246080:12345-0@lo:700: Request processed in 59657us (59736us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635240.998151:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789635240.998203:0:9890:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447918380 x1876568427246080/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789635256 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635240.998218:0:9890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447918380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9890:1876568427246080:0@lo:700: 00010000:00010000:1.0:1789635241.000200:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635241.005168:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789635241.005192:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447918380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427247744:0@lo:13: 00000100:00100000:0.0:1789635241.005254:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635241.005301:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427247744 00000100:00100000:0.0:1789635241.005310:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427247744 00000100:00100000:0.0:1789635241.005356:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789635241.005366:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044791b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427247744:12345-0@lo:13: 00002000:00000024:0.0:1789635241.005394:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1789635241.005436:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044791b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427247744:12345-0@lo:13: Request processed in 72us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635241.005443:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789635241.005483:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447918380 x1876568427247744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635257 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635241.005512:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447918380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427247744:0@lo:13: 00000004:00080000:0.0:1789635241.005532:0:9890:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789635241.005551:0:9890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447918380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9890:1876568427247872:0@lo:7: 00000100:00100000:0.0:1789635241.005576:0:9890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635241.005613:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427247872 00000100:00100000:0.0:1789635241.005617:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427247872 00000100:00100000:0.0:1789635241.005641:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789635241.005647:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044791ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9890:x1876568427247872:12345-0@lo:7: 00000100:00100000:1.0:1789635241.007057:0:9890:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446ce0d80 going to sleep for 11 seconds 00002000:00080000:0.0:1789635241.017225:0:8431:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1789635241.017235:0:8431:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789635241.017333:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044791ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9890:x1876568427247872:12345-0@lo:7: Request processed in 11681us (11751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635241.017344:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789635241.017438:0:9890:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447918380 x1876568427247872/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789635257 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635241.017454:0:9890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447918380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9890:1876568427247872:0@lo:7: 00000004:00080000:3.0:1789635241.017469:0:9890:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789635241.017507:0:9890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e017100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9890:1876568427248000:0@lo:5: 00000100:00100000:3.0:1789635241.017543:0:9890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635241.017573:0:9890:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d04477df0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635241.019159:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427248000 00000100:00100000:0.0:1789635241.019169:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427248000 00000100:00100000:0.0:1789635241.019224:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789635241.019234:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9890:x1876568427248000:12345-0@lo:5: 00002000:00080000:0.0:1789635241.019262:0:8430:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1789635241.019318:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9890:x1876568427248000:12345-0@lo:5: Request processed in 86us (1776us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635241.019325:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1789635241.019359:0:9890:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d056e017100 x1876568427248000/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789635257 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635241.019372:0:9890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e017100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9890:1876568427248000:0@lo:5: 00000004:00080000:0.0:1789635241.019382:0:9890:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789635241.019422:0:9890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447918a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9890:1876568427248128:0@lo:5: 00000100:00100000:0.0:1789635241.019449:0:9890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635241.019469:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427248128 00000100:00100000:0.0:1789635241.019472:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427248128 00000100:00100000:0.0:1789635241.019490:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789635241.019495:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9890:x1876568427248128:12345-0@lo:5: 00002000:00080000:0.0:1789635241.019515:0:8431:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:0.0:1789635241.021825:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9890:x1876568427248128:12345-0@lo:5: Request processed in 2323us (2369us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789635241.021836:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789635241.021937:0:9890:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0575963a80 going to sleep for 11 seconds 00010000:00080000:0.0:1789635241.024005:0:9890:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447918a80 x1876568427248128/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789635257 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635241.024023:0:9890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447918a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9890:1876568427248128:0@lo:5: 00000004:00080000:0.0:1789635241.024040:0:9890:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1789635241.024080:0:9890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044791aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9890:1876568427248256:0@lo:900: 00000100:00100000:0.0:1789635241.024131:0:9890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635241.024170:0:9890:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0575963a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789635241.024330:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427248256 00000100:00100000:1.0:1789635241.024337:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427248256 00000100:00100000:1.0:1789635241.024389:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789635241.024399:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9890:x1876568427248256:12345-0@lo:900: 00000100:00100000:1.0:1789635241.024453:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9890:x1876568427248256:12345-0@lo:900: Request processed in 56us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635241.024460:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789635241.024533:0:9890:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d044791aa00 x1876568427248256/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789635257 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635241.024542:0:9890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044791aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9890:1876568427248256:0@lo:900: 00000040:00080000:0.0:1789635241.030211:0:9894:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789635241.030218:0:9894:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789635241.030822:0:9893:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789635241.030833:0:9893:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789635241.030905:0:9893:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789635241.031009:0:9893:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb0c3a59caa40eeb1 00000100:00080000:0.0:1789635241.031021:0:9893:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789635241.031032:0:9893:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d057603f000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1789635241.031067:0:9893:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d044791aa00 x1876568427248384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789635241.031089:0:9893:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789635241.031146:0:9893:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635241.031151:0:9893:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635241.031153:0:9893:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789635241.031156:0:9893:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789635241.031159:0:9893:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635241.031161:0:9893:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789635241.031164:0:9893:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789635241.031165:0:9893:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789635241.031189:0:9893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044791a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:9893:1876568427248512:0@lo:502: 00000100:00100000:0.0:1789635241.031259:0:9893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635241.031299:0:9893:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05506473c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635241.031319:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044791aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427248384:0@lo:8: 00000100:00100000:0.0:1789635241.031345:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635241.031520:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427248384 00000100:00100000:3.0:1789635241.031527:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427248384 00000100:00100000:3.0:1789635241.031564:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789635241.031571:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e017100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3639:x1876568427248384:12345-0@lo:8: 00010000:00080000:3.0:1789635241.031616:0:8432:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:3.0:1789635241.031639:0:8432:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb0c3a59caa40eeb8 00002000:00100000:3.0:1789635241.031652:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d0447837000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789635241.031665:0:8432:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1789635241.031668:0:8432:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789635241.031740:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789635241.031763:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8d0447833800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789635241.031815:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e017100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1876568427248384:12345-0@lo:8: Request processed in 242us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635241.031822:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789635241.031875:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d044791aa00 x1876568427248384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789635251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635241.031885:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789635241.031892:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789635241.031898:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789635241.031903:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789635241.031905:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d057603f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789635241.031922:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789635241.031928:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044791aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427248384:0@lo:8: 00000004:00080000:0.0:1789635241.033088:0:9894:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789635241.033144:0:9894:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 259716547308ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789635241.033151:0:9894:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1789635241.036704:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427248512 00000100:00100000:2.0:1789635241.036718:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427248512 00000100:00100000:2.0:1789635241.036778:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789635241.036788:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+23:9893:x1876568427248512:12345-0@lo:502: 00000100:00100000:2.0:1789635241.037801:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+23:9893:x1876568427248512:12345-0@lo:502: Request processed in 1010us (6538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635241.037811:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789635241.038540:0:9893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044791a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:9893:1876568427248512:0@lo:502: 00000020:01000000:0.0:1789635241.038582:0:9893:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635241.038589:0:9893:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635241.038591:0:9893:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789635241.038613:0:9893:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:1.0:1789635241.038785:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:1.0:1789635241.038815:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789635241.038825:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2400/0xb0c3a59caa40ee95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ee9c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635241.038836:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2400/0xb0c3a59caa40ee95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ee9c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635241.038847:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789635241.038849:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d057ae4b380 from 1 10000000:01000000:1.0:1789635241.038852:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789635241.038897:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d058214a200/0xb0c3a59caa40eebf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635241.038906:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d058214a200/0xb0c3a59caa40eebf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635241.039187:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d058214a200/0xb0c3a59caa40eebf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635241.039210:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575adaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427248640:0@lo:101: 00000100:00100000:1.0:1789635241.039261:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635241.039296:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446c53540 going to sleep for 11 seconds 00000100:00100000:1.0:1789635241.039315:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427248640 00000100:00100000:1.0:1789635241.039322:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427248640 00000100:00100000:1.0:1789635241.039557:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789635241.039567:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+23:6512:x1876568427248640:12345-0@lo:101: 00010000:00010000:1.0:1789635241.039581:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635241.039614:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d058214a400/0xb0c3a59caa40eec6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40eebf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635241.039650:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d058214a400/0xb0c3a59caa40eec6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40eebf expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635241.039660:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d058214a400/0xb0c3a59caa40eec6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40eebf expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635241.039669:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d058214a400, rc 0) 00000100:00100000:1.0:1789635241.039705:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+24:6512:x1876568427248640:12345-0@lo:101: Request processed in 140us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635241.039711:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000004:00080000:3.0:1789635241.045059:0:6493:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1789635241.045164:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044791a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427248768:0@lo:13: 00000100:00100000:3.0:1789635241.045226:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1789635241.045271:0:9895:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789635241.045293:0:9895:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d057b59a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9895:1876568427248896:0@lo:7: 00000100:00100000:3.0:1789635241.045315:0:9895:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635241.045328:0:9895:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d04477dfc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789635241.045423:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427248768 00000100:00100000:0.0:1789635241.045441:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427248768 00000100:00100000:0.0:1789635241.045497:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789635241.045505:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044791aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1876568427248768:12345-0@lo:13: 00002000:00000024:0.0:1789635241.045524:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:0.0:1789635241.045563:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044791aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1876568427248768:12345-0@lo:13: Request processed in 58us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635241.045569:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789635241.045589:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427248896 00000100:00100000:0.0:1789635241.045592:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427248896 00000100:00100000:0.0:1789635241.045634:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789635241.045640:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9895:x1876568427248896:12345-0@lo:7: 00000100:00080000:3.0:1789635241.046065:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789635241.047686:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d044791a300 x1876568427248768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635257 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635241.047721:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044791a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427248768:0@lo:13: 00000100:00100000:1.0:1789635241.052135:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575adaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427248640:0@lo:101: 00010000:00010000:1.0:1789635241.052166:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d058214a200/0xb0c3a59caa40eebf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40eec6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635241.052180:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d058214a200/0xb0c3a59caa40eebf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40eec6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635241.052257:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575adaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427249024:0@lo:501: 00000100:00100000:1.0:1789635241.052318:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1789635241.053095:0:8430:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1789635241.053103:0:8430:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789635241.053169:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9895:x1876568427248896:12345-0@lo:7: Request processed in 7527us (7851us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635241.053178:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1789635241.053227:0:9895:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d057b59a680 x1876568427248896/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789635257 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635241.053240:0:9895:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d057b59a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9895:1876568427248896:0@lo:7: 00000004:00080000:0.0:1789635241.053251:0:9895:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789635241.053277:0:9895:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9895:1876568427249152:0@lo:5: 00000100:00100000:0.0:1789635241.053304:0:9895:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635241.053334:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427249152 00000100:00100000:0.0:1789635241.053341:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427249152 00000100:00100000:0.0:1789635241.053376:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789635241.053384:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9895:x1876568427249152:12345-0@lo:5: 00002000:00080000:0.0:1789635241.053407:0:8431:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789635241.053417:0:8431:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789635241.054321:0:9895:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0565a28d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789635241.056097:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446c53540 going to sleep for 11 seconds 00000100:00100000:3.0:1789635241.057289:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427249024 00000100:00100000:3.0:1789635241.057301:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427249024 00000001:00080000:1.0:1789635241.058965:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00100000:1.0:1789635241.058981:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789635241.058986:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:0.0:1789635241.059492:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9895:x1876568427249152:12345-0@lo:5: Request processed in 6105us (6184us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789635241.059502:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789635241.060121:0:9895:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05759d0e00 x1876568427249152/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789635257 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635241.060133:0:9895:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789635241.060139:0:9895:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9895:1876568427249152:0@lo:5: 00000004:00080000:3.0:1789635241.060154:0:9895:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789635241.060202:0:9895:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d057b59a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9895:1876568427249280:0@lo:700: 00000100:00100000:3.0:1789635241.060236:0:9895:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635241.060273:0:9895:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d04477df480 going to sleep for 11 seconds 00000100:00100000:1.0:1789635241.060322:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427249280 00000100:00100000:1.0:1789635241.060329:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427249280 00000100:00100000:1.0:1789635241.060381:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789635241.060390:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044791a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9895:x1876568427249280:12345-0@lo:700: 00000100:00100000:0.0:1789635241.066980:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789635241.066997:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:6512:x1876568427249024:12345-0@lo:501: 00000100:00100000:0.0:1789635241.067135:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:6512:x1876568427249024:12345-0@lo:501: Request processed in 144us (14817us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789635241.067142:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789635241.067254:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575adaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427249024:0@lo:501: 10000000:01000000:2.0:1789635241.067293:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789635241.067303:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d058214a200/0xb0c3a59caa40eebf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40eec6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635241.067314:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d058214a200/0xb0c3a59caa40eebf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40eec6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635241.072738:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044791a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9895:x1876568427249280:12345-0@lo:700: Request processed in 12341us (12493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635241.072753:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789635241.072806:0:9895:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d057b59a680 x1876568427249280/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789635257 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635241.073497:0:9895:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d057b59a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9895:1876568427249280:0@lo:700: 00000004:02000040:2.0:1789635241.080938:0:9895:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:2.0:1789635241.086721:0:9895:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9895:1876568427249408:0@lo:5: 00000100:00100000:2.0:1789635241.086793:0:9895:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635241.088290:0:9895:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05463dd180 going to sleep for 11 seconds 00000100:00100000:0.0:1789635241.089269:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427249408 00000100:00100000:0.0:1789635241.089280:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427249408 00000100:00100000:0.0:1789635241.089337:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789635241.089347:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9895:x1876568427249408:12345-0@lo:5: 00002000:00080000:0.0:1789635241.096296:0:8432:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1789635241.096315:0:8432:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1789635241.098200:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9895:x1876568427249408:12345-0@lo:5: Request processed in 8850us (11402us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789635241.098211:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1789635241.098314:0:9895:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05759c8700 x1876568427249408/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789635257 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635241.098331:0:9895:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9895:1876568427249408:0@lo:5: 00000004:00080000:3.0:1789635241.098345:0:9895:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000020:00000004:0.0:1789635241.609286:0:9932:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789635241.615405:0:9932:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789635242.019805:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635242.403842:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789635242.404825:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427249536:0@lo:13: 00000100:00100000:0.0:1789635242.404907:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635242.405001:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427249536 00000100:00100000:1.0:1789635242.405010:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427249536 00000100:00100000:1.0:1789635242.405110:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789635242.405120:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427249536:12345-0@lo:13: 00002000:00000024:1.0:1789635242.405147:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789635242.405201:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427249536:12345-0@lo:13: Request processed in 83us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635242.405208:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1789635242.405391:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0575ad8a80 x1876568427249536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635242.405408:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427249536:0@lo:13: 00000100:00080000:3.0:1789635242.409224:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789635242.535106:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:2.0:1789635242.915905:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427249664:0@lo:13: 00000100:00100000:2.0:1789635242.915975:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635242.916207:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427249664 00000100:00100000:0.0:1789635242.916216:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427249664 00000100:00080000:3.0:1789635242.916257:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789635242.916285:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789635242.916296:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427249664:12345-0@lo:13: 00002000:00000024:0.0:1789635242.916318:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635242.916367:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427249664:12345-0@lo:13: Request processed in 73us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635242.916373:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1789635242.916398:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05446f7480 x1876568427249664/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635242.916414:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427249664:0@lo:13: 00010000:00010000:3.0:1789635243.044376:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635244.067867:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789635244.384364:0:10033:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789635244.384694:0:10033:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789635244.451705:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789635244.451730:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427249920:0@lo:41: 00000100:00100000:2.0:1789635244.451797:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635244.451864:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427249792:0@lo:41: 00000100:00100000:2.0:1789635244.451899:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635244.452037:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427249920 00000100:00100000:1.0:1789635244.452038:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427249792 00000100:00100000:0.0:1789635244.452045:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427249920 00000100:00100000:1.0:1789635244.452054:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427249792 00000100:00100000:1.0:1789635244.452097:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789635244.452108:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427249792:12345-0@lo:41: 00000004:00000024:1.0:1789635244.452141:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789635244.452189:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427249792:12345-0@lo:41: Request processed in 83us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635244.452196:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789635244.452212:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789635244.452219:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427249920:12345-0@lo:41: 00000004:00000024:1.0:1789635244.452235:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789635244.452270:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427249920:12345-0@lo:41: Request processed in 52us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635244.452276:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789635244.456713:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427249920:0@lo:41: 00000100:00100000:3.0:1789635244.456729:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427249792:0@lo:41: 00000020:00000004:1.0:1789635245.042101:0:10081:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789635245.042112:0:10081:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1789635245.091935:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635246.119300:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635246.499871:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427250304:0@lo:400: 00000100:00100000:1.0:1789635246.499879:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427250048:0@lo:13: 00000100:00100000:1.0:1789635246.500118:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635246.500166:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427250560:0@lo:400: 00000100:00100000:1.0:1789635246.500190:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635246.500212:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427251072:0@lo:400: 00000100:00100000:1.0:1789635246.500232:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635246.500248:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789635246.500253:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427250176:0@lo:13: 00000100:00100000:1.0:1789635246.500270:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635246.500283:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427250688:0@lo:400: 00000100:00100000:1.0:1789635246.500298:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635246.500325:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876568427250432:0@lo:400: 00000100:00100000:1.0:1789635246.500343:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635246.500355:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1876568427250944:0@lo:400: 00000100:00100000:1.0:1789635246.500369:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635246.500382:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789635246.500399:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876568427250816:0@lo:400: 00000100:00100000:1.0:1789635246.500418:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635246.500441:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427250048 00000100:00100000:1.0:1789635246.500447:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427250048 00000100:00100000:1.0:1789635246.500493:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427250176 00000100:00100000:1.0:1789635246.500506:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427250176 00000100:00100000:1.0:1789635246.500523:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789635246.500530:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427250048:12345-0@lo:13: 00002000:00000024:1.0:1789635246.500556:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789635246.500638:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427250048:12345-0@lo:13: Request processed in 107us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635246.500644:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789635246.500659:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789635246.502148:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427250176:12345-0@lo:13: 00002000:00000024:1.0:1789635246.502174:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789635246.502227:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427250176:12345-0@lo:13: Request processed in 1562us (1954us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635246.502235:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789635246.502269:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427250560 00000100:00100000:1.0:1789635246.502275:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427250560 00000100:00100000:1.0:1789635246.502305:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427250688 00000100:00100000:1.0:1789635246.502307:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427250688 00000100:00100000:1.0:1789635246.502318:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789635246.502325:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427250560:12345-0@lo:400: 00000100:00100000:1.0:1789635246.502355:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427250560:12345-0@lo:400: Request processed in 31us (2165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635246.502361:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789635246.502370:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789635246.502374:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575adb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427250688:12345-0@lo:400: 00000100:00100000:1.0:1789635246.503273:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575adb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427250688:12345-0@lo:400: Request processed in 896us (2971us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635246.503281:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1789635246.503348:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04459ea680 x1876568427250176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635262 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635246.503359:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1789635246.503379:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427250176:0@lo:13: 00000100:00100000:1.0:1789635246.503738:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427250688:0@lo:400: 00010000:00080000:1.0:1789635246.503753:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05446f7480 x1876568427250048/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635262 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635246.503760:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789635246.503774:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427250048:0@lo:13: 00000100:00100000:1.0:1789635246.503785:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427250560:0@lo:400: 00000100:00100000:1.0:1789635246.503846:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427251072 00000100:00100000:1.0:1789635246.503851:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427251072 00000100:00100000:1.0:1789635246.503876:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427250432 00000100:00100000:1.0:1789635246.503879:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427250432 00000100:00100000:1.0:1789635246.503889:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427250944 00000100:00100000:1.0:1789635246.503891:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427250944 00000100:00100000:1.0:1789635246.503900:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427250816 00000100:00100000:1.0:1789635246.503902:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427250816 00000100:00100000:1.0:1789635246.503912:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789635246.503918:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427251072:12345-0@lo:400: 00000100:00100000:1.0:1789635246.503963:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427251072:12345-0@lo:400: Request processed in 46us (3730us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635246.503969:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789635246.503980:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789635246.503985:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876568427250432:12345-0@lo:400: 00000100:00100000:1.0:1789635246.504009:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876568427250432:12345-0@lo:400: Request processed in 25us (3665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635246.504021:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789635246.504041:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789635246.504053:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575adaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876568427250944:12345-0@lo:400: 00000100:00100000:1.0:1789635246.504078:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575adaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876568427250944:12345-0@lo:400: Request processed in 32us (3708us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635246.504083:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789635246.504092:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789635246.504098:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876568427250816:12345-0@lo:400: 00000100:00100000:1.0:1789635246.504120:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876568427250816:12345-0@lo:400: Request processed in 23us (3702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635246.504125:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1789635246.504149:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05759cb480 x1876568427250816/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635246.504159:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876568427250816:0@lo:400: 00010000:00080000:1.0:1789635246.504169:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05759caa00 x1876568427250432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635246.504177:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876568427250432:0@lo:400: 00010000:00080000:1.0:1789635246.504185:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05759ca300 x1876568427250944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635246.504192:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1876568427250944:0@lo:400: 00010000:00080000:1.0:1789635246.504214:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05759c8e00 x1876568427251072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635246.504221:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427251072:0@lo:400: 00000100:00080000:1.0:1789635246.504280:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789635246.504284:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789635246.504286:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789635246.505951:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635246.506166:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427250304 00000100:00100000:1.0:1789635246.506174:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427250304 00000100:00100000:1.0:1789635246.506226:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789635246.506235:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3640:x1876568427250304:12345-0@lo:400: 00000100:00100000:1.0:1789635246.506297:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3640:x1876568427250304:12345-0@lo:400: Request processed in 63us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635246.506304:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789635246.506544:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427250304:0@lo:400: 00000100:00100000:2.0:1789635246.510779:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1876568427251456:0@lo:400: 00000100:00100000:2.0:1789635246.510863:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635246.510905:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789635246.510911:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427251328:0@lo:400: 00000100:00100000:2.0:1789635246.510936:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635246.510965:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427251456 00000100:00100000:2.0:1789635246.510973:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427251456 00000100:00100000:2.0:1789635246.511030:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789635246.511039:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876568427251456:12345-0@lo:400: 00000100:00100000:2.0:1789635246.511087:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876568427251456:12345-0@lo:400: Request processed in 49us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635246.511093:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1789635246.511114:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789635246.511137:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05759c8e00 x1876568427251456/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635246.511150:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1876568427251456:0@lo:400: 00000100:00100000:1.0:1789635246.511241:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427251200:0@lo:400: 00000100:00100000:1.0:1789635246.511272:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635246.511302:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789635246.511308:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1876568427251584:0@lo:400: 00000100:00100000:1.0:1789635246.511354:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635246.511384:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427251584 00000100:00100000:1.0:1789635246.511388:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427251584 00000100:00100000:1.0:1789635246.511420:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789635246.511427:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575adad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876568427251584:12345-0@lo:400: 00000100:00100000:1.0:1789635246.511464:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575adad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876568427251584:12345-0@lo:400: Request processed in 37us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635246.511540:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1789635246.511572:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05759ca300 x1876568427251584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635246.511582:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1876568427251584:0@lo:400: 00000100:00100000:0.0:1789635246.511726:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427251328 00000100:00100000:0.0:1789635246.511730:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427251328 00000100:00100000:0.0:1789635246.511767:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427251200 00000100:00100000:0.0:1789635246.511770:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427251200 00000100:00100000:0.0:1789635246.511787:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789635246.511794:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427251328:12345-0@lo:400: 00000100:00100000:0.0:1789635246.511854:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427251328:12345-0@lo:400: Request processed in 61us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635246.511860:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789635246.511873:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789635246.511880:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575adb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427251200:12345-0@lo:400: 00000100:00100000:0.0:1789635246.511915:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575adb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427251200:12345-0@lo:400: Request processed in 35us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635246.511930:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1789635246.511956:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05759c8000 x1876568427251200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635246.511964:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427251200:0@lo:400: 00010000:00080000:3.0:1789635246.512038:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05759cad80 x1876568427251328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635246.512047:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427251328:0@lo:400: 00000100:00080000:2.0:1789635246.512214:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789635246.512224:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789635246.588449:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635246.588789:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411472256 00000100:00100000:3.0:1789635246.588802:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411472256 00000100:00100000:3.0:1789635246.588870:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 181 00000100:00100000:3.0:1789635246.588891:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2395:x1876568411472256:12345-192.168.203.20@tcp:250: 00010000:00080000:3.0:1789635246.588937:0:6509:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from fd20b267-9db1-4540-8a6a-0af57c4f3581@192.168.203.20@tcp t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:3.0:1789635246.588976:0:6509:0:(genops.c:1384:class_connect()) connect: client fd20b267-9db1-4540-8a6a-0af57c4f3581, cookie 0xb0c3a59caa40eecd 00000100:00080000:3.0:1789635246.589143:0:6509:0:(import.c:65:import_set_state_nolock()) ffff8d0447832000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789635246.589228:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+5:2395:x1876568411472256:12345-192.168.203.20@tcp:250: Request processed in 338us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635246.589236:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 181 00000100:00100000:0.0:1789635246.595403:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635246.595525:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411472128 00000100:00100000:1.0:1789635246.595556:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411472128 00000100:00100000:1.0:1789635246.595678:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 182 00000100:00100000:1.0:1789635246.595691:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054645ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+5:6151:x1876568411472128:12345-192.168.203.20@tcp:101: 00010000:00010000:1.0:1789635246.595714:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635246.595738:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d058214b400/0xb0c3a59caa40eed4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73e62 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635246.595776:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d058214b400/0xb0c3a59caa40eed4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73e62 expref: 6 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635246.595789:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d058214b400/0xb0c3a59caa40eed4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73e62 expref: 6 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635246.595802:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d058214b400, rc 0) 00000100:00100000:1.0:1789635246.595889:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054645ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+6:6151:x1876568411472128:12345-192.168.203.20@tcp:101: Request processed in 199us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635246.595906:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 182 00000100:00100000:1.0:1789635246.603751:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635246.603934:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411472384 00000100:00100000:3.0:1789635246.603948:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411472384 00000100:00100000:3.0:1789635246.604017:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 183 00000100:00100000:3.0:1789635246.604028:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546459850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+6:6151:x1876568411472384:12345-192.168.203.20@tcp:501: 00000100:00100000:3.0:1789635246.604186:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546459850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+6:6151:x1876568411472384:12345-192.168.203.20@tcp:501: Request processed in 159us (449us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789635246.604195:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 183 00000100:00100000:3.0:1789635246.606573:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635246.606986:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411472512 00000100:00100000:2.0:1789635246.606999:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411472512 00000100:00100000:2.0:1789635246.607069:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 184 00000100:00100000:2.0:1789635246.607082:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054645b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+6:6151:x1876568411472512:12345-192.168.203.20@tcp:101: 00010000:00010000:2.0:1789635246.607104:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635246.607130:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa40eedb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73e69 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635246.607167:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa40eedb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73e69 expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635246.607181:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa40eedb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73e69 expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635246.607192:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a2800, rc 0) 00000100:00100000:2.0:1789635246.607274:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054645b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+7:6151:x1876568411472512:12345-192.168.203.20@tcp:101: Request processed in 195us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635246.607281:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 184 00000100:00100000:0.0:1789635246.610974:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635246.611106:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411472640 00000100:00100000:1.0:1789635246.611121:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411472640 00000100:00100000:1.0:1789635246.611254:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 185 00000100:00100000:1.0:1789635246.611266:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546458850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+7:6151:x1876568411472640:12345-192.168.203.20@tcp:501: 00000100:00100000:1.0:1789635246.611888:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546458850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+8:6151:x1876568411472640:12345-192.168.203.20@tcp:501: Request processed in 612us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635246.611903:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 185 00000100:00100000:1.0:1789635246.622742:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635246.623931:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411472768 00000100:00100000:3.0:1789635246.623961:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411472768 00000100:00100000:3.0:1789635246.624050:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 186 00000100:00100000:3.0:1789635246.624081:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054645bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+8:6151:x1876568411472768:12345-192.168.203.20@tcp:503: 00000100:00100000:3.0:1789635246.624288:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054645bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+8:6151:x1876568411472768:12345-192.168.203.20@tcp:503: Request processed in 208us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635246.624298:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 186 00000100:00100000:3.0:1789635246.629074:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635246.629420:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411472896 00000100:00100000:1.0:1789635246.629437:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411472896 00000100:00100000:1.0:1789635246.629533:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 187 00000100:00100000:1.0:1789635246.629545:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546459450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+8:6170:x1876568411472896:12345-192.168.203.20@tcp:502: 00000100:00100000:1.0:1789635246.629753:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546459450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+8:6170:x1876568411472896:12345-192.168.203.20@tcp:502: Request processed in 210us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635246.629762:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 187 00000100:00100000:0.0:1789635246.672315:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635246.672481:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411473024 00000100:00100000:2.0:1789635246.672495:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411473024 00000100:00100000:2.0:1789635246.672717:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 188 00000100:00100000:2.0:1789635246.672730:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546459050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+8:6170:x1876568411473024:12345-192.168.203.20@tcp:502: 00000100:00100000:2.0:1789635246.672962:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546459050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+8:6170:x1876568411473024:12345-192.168.203.20@tcp:502: Request processed in 235us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635246.672971:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 188 00000100:00100000:3.0:1789635246.678401:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635246.686966:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411473152 00000100:00100000:1.0:1789635246.686988:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411473152 00000100:00100000:1.0:1789635246.687080:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 189 00000100:00100000:1.0:1789635246.687093:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054645b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+8:6151:x1876568411473152:12345-192.168.203.20@tcp:101: 00010000:00010000:1.0:1789635246.687115:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635246.687140:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d058214b800/0xb0c3a59caa40eee2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73e9a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635246.687179:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d058214b800/0xb0c3a59caa40eee2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73e9a expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635246.687193:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d058214b800/0xb0c3a59caa40eee2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73e9a expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635246.687203:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d058214b800, rc 0) 00000100:00100000:1.0:1789635246.687293:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054645b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+9:6151:x1876568411473152:12345-192.168.203.20@tcp:101: Request processed in 202us (8907us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635246.687300:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 189 00000100:00100000:3.0:1789635246.693471:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635246.696073:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411473280 00000100:00100000:1.0:1789635246.696096:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411473280 00000100:00100000:1.0:1789635246.696202:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 190 00000100:00100000:1.0:1789635246.696216:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054645a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+9:6151:x1876568411473280:12345-192.168.203.20@tcp:256: 20000000:01000000:1.0:1789635246.696278:0:6508:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789635246.696304:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789635246.696308:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789635246.696311:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789635246.696314:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789635246.696317:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1789635246.698407:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054645a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+9:6151:x1876568411473280:12345-192.168.203.20@tcp:256: Request processed in 2177us (4934us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635246.698425:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 190 00000100:00100000:2.0:1789635246.704442:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635246.704559:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411473408 00000100:00100000:0.0:1789635246.704575:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411473408 00000100:00100000:0.0:1789635246.704699:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 191 00000100:00100000:0.0:1789635246.704711:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054645a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+9:6151:x1876568411473408:12345-192.168.203.20@tcp:101: 00010000:00010000:0.0:1789635246.704736:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635246.705072:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056f6e9a00/0xb0c3a59caa40eee9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73ea1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635246.705119:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056f6e9a00/0xb0c3a59caa40eee9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ea1 expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635246.705136:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056f6e9a00/0xb0c3a59caa40eee9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ea1 expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635246.705148:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056f6e9a00, rc 0) 00000100:00100000:0.0:1789635246.705358:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054645a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:6151:x1876568411473408:12345-192.168.203.20@tcp:101: Request processed in 647us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635246.705366:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 191 00000100:00100000:3.0:1789635246.708156:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635246.708808:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411473536 00000100:00100000:1.0:1789635246.708832:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411473536 00000100:00100000:1.0:1789635246.708928:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 192 00000100:00100000:1.0:1789635246.708939:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0565a0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:6151:x1876568411473536:12345-192.168.203.20@tcp:501: 00000100:00100000:1.0:1789635246.709166:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0565a0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:6151:x1876568411473536:12345-192.168.203.20@tcp:501: Request processed in 227us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635246.709176:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 192 00000100:00100000:1.0:1789635246.712182:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635246.712381:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411473664 00000100:00100000:0.0:1789635246.712395:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411473664 00000100:00100000:0.0:1789635246.712482:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 193 00000100:00100000:0.0:1789635246.712495:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0565a08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:6151:x1876568411473664:12345-192.168.203.20@tcp:503: 00000100:00100000:0.0:1789635246.713126:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0565a08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:6151:x1876568411473664:12345-192.168.203.20@tcp:503: Request processed in 630us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635246.713136:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 193 00000100:00100000:3.0:1789635246.717394:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635246.717484:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411473792 00000100:00100000:1.0:1789635246.717497:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411473792 00000100:00100000:1.0:1789635246.717567:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 194 00000100:00100000:1.0:1789635246.717580:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0565a0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:6175:x1876568411473792:12345-192.168.203.20@tcp:502: 00000100:00100000:1.0:1789635246.718244:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0565a0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:6175:x1876568411473792:12345-192.168.203.20@tcp:502: Request processed in 663us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635246.718254:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 194 00000100:00100000:3.0:1789635246.721108:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635246.723924:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411473920 00000100:00100000:0.0:1789635246.723948:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411473920 00000100:00100000:0.0:1789635246.724048:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 195 00000100:00100000:0.0:1789635246.724061:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0565a09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:6175:x1876568411473920:12345-192.168.203.20@tcp:502: 00000100:00100000:0.0:1789635246.724283:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0565a09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:6175:x1876568411473920:12345-192.168.203.20@tcp:502: Request processed in 223us (3188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635246.724292:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 195 00000100:00100000:2.0:1789635246.730307:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635246.730397:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635246.730492:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411474048 00000100:00100000:1.0:1789635246.730505:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411474048 00000100:00100000:1.0:1789635246.730559:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411474304 00000100:00100000:1.0:1789635246.730569:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411474304 00000100:00100000:1.0:1789635246.730643:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:1.0:1789635246.730654:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2395:x1876568411474048:12345-192.168.203.20@tcp:38: 00010000:00080000:1.0:1789635246.730698:0:6514:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 6e1c17f2-a595-4ed0-97c8-b9260d0850ab@192.168.203.20@tcp t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:1.0:1789635246.730778:0:6514:0:(genops.c:1384:class_connect()) connect: client 6e1c17f2-a595-4ed0-97c8-b9260d0850ab, cookie 0xb0c3a59caa40eef0 00000004:00100000:1.0:1789635246.730822:0:6514:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789635246.731114:0:6514:0:(import.c:65:import_set_state_nolock()) ffff8d057603b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789635246.731206:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2395:x1876568411474048:12345-192.168.203.20@tcp:38: Request processed in 552us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635246.731213:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:1.0:1789635246.731236:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:1.0:1789635246.731241:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2395:x1876568411474304:12345-192.168.203.20@tcp:38: 00010000:00080000:1.0:1789635246.731260:0:6514:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 6e1c17f2-a595-4ed0-97c8-b9260d0850ab@192.168.203.20@tcp t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:1.0:1789635246.731295:0:6514:0:(genops.c:1384:class_connect()) connect: client 6e1c17f2-a595-4ed0-97c8-b9260d0850ab, cookie 0xb0c3a59caa40eef7 00000004:00100000:1.0:1789635246.731310:0:6514:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789635246.731484:0:6514:0:(import.c:65:import_set_state_nolock()) ffff8d0576039000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789635246.731510:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2395:x1876568411474304:12345-192.168.203.20@tcp:38: Request processed in 268us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635246.731517:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 8 00010000:00010000:0.0:1789635247.140749:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635247.525149:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789635247.525180:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427251712:0@lo:13: 00000100:00100000:2.0:1789635247.525270:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635247.525366:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427251712 00000100:00100000:1.0:1789635247.525376:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427251712 00000100:00100000:1.0:1789635247.525451:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789635247.525464:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427251712:12345-0@lo:13: 00002000:00000024:1.0:1789635247.525503:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789635247.525821:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427251712:12345-0@lo:13: Request processed in 358us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635247.525850:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789635247.527580:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0575ad9f80 x1876568427251712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635247.527650:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427251712:0@lo:13: 00000100:00100000:2.0:1789635247.746389:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635247.746530:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635247.746568:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635247.754352:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411474432 00000100:00100000:3.0:1789635247.754376:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411474432 00000100:00100000:3.0:1789635247.754490:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411474176 00000100:00100000:3.0:1789635247.754494:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411474176 00000100:00100000:3.0:1789635247.754520:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411474560 00000100:00100000:3.0:1789635247.754523:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411474560 00000100:00100000:3.0:1789635247.754551:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:3.0:1789635247.754560:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:0:x1876568411474432:12345-192.168.203.20@tcp:41: 00000004:00000024:3.0:1789635247.754615:0:9526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00080000:0.0:1789635247.754878:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789635247.754883:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789635247.754935:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:0.0:1789635247.754945:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:0:x1876568411474176:12345-192.168.203.20@tcp:41: 00000004:00000024:0.0:1789635247.754979:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789635247.755150:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:0:x1876568411474432:12345-192.168.203.20@tcp:41: Request processed in 590us (8776us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635247.755165:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:3.0:1789635247.755197:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:3.0:1789635247.755205:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:6151:x1876568411474560:12345-192.168.203.20@tcp:41: 00000004:00000024:3.0:1789635247.755262:0:9526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789635247.756092:0:6514:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1789635247.756116:0:6514:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1789635247.760126:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:0:x1876568411474176:12345-192.168.203.20@tcp:41: Request processed in 5172us (13584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635247.760142:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:3.0:1789635247.760792:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:6151:x1876568411474560:12345-192.168.203.20@tcp:41: Request processed in 5585us (14220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635247.760874:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:2.0:1789635247.766961:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635247.767658:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411474688 00000100:00100000:1.0:1789635247.767678:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411474688 00000100:00100000:1.0:1789635247.767781:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:1.0:1789635247.767797:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:6151:x1876568411474688:12345-192.168.203.20@tcp:40: 00000100:00100000:1.0:1789635247.767946:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:6151:x1876568411474688:12345-192.168.203.20@tcp:40: Request processed in 154us (1272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635247.767955:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:2.0:1789635247.778159:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635247.778278:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411475200 00000100:00100000:1.0:1789635247.778297:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411475200 00000100:00100000:1.0:1789635247.778393:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 196 00000100:00100000:1.0:1789635247.778406:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0565a09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:2398:x1876568411475200:12345-192.168.203.20@tcp:400: 00000100:00100000:1.0:1789635247.778520:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0565a09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:2398:x1876568411475200:12345-192.168.203.20@tcp:400: Request processed in 116us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635247.778528:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 196 00000100:00100000:2.0:1789635247.787928:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635247.787981:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635247.788033:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635247.788211:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411475072 00000100:00100000:1.0:1789635247.788228:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411475072 00000100:00100000:1.0:1789635247.788311:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:1.0:1789635247.788323:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:6151:x1876568411475072:12345-192.168.203.20@tcp:900: 00000100:00100000:1.0:1789635247.788452:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:6151:x1876568411475072:12345-192.168.203.20@tcp:900: Request processed in 130us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635247.788461:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:0.0:1789635247.789053:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411474816 00000100:00100000:0.0:1789635247.789060:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411474816 00000100:00100000:0.0:1789635247.789091:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411474944 00000100:00100000:0.0:1789635247.789095:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411474944 00000100:00100000:0.0:1789635247.789109:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:0.0:1789635247.789116:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2395:x1876568411474816:12345-192.168.203.20@tcp:8: 00010000:00080000:0.0:1789635247.789175:0:8431:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 6e1c17f2-a595-4ed0-97c8-b9260d0850ab@192.168.203.20@tcp t0 exp 0000000000000000 cur 266 last 0 00000020:00000080:0.0:1789635247.789215:0:8431:0:(genops.c:1384:class_connect()) connect: client 6e1c17f2-a595-4ed0-97c8-b9260d0850ab, cookie 0xb0c3a59caa40eefe 00002000:00100000:0.0:1789635247.789231:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6e1c17f2-a595-4ed0-97c8-b9260d0850ab/ffff8d0446453800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789635247.789247:0:8431:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789635247.791010:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789635247.791076:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8d0446452000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789635247.791178:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2395:x1876568411474816:12345-192.168.203.20@tcp:8: Request processed in 2056us (3263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635247.791191:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:0.0:1789635247.791234:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:0.0:1789635247.791242:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2395:x1876568411474944:12345-192.168.203.20@tcp:8: 00010000:00080000:0.0:1789635247.791275:0:8431:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 6e1c17f2-a595-4ed0-97c8-b9260d0850ab@192.168.203.20@tcp t0 exp 0000000000000000 cur 266 last 0 00000020:00000080:0.0:1789635247.791309:0:8431:0:(genops.c:1384:class_connect()) connect: client 6e1c17f2-a595-4ed0-97c8-b9260d0850ab, cookie 0xb0c3a59caa40ef05 00002000:00100000:0.0:1789635247.791323:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6e1c17f2-a595-4ed0-97c8-b9260d0850ab/ffff8d0446455800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789635247.791336:0:8431:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789635247.792633:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789635247.792685:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8d0446454000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789635247.792760:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2395:x1876568411474944:12345-192.168.203.20@tcp:8: Request processed in 1515us (4776us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635247.792769:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:1.0:1789635247.797002:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635247.797360:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411475328 00000100:00100000:2.0:1789635247.797377:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411475328 00000100:00100000:2.0:1789635247.797463:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:2.0:1789635247.797476:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:6151:x1876568411475328:12345-192.168.203.20@tcp:33: 00000004:00080000:2.0:1789635247.827637:0:6517:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 29997us 00000004:00200000:0.0:1789635247.861064:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789635247.861198:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:6151:x1876568411475328:12345-192.168.203.20@tcp:33: Request processed in 63715us (64200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635247.861216:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:3.0:1789635248.036033:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427251840:0@lo:13: 00000100:00100000:3.0:1789635248.036117:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635248.039437:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427251840 00000100:00100000:1.0:1789635248.039470:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427251840 00000100:00100000:2.0:1789635248.039839:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789635248.039856:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427251840:12345-0@lo:13: 00002000:00000024:2.0:1789635248.039887:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635248.039982:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427251840:12345-0@lo:13: Request processed in 133us (3865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635248.039990:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1789635248.040082:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05446f7480 x1876568427251840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635264 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635248.040102:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427251840:0@lo:13: 00000100:00080000:0.0:1789635248.040632:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789635248.169748:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635248.228977:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635248.230055:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411475456 00000100:00100000:3.0:1789635248.230069:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411475456 00000100:00100000:3.0:1789635248.230149:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:3.0:1789635248.230161:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:6193:x1876568411475456:12345-192.168.203.20@tcp:101: 00010000:00010000:3.0:1789635248.230185:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635248.230241:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3800/0xb0c3a59caa40ef0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73ed2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635248.230308:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3200/0xb0c3a59caa40ef13 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635248.230321:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3200/0xb0c3a59caa40ef13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635248.230337:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3200/0xb0c3a59caa40ef13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635248.230387:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789635248.230405:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789635248.230423:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3200/0xb0c3a59caa40ef13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635248.230448:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3800/0xb0c3a59caa40ef0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ed2 expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635248.230467:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3200/0xb0c3a59caa40ef13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ed2 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635248.230475:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d044766d100) 00010000:00010000:3.0:1789635248.230478:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789635248.230481:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05820d3200, rc 0) 00000100:00100000:3.0:1789635248.230560:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:6193:x1876568411475456:12345-192.168.203.20@tcp:101: Request processed in 391us (1583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635248.230568:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 13 00010000:00010000:3.0:1789635249.189055:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635249.574434:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427251968:0@lo:41: 00000100:00100000:3.0:1789635249.574504:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635249.574674:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427251968 00000100:00100000:0.0:1789635249.574683:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427251968 00000100:00100000:0.0:1789635249.574736:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789635249.574746:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427251968:12345-0@lo:41: 00000004:00000024:0.0:1789635249.574780:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789635249.575988:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789635249.576079:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0446c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427252096:0@lo:41: 00000100:00100000:0.0:1789635249.576948:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427251968:12345-0@lo:41: Request processed in 2202us (2440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635249.576959:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789635249.583252:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635249.583484:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427252096 00000100:00100000:1.0:1789635249.583494:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427252096 00000100:00100000:1.0:1789635249.583726:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789635249.583737:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427252096:12345-0@lo:41: 00000004:00000024:1.0:1789635249.583773:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789635249.583917:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427252096:12345-0@lo:41: Request processed in 182us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635249.583924:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789635249.588851:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427251968:0@lo:41: 00000100:00100000:0.0:1789635249.589786:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0446c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427252096:0@lo:41: 00010000:00010000:0.0:1789635250.214082:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635250.668267:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635250.670121:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411475584 00000100:00100000:2.0:1789635250.670134:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411475584 00000100:00100000:2.0:1789635250.670223:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00100000:2.0:1789635250.670235:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:6245:x1876568411475584:12345-192.168.203.20@tcp:41: 00000004:00000024:2.0:1789635250.670269:0:9526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789635250.670339:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:6245:x1876568411475584:12345-192.168.203.20@tcp:41: Request processed in 108us (2082us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635250.670346:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00080000:0.0:1789635250.670418:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635250.674458:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635250.675108:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411475712 00000100:00100000:2.0:1789635250.675118:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411475712 00000100:00100000:2.0:1789635250.675188:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00100000:2.0:1789635250.675200:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:6245:x1876568411475712:12345-192.168.203.20@tcp:41: 00000004:00000024:2.0:1789635250.675235:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789635250.675339:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:6245:x1876568411475712:12345-192.168.203.20@tcp:41: Request processed in 142us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635250.675347:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00080000:0.0:1789635250.675410:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789635250.681159:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635250.681281:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411475840 00000100:00100000:1.0:1789635250.681292:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411475840 00000100:00100000:1.0:1789635250.681421:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:1.0:1789635250.681434:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:6245:x1876568411475840:12345-192.168.203.20@tcp:13: 00002000:00000024:1.0:1789635250.681479:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1789635250.681536:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789635250.681670:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:6245:x1876568411475840:12345-192.168.203.20@tcp:13: Request processed in 238us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635250.681678:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:1.0:1789635250.683297:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635250.683427:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411475968 00000100:00100000:2.0:1789635250.683441:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411475968 00000100:00080000:0.0:1789635250.683565:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789635250.683579:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:2.0:1789635250.683593:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b59a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:6245:x1876568411475968:12345-192.168.203.20@tcp:13: 00002000:00000024:2.0:1789635250.683667:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635250.683751:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b59a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:6245:x1876568411475968:12345-192.168.203.20@tcp:13: Request processed in 160us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635250.683760:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 17 00000001:00100000:0.0:1789635251.110006:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e1c17f2-a595-4ed0-97c8-b9260d0850ab 00010000:00010000:1.0:1789635251.237017:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635251.619953:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789635251.619992:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427252224:0@lo:13: 00000100:00100000:3.0:1789635251.620087:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635251.620169:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427252224 00000100:00100000:3.0:1789635251.620178:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427252224 00000100:00100000:3.0:1789635251.620248:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789635251.620270:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427252224:12345-0@lo:13: 00002000:00000024:3.0:1789635251.620302:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635251.620360:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427252224:12345-0@lo:13: Request processed in 93us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635251.620367:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1789635251.620394:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789635251.620432:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04459e9c00 x1876568427252224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635267 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635251.620454:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427252224:0@lo:13: 00000100:00100000:2.0:1789635251.621772:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0446c3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427252352:0@lo:13: 00000100:00100000:2.0:1789635251.621856:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635251.621943:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427252352 00000100:00100000:2.0:1789635251.621952:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427252352 00000100:00100000:2.0:1789635251.622010:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789635251.622019:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427252352:12345-0@lo:13: 00002000:00000024:2.0:1789635251.622048:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635251.622099:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427252352:12345-0@lo:13: Request processed in 81us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635251.622107:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1789635251.622151:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0446c3dc00 x1876568427252352/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635267 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635251.622170:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0446c3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427252352:0@lo:13: 00000100:00080000:3.0:1789635251.622884:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789635251.623769:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789635251.623967:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0446c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876568427252608:0@lo:400: 00000100:00100000:3.0:1789635251.624051:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635251.624093:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789635251.624099:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0441469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427252736:0@lo:400: 00000100:00100000:3.0:1789635251.624128:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635251.624166:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427252608 00000100:00100000:3.0:1789635251.624174:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427252608 00000100:00100000:3.0:1789635251.624226:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789635251.624235:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876568427252608:12345-0@lo:400: 00000100:00100000:3.0:1789635251.624299:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876568427252608:12345-0@lo:400: Request processed in 64us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635251.624305:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789635251.624332:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427252736 00000100:00100000:3.0:1789635251.624336:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427252736 00000100:00100000:3.0:1789635251.624362:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789635251.624369:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427252736:12345-0@lo:400: 00000100:00100000:3.0:1789635251.624403:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427252736:12345-0@lo:400: Request processed in 34us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635251.624419:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789635251.624476:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0441469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427252736:0@lo:400: 00000100:00100000:3.0:1789635251.624488:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0446c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876568427252608:0@lo:400: 00000100:00100000:1.0:1789635251.626412:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044146a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427252864:0@lo:400: 00000100:00100000:1.0:1789635251.626556:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635251.626640:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0446c3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427252480:0@lo:400: 00000100:00100000:1.0:1789635251.626679:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635251.626730:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427252480 00000100:00100000:1.0:1789635251.626740:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427252480 00000100:00100000:1.0:1789635251.626828:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789635251.627346:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0565a0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3640:x1876568427252480:12345-0@lo:400: 00000100:00100000:1.0:1789635251.627430:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0565a0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3640:x1876568427252480:12345-0@lo:400: Request processed in 90us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635251.627438:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789635251.627709:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0446c3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427252480:0@lo:400: 00000100:00100000:3.0:1789635251.629402:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0441468380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876568427252992:0@lo:400: 00000100:00100000:3.0:1789635251.629491:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635251.629698:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427252992 00000100:00100000:1.0:1789635251.629708:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427252992 00000100:00100000:1.0:1789635251.629785:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789635251.629796:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876568427252992:12345-0@lo:400: 00000100:00100000:1.0:1789635251.630394:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876568427252992:12345-0@lo:400: Request processed in 600us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635251.630403:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789635251.630663:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427252864 00000100:00100000:2.0:1789635251.630670:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427252864 00000100:00100000:2.0:1789635251.630727:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789635251.630737:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427252864:12345-0@lo:400: 00000100:00100000:2.0:1789635251.634332:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427252864:12345-0@lo:400: Request processed in 3582us (7762us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635251.634352:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789635251.634427:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044146a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1876568427253120:0@lo:400: 00000100:00100000:2.0:1789635251.634644:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635251.634699:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044146bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1876568427253632:0@lo:400: 00000100:00100000:2.0:1789635251.634725:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635251.634954:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789635251.634969:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0441469180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427253248:0@lo:400: 00000100:00100000:2.0:1789635251.635149:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635251.635177:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044146b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1876568427253760:0@lo:400: 00000100:00100000:0.0:1789635251.635204:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427253120 00000100:00100000:2.0:1789635251.635232:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635251.635233:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427253120 00000100:00100000:2.0:1789635251.635294:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427253632 00000100:00100000:2.0:1789635251.635304:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427253632 00000100:00100000:0.0:1789635251.635324:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427253248 00000100:00100000:0.0:1789635251.635330:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427253248 00000100:00100000:2.0:1789635251.635358:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427253760 00000100:00100000:2.0:1789635251.635366:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427253760 00000100:00100000:0.0:1789635251.635432:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789635251.635447:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0441468e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876568427253120:12345-0@lo:400: 00000100:00100000:0.0:1789635251.635539:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0441468e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876568427253120:12345-0@lo:400: Request processed in 96us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635251.636689:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789635251.636709:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0441468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876568427253632:12345-0@lo:400: 00000100:00100000:2.0:1789635251.636809:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0441468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876568427253632:12345-0@lo:400: Request processed in 110us (2083us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635251.636817:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789635251.636847:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789635251.636855:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0441469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427253248:12345-0@lo:400: 00000100:00100000:2.0:1789635251.637174:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0441469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427253248:12345-0@lo:400: Request processed in 321us (2026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635251.637181:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789635251.637198:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789635251.637206:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044146b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876568427253760:12345-0@lo:400: 00000100:00100000:2.0:1789635251.637283:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044146b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876568427253760:12345-0@lo:400: Request processed in 77us (2051us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635251.637290:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1789635251.637358:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0441469180 x1876568427253248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635251.637376:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0441469180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427253248:0@lo:400: 00010000:00080000:2.0:1789635251.637390:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d044146b800 x1876568427253760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635251.637399:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044146b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1876568427253760:0@lo:400: 00000100:00100000:2.0:1789635251.637428:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044146a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1876568427253120:0@lo:400: 00000100:00100000:2.0:1789635251.637440:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044146bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1876568427253632:0@lo:400: 00000100:00100000:0.0:1789635251.637677:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789635251.637748:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0441469500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427253376:0@lo:400: 00000100:00100000:0.0:1789635251.637831:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635251.637965:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044146a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427252864:0@lo:400: 00000100:00100000:0.0:1789635251.637999:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789635251.638008:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0441468700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427253504:0@lo:400: 00000100:00100000:0.0:1789635251.638047:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635251.638088:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427253376 00000100:00100000:0.0:1789635251.638096:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427253376 00000100:00100000:0.0:1789635251.638307:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427253504 00000100:00100000:0.0:1789635251.638313:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427253504 00000100:00100000:2.0:1789635251.638344:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789635251.638435:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05446f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427253376:12345-0@lo:400: 00000100:00100000:2.0:1789635251.638648:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05446f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427253376:12345-0@lo:400: Request processed in 293us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635251.638725:0:8432:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789635251.638735:0:8432:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1789635251.640492:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0441468380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876568427252992:0@lo:400: 00000100:00080000:3.0:1789635251.640799:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789635251.640810:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789635251.640815:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635251.641658:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789635251.641682:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427253504:12345-0@lo:400: 00000100:00100000:0.0:1789635251.642431:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427253504:12345-0@lo:400: Request processed in 104us (3725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635251.642444:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1789635251.642516:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0441468700 x1876568427253504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635251.642663:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0441468700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427253504:0@lo:400: 00010000:00080000:0.0:1789635251.642683:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0441469500 x1876568427253376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635251.642692:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0441469500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427253376:0@lo:400: 00000100:00100000:2.0:1789635251.649528:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000001:00100000:3.0:1789635252.147874:0:7446:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6e1c17f2-a595-4ed0-97c8-b9260d0850ab 00000001:00100000:2.0:1789635252.148045:0:6493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6e1c17f2-a595-4ed0-97c8-b9260d0850ab 00010000:00010000:3.0:1789635252.259888:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635252.647875:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789635252.647966:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427253888:0@lo:13: 00000100:00100000:3.0:1789635252.648035:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635252.648135:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427253888 00000100:00100000:0.0:1789635252.648143:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427253888 00000100:00100000:0.0:1789635252.648199:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789635252.648209:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427253888:12345-0@lo:13: 00002000:00000024:0.0:1789635252.648236:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635252.648290:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427253888:12345-0@lo:13: Request processed in 82us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635252.648298:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1789635252.648390:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04477abb80 x1876568427253888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635268 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635252.648409:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427253888:0@lo:13: 00000100:00100000:1.0:1789635253.160748:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427254016:0@lo:13: 00000100:00100000:1.0:1789635253.160838:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635253.160990:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427254016 00000100:00100000:0.0:1789635253.160999:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427254016 00000100:00100000:0.0:1789635253.161073:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789635253.161083:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427254016:12345-0@lo:13: 00002000:00000024:0.0:1789635253.161103:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635253.161146:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427254016:12345-0@lo:13: Request processed in 66us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635253.161153:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1789635253.161257:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789635253.161333:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447975880 x1876568427254016/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635269 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635253.161351:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427254016:0@lo:13: 00000001:00100000:0.0:1789635253.162806:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e1c17f2-a595-4ed0-97c8-b9260d0850ab 00000100:00100000:1.0:1789635253.196930:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635253.196972:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635253.197006:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635253.197037:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635253.197080:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635253.197105:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411476352 00000100:00100000:1.0:1789635253.197113:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411476352 00000100:00100000:1.0:1789635253.197179:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411476224 00000100:00100000:1.0:1789635253.197183:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411476224 00000100:00100000:1.0:1789635253.197208:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:1.0:1789635253.197218:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411476352:12345-192.168.203.20@tcp:400: 00000100:00100000:1.0:1789635253.197285:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411476352:12345-192.168.203.20@tcp:400: Request processed in 69us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635253.197292:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:1.0:1789635253.197308:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 56 00000100:00100000:1.0:1789635253.197315:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2399:x1876568411476224:12345-192.168.203.20@tcp:400: 00000100:00100000:1.0:1789635253.197340:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2399:x1876568411476224:12345-192.168.203.20@tcp:400: Request processed in 25us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635253.197346:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 56 00000100:00080000:1.0:1789635253.197362:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789635253.197365:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789635253.197784:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411476608 00000100:00100000:3.0:1789635253.197789:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411476608 00000100:00100000:3.0:1789635253.197830:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411476480 00000100:00100000:3.0:1789635253.197834:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411476480 00000100:00100000:3.0:1789635253.197865:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:3.0:1789635253.197873:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411476608:12345-192.168.203.20@tcp:400: 00000100:00100000:3.0:1789635253.197907:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411476608:12345-192.168.203.20@tcp:400: Request processed in 35us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635253.197914:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:3.0:1789635253.197937:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:3.0:1789635253.197947:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411476480:12345-192.168.203.20@tcp:400: 00000100:00100000:3.0:1789635253.197973:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411476480:12345-192.168.203.20@tcp:400: Request processed in 30us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635253.197991:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:0.0:1789635253.198232:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411476096 00000100:00100000:0.0:1789635253.198237:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411476096 00000100:00100000:0.0:1789635253.198276:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 198 00000100:00100000:0.0:1789635253.198284:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:2398:x1876568411476096:12345-192.168.203.20@tcp:400: 00000100:00100000:0.0:1789635253.198320:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:2398:x1876568411476096:12345-192.168.203.20@tcp:400: Request processed in 27us (1389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635253.198327:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 198 00000100:00080000:1.0:1789635253.199337:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789635253.199343:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789635253.283945:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789635254.096180:0:10181:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789635254.312706:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635254.692504:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789635254.692534:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044146bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427254144:0@lo:41: 00000100:00100000:1.0:1789635254.692653:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635254.693133:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427254144 00000100:00100000:2.0:1789635254.693145:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427254144 00000100:00100000:2.0:1789635254.693208:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789635254.693220:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427254144:12345-0@lo:41: 00000004:00000024:2.0:1789635254.693273:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789635254.693340:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427254144:12345-0@lo:41: Request processed in 123us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635254.693347:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789635254.693528:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044146bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427254144:0@lo:41: 00000100:00100000:1.0:1789635254.701023:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427254272:0@lo:41: 00000100:00100000:1.0:1789635254.701116:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635254.701252:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427254272 00000100:00100000:2.0:1789635254.701276:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427254272 00000100:00100000:2.0:1789635254.701338:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789635254.701349:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427254272:12345-0@lo:41: 00000004:00000024:2.0:1789635254.701395:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789635254.701458:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427254272:12345-0@lo:41: Request processed in 110us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635254.701466:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789635254.701518:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427254272:0@lo:41: 00010000:00010000:3.0:1789635255.332926:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635256.357642:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635256.739751:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789635256.739778:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044146a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427254400:0@lo:13: 00000100:00100000:2.0:1789635256.739841:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635256.739895:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427254400 00000100:00100000:2.0:1789635256.739903:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427254400 00000100:00100000:2.0:1789635256.739968:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789635256.739978:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044146b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427254400:12345-0@lo:13: 00002000:00000024:2.0:1789635256.740004:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635256.740044:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044146b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427254400:12345-0@lo:13: Request processed in 68us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635256.740051:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1789635256.740070:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789635256.740095:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d044146a680 x1876568427254400/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635272 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635256.740112:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044146a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427254400:0@lo:13: 00000100:00100000:3.0:1789635256.741976:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427254912:0@lo:400: 00000100:00100000:3.0:1789635256.742018:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635256.742051:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427255424:0@lo:400: 00000100:00100000:3.0:1789635256.742074:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635256.742090:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427255936:0@lo:400: 00000100:00100000:3.0:1789635256.742109:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635256.742129:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789635256.742134:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427254528:0@lo:400: 00000100:00100000:3.0:1789635256.742156:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635256.742173:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044765b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427255040:0@lo:400: 00000100:00100000:3.0:1789635256.742192:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635256.742204:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044765a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427255552:0@lo:400: 00000100:00100000:3.0:1789635256.742220:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635256.742239:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044765aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876568427254656:0@lo:400: 00000100:00100000:3.0:1789635256.742258:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635256.742273:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1876568427255168:0@lo:400: 00000100:00100000:3.0:1789635256.742311:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635256.742332:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1876568427255680:0@lo:400: 00000100:00100000:3.0:1789635256.742358:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635256.742374:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789635256.742379:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044765ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427254784:0@lo:400: 00000100:00100000:3.0:1789635256.742407:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635256.742422:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044765a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427255296:0@lo:400: 00000100:00100000:3.0:1789635256.742437:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635256.742448:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447659500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1876568427255808:0@lo:400: 00000100:00100000:3.0:1789635256.742462:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635256.742484:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427254912 00000100:00100000:3.0:1789635256.742488:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427254912 00000100:00100000:3.0:1789635256.742514:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427254784 00000100:00100000:3.0:1789635256.742516:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427254784 00000100:00100000:3.0:1789635256.742528:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789635256.742535:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427254912:12345-0@lo:400: 00000100:00100000:3.0:1789635256.742577:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427254912:12345-0@lo:400: Request processed in 42us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635256.742583:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789635256.742613:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789635256.742619:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044796a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427254784:12345-0@lo:400: 00000100:00100000:3.0:1789635256.742646:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044796a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427254784:12345-0@lo:400: Request processed in 28us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635256.742651:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789635256.742665:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427255424 00000100:00100000:3.0:1789635256.742668:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427255424 00000100:00100000:0.0:1789635256.744872:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427255040 00000100:00100000:0.0:1789635256.744882:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427255040 00000100:00100000:0.0:1789635256.744914:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427254656 00000100:00100000:0.0:1789635256.744917:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427254656 00000100:00100000:0.0:1789635256.744925:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427255168 00000100:00100000:0.0:1789635256.744928:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427255168 00000100:00100000:3.0:1789635256.745007:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427255936 00000100:00100000:3.0:1789635256.745011:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427255936 00000100:00100000:1.0:1789635256.749320:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427255680 00000100:00100000:1.0:1789635256.749334:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427255680 00000100:00100000:0.0:1789635256.754497:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427255296 00000100:00100000:0.0:1789635256.754510:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427255296 00000100:00100000:0.0:1789635256.754532:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427255808 00000100:00100000:0.0:1789635256.754535:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427255808 00000100:00100000:0.0:1789635256.754554:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789635256.754577:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427255040:12345-0@lo:400: 00000100:00100000:0.0:1789635256.754688:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427255040:12345-0@lo:400: Request processed in 100us (12482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635256.754695:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789635256.754712:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789635256.754719:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876568427254656:12345-0@lo:400: 00000100:00100000:0.0:1789635256.754760:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876568427254656:12345-0@lo:400: Request processed in 41us (12501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635256.754765:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789635256.754775:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789635256.754781:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044796b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876568427255168:12345-0@lo:400: 00000100:00100000:0.0:1789635256.754809:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044796b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876568427255168:12345-0@lo:400: Request processed in 29us (12498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635256.754815:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789635256.754825:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789635256.754831:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427255296:12345-0@lo:400: 00000100:00100000:0.0:1789635256.754858:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427255296:12345-0@lo:400: Request processed in 27us (12420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635256.754863:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789635256.754873:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789635256.754878:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044796a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876568427255808:12345-0@lo:400: 00000100:00100000:0.0:1789635256.754901:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044796a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876568427255808:12345-0@lo:400: Request processed in 23us (12438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635256.754906:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789635256.754930:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427254528 00000100:00100000:0.0:1789635256.754940:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427254528 00000100:00100000:0.0:1789635256.754982:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789635256.754989:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3640:x1876568427254528:12345-0@lo:400: 00000100:00100000:0.0:1789635256.755018:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3640:x1876568427254528:12345-0@lo:400: Request processed in 30us (12861us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635256.755023:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789635256.755051:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427255552 00000100:00100000:0.0:1789635256.755055:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427255552 00000100:00100000:0.0:1789635256.755073:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789635256.755080:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427255424:12345-0@lo:400: 00000100:00100000:0.0:1789635256.755110:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427255424:12345-0@lo:400: Request processed in 31us (13036us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635256.755117:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789635256.755130:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789635256.755136:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447659880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427255552:12345-0@lo:400: 00000100:00100000:0.0:1789635256.755163:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447659880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427255552:12345-0@lo:400: Request processed in 28us (12943us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635256.755169:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789635256.755271:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427254528:0@lo:400: 00000100:00100000:0.0:1789635256.755285:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044765b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427255040:0@lo:400: 00010000:00080000:0.0:1789635256.755675:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d044765a680 x1876568427255552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635256.755688:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044765a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427255552:0@lo:400: 00000100:00100000:0.0:1789635256.755703:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427254912:0@lo:400: 00010000:00080000:0.0:1789635256.755712:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447658380 x1876568427255424/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635256.755727:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427255424:0@lo:400: 00000100:00100000:0.0:1789635256.755761:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789635256.755774:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044146a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427256064:0@lo:13: 00000100:00100000:0.0:1789635256.755807:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635256.755863:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427256064 00000100:00100000:0.0:1789635256.755868:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427256064 00000100:00100000:0.0:1789635256.755891:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789635256.755898:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1876568427256064:12345-0@lo:13: 00002000:00000024:0.0:1789635256.755914:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635256.755960:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1876568427256064:12345-0@lo:13: Request processed in 63us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635256.755966:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1789635256.755994:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d044146a680 x1876568427256064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635272 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635256.756008:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044146a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427256064:0@lo:13: 00000100:00100000:0.0:1789635256.758142:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044765ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427254784:0@lo:400: 00010000:00080000:0.0:1789635256.758160:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d044765a300 x1876568427255296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635256.758170:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044765a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427255296:0@lo:400: 00010000:00080000:0.0:1789635256.758182:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447659500 x1876568427255808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635256.758189:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447659500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1876568427255808:0@lo:400: 00000100:00100000:0.0:1789635256.758200:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044765aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876568427254656:0@lo:400: 00000100:00100000:0.0:1789635256.758220:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1876568427255168:0@lo:400: 00000100:00100000:3.0:1789635256.761906:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789635256.761921:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447658e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427255936:12345-0@lo:400: 00000100:00100000:3.0:1789635256.762180:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447658e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427255936:12345-0@lo:400: Request processed in 263us (20068us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635256.762189:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1789635256.762236:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447658700 x1876568427255936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635256.762249:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427255936:0@lo:400: 00000100:00080000:2.0:1789635256.762367:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789635256.762889:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789635256.762893:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789635256.762895:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789635256.779936:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789635256.779967:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876568427255680:12345-0@lo:400: 00000100:00100000:1.0:1789635256.780057:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876568427255680:12345-0@lo:400: Request processed in 111us (37698us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635256.780065:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789635256.780114:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1876568427255680:0@lo:400: 00010000:00010000:3.0:1789635257.382494:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635257.778489:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789635257.778526:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0441469180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427256192:0@lo:13: 00000100:00100000:0.0:1789635257.778640:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635257.778801:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427256192 00000100:00100000:2.0:1789635257.778811:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427256192 00000100:00100000:2.0:1789635257.778870:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789635257.778879:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427256192:12345-0@lo:13: 00002000:00000024:2.0:1789635257.778912:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635257.778963:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427256192:12345-0@lo:13: Request processed in 85us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635257.778970:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1789635257.779025:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0441469180 x1876568427256192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635257.779047:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0441469180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427256192:0@lo:13: 00000100:00100000:1.0:1789635258.275863:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789635258.275887:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427256320:0@lo:13: 00000100:00100000:1.0:1789635258.275953:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635258.276222:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427256320 00000100:00100000:2.0:1789635258.276230:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427256320 00000100:00080000:0.0:1789635258.276348:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789635258.276511:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789635258.276529:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427256320:12345-0@lo:13: 00002000:00000024:1.0:1789635258.276574:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789635258.276753:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427256320:12345-0@lo:13: Request processed in 228us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635258.276767:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1789635258.276783:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04477aaa00 x1876568427256320/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635274 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635258.276803:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427256320:0@lo:13: 00000100:00100000:1.0:1789635258.303963:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635258.304036:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635258.304066:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635258.304095:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635258.304128:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635258.304264:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411476992 00000100:00100000:0.0:1789635258.304274:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411476992 00000100:00100000:0.0:1789635258.304334:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411476864 00000100:00100000:0.0:1789635258.304337:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411476864 00000100:00100000:0.0:1789635258.304355:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00100000:0.0:1789635258.304365:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411476992:12345-192.168.203.20@tcp:400: 00000100:00100000:0.0:1789635258.304427:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411476992:12345-192.168.203.20@tcp:400: Request processed in 64us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635258.304435:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00100000:0.0:1789635258.304449:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 64 00000100:00100000:0.0:1789635258.304455:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2399:x1876568411476864:12345-192.168.203.20@tcp:400: 00000100:00100000:0.0:1789635258.304474:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2399:x1876568411476864:12345-192.168.203.20@tcp:400: Request processed in 19us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635258.304479:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 64 00000100:00100000:0.0:1789635258.304498:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411477248 00000100:00100000:0.0:1789635258.304501:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411477248 00000100:00100000:0.0:1789635258.304523:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411477120 00000100:00100000:0.0:1789635258.304525:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411477120 00000100:00100000:0.0:1789635258.304553:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:0.0:1789635258.304558:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411477248:12345-192.168.203.20@tcp:400: 00000100:00100000:0.0:1789635258.304581:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411477248:12345-192.168.203.20@tcp:400: Request processed in 23us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635258.304587:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:0.0:1789635258.304620:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:0.0:1789635258.304626:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411477120:12345-192.168.203.20@tcp:400: 00000100:00100000:0.0:1789635258.304646:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411477120:12345-192.168.203.20@tcp:400: Request processed in 20us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635258.304652:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00080000:1.0:1789635258.304764:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789635258.304768:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789635258.304771:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789635258.304773:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789635258.305141:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411476736 00000100:00100000:3.0:1789635258.305146:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411476736 00000100:00100000:3.0:1789635258.305211:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 200 00000100:00100000:3.0:1789635258.305218:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:2399:x1876568411476736:12345-192.168.203.20@tcp:400: 00000100:00100000:3.0:1789635258.305260:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:2399:x1876568411476736:12345-192.168.203.20@tcp:400: Request processed in 43us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635258.305266:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 200 00010000:00010000:3.0:1789635258.406996:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635259.430532:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635259.811943:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0441469180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427256448:0@lo:41: 00000100:00100000:3.0:1789635259.812015:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635259.812478:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427256448 00000100:00100000:2.0:1789635259.812486:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427256448 00000100:00100000:2.0:1789635259.812541:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789635259.812551:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427256448:12345-0@lo:41: 00000004:00000024:2.0:1789635259.812583:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789635259.812667:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427256448:12345-0@lo:41: Request processed in 118us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635259.812673:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789635259.812779:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0441469180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427256448:0@lo:41: 00000100:00100000:2.0:1789635259.812935:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427256576:0@lo:41: 00000100:00100000:2.0:1789635259.812965:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635259.813121:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427256576 00000100:00100000:0.0:1789635259.813127:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427256576 00000100:00100000:0.0:1789635259.813159:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789635259.813166:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0441469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427256576:12345-0@lo:41: 00000004:00000024:0.0:1789635259.813186:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789635259.813229:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0441469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427256576:12345-0@lo:41: Request processed in 64us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635259.813236:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789635259.813293:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427256576:0@lo:41: 00010000:00010000:3.0:1789635260.453823:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635261.479538:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635261.864175:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427256704:0@lo:13: 00000100:00100000:0.0:1789635261.864250:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635261.865620:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044146b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427257216:0@lo:400: 00000100:00100000:2.0:1789635261.865681:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635261.865726:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0441469500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427257728:0@lo:400: 00000100:00100000:2.0:1789635261.865762:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635261.865783:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0441469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427258240:0@lo:400: 00000100:00100000:2.0:1789635261.865807:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635261.865828:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789635261.865834:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044146aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427256832:0@lo:400: 00000100:00100000:2.0:1789635261.865858:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635261.865878:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0441469180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876568427257344:0@lo:400: 00000100:00100000:2.0:1789635261.865903:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635261.865928:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0441468700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427257856:0@lo:400: 00000100:00100000:2.0:1789635261.865948:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635261.865975:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427257728 00000100:00100000:2.0:1789635261.865982:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427257728 00000100:00100000:3.0:1789635261.866230:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044146ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427256960:0@lo:400: 00000100:00100000:3.0:1789635261.866258:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635261.866278:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044146a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427257472:0@lo:400: 00000100:00100000:3.0:1789635261.866309:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635261.866327:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0441468380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427257984:0@lo:400: 00000100:00100000:3.0:1789635261.866358:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635261.866375:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789635261.866380:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0441468a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427257088:0@lo:400: 00000100:00100000:3.0:1789635261.866396:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635261.866410:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044146bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1876568427257600:0@lo:400: 00000100:00100000:3.0:1789635261.866425:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635261.866438:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044146a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1876568427258112:0@lo:400: 00000100:00100000:3.0:1789635261.866457:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635261.866481:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427257216 00000100:00100000:3.0:1789635261.866485:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427257216 00000100:00100000:3.0:1789635261.866528:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427257088 00000100:00100000:3.0:1789635261.866532:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427257088 00000100:00100000:3.0:1789635261.866548:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789635261.866555:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427257216:12345-0@lo:400: 00000100:00100000:3.0:1789635261.866623:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427257216:12345-0@lo:400: Request processed in 68us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635261.866630:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789635261.866646:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789635261.866652:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044796b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427257088:12345-0@lo:400: 00000100:00100000:3.0:1789635261.866682:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044796b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427257088:12345-0@lo:400: Request processed in 30us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635261.866687:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789635261.866731:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427257344 00000100:00100000:3.0:1789635261.866735:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427257344 00000100:00100000:2.0:1789635261.866942:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427258240 00000100:00100000:2.0:1789635261.866947:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427258240 00000100:00100000:2.0:1789635261.866961:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427257856 00000100:00100000:2.0:1789635261.866964:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427257856 00000100:00100000:2.0:1789635261.866977:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789635261.866983:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427257728:12345-0@lo:400: 00000100:00100000:3.0:1789635261.867074:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427256960 00000100:00100000:3.0:1789635261.867084:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427256960 00000100:00100000:3.0:1789635261.867101:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427257472 00000100:00100000:3.0:1789635261.867104:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427257472 00000100:00100000:3.0:1789635261.867115:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427257984 00000100:00100000:3.0:1789635261.867117:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427257984 00000100:00100000:3.0:1789635261.867130:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427257600 00000100:00100000:3.0:1789635261.867132:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427257600 00000100:00100000:3.0:1789635261.867142:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427258112 00000100:00100000:3.0:1789635261.867144:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427258112 00000100:00100000:3.0:1789635261.867158:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789635261.867163:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876568427257344:12345-0@lo:400: 00000100:00100000:1.0:1789635261.867272:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427256704 00000100:00100000:1.0:1789635261.867276:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427256704 00000100:00100000:1.0:1789635261.867302:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789635261.867314:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427256704:12345-0@lo:13: 00002000:00000024:1.0:1789635261.867347:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635261.870072:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876568427257344:12345-0@lo:400: Request processed in 2901us (4160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635261.870085:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789635261.870117:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789635261.870127:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427256960:12345-0@lo:400: 00000100:00100000:3.0:1789635261.870190:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427256960:12345-0@lo:400: Request processed in 66us (3931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635261.870196:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789635261.870211:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789635261.870218:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427257472:12345-0@lo:400: 00000100:00100000:3.0:1789635261.870246:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427257472:12345-0@lo:400: Request processed in 29us (3936us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635261.870251:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789635261.870262:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789635261.870269:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044796bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427257984:12345-0@lo:400: 00000100:00100000:3.0:1789635261.870295:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044796bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427257984:12345-0@lo:400: Request processed in 27us (3936us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635261.870310:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789635261.870322:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789635261.870343:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447968e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876568427257600:12345-0@lo:400: 00000100:00100000:3.0:1789635261.870374:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447968e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876568427257600:12345-0@lo:400: Request processed in 46us (3948us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635261.870379:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789635261.870390:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789635261.870397:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876568427258112:12345-0@lo:400: 00000100:00100000:3.0:1789635261.870423:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876568427258112:12345-0@lo:400: Request processed in 27us (3966us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635261.870428:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789635261.870491:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0441469180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876568427257344:0@lo:400: 00000100:00100000:3.0:1789635261.870504:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044146b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427257216:0@lo:400: 00000100:00100000:3.0:1789635261.870523:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789635261.870535:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427258368:0@lo:13: 00000100:00100000:3.0:1789635261.870567:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635261.870625:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0441468a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427257088:0@lo:400: 00010000:00080000:3.0:1789635261.870639:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d044146bb80 x1876568427257600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635261.870648:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044146bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1876568427257600:0@lo:400: 00010000:00080000:3.0:1789635261.870659:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d044146a300 x1876568427258112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635261.870666:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044146a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1876568427258112:0@lo:400: 00000100:00100000:3.0:1789635261.870689:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044146ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427256960:0@lo:400: 00000100:00100000:3.0:1789635261.870710:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044146a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427257472:0@lo:400: 00000100:00100000:3.0:1789635261.870720:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0441468380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427257984:0@lo:400: 00000100:00100000:3.0:1789635261.870888:0:8434:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1789635261.870896:0:8434:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1789635261.870993:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427258368 00000100:00100000:3.0:1789635261.871000:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427258368 00000100:00100000:3.0:1789635261.871084:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789635261.871092:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447969880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1876568427258368:12345-0@lo:13: 00002000:00000024:3.0:1789635261.871107:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635261.871144:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447969880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1876568427258368:12345-0@lo:13: Request processed in 53us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635261.871150:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1789635261.871173:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04477a8380 x1876568427258368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635261.871188:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427258368:0@lo:13: 00000100:00100000:3.0:1789635261.874586:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427256832 00000100:00100000:3.0:1789635261.874617:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427256832 00000100:00100000:3.0:1789635261.874680:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789635261.874690:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3642:x1876568427256832:12345-0@lo:400: 00000100:00100000:3.0:1789635261.875540:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3642:x1876568427256832:12345-0@lo:400: Request processed in 849us (9677us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635261.875549:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789635261.875613:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789635261.875625:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427258240:12345-0@lo:400: 00000100:00100000:3.0:1789635261.875676:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427258240:12345-0@lo:400: Request processed in 55us (9867us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635261.875682:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789635261.875708:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789635261.875716:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427257856:12345-0@lo:400: 00000100:00100000:3.0:1789635261.875745:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427257856:12345-0@lo:400: Request processed in 30us (9796us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635261.875750:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789635261.876095:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044146aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427256832:0@lo:400: 00010000:00080000:3.0:1789635261.876112:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0441468700 x1876568427257856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635261.876193:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0441468700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427257856:0@lo:400: 00010000:00080000:3.0:1789635261.876208:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0441469c00 x1876568427258240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635261.876216:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0441469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427258240:0@lo:400: 00000100:00100000:1.0:1789635261.882418:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427256704:12345-0@lo:13: Request processed in 15098us (18161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635261.882432:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1789635261.882500:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447974a80 x1876568427256704/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635261.882524:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427256704:0@lo:13: 00000100:00080000:1.0:1789635261.882732:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789635261.882738:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789635261.882741:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789635261.882744:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789635261.894477:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427257728:12345-0@lo:400: Request processed in 27482us (28713us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635261.894494:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1789635261.902242:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0441469500 x1876568427257728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635261.902261:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0441469500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427257728:0@lo:400: 00000020:00000080:1.0:1789635261.915547:0:10331:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff6ec60230 20000000:00000080:1.0:1789635261.915564:0:10331:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d0446de4800 uarg=0000000000000000 20000000:01000000:1.0:1789635261.915745:0:10331:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1789635261.915748:0:10331:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1789635261.915815:0:10331:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789635261.915820:0:10331:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789635261.915824:0:10331:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1789635261.915880:0:10331:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789635261.915882:0:10331:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789635261.923094:0:10332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:1.0:1789635261.923582:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:1.0:1789635261.923646:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:1.0:1789635261.923664:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:1.0:1789635261.923677:0:10331:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789635261.923686:0:10331:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789635261.924632:0:10333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:3.0:1789635261.925250:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:3.0:1789635261.925275:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:3.0:1789635261.925303:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:3.0:1789635261.925314:0:10331:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789635261.925316:0:10331:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789635261.926045:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1789635261.926340:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1789635261.926363:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1789635261.926377:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:2.0:1789635261.926387:0:10331:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789635261.926389:0:10331:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789635261.926953:0:10335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:3.0:1789635261.927640:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:3.0:1789635261.927664:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:3.0:1789635261.927678:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:3.0:1789635261.927689:0:10331:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789635261.927692:0:10331:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789635261.929215:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1789635261.929717:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1789635261.929741:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1789635261.929942:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 10000000:01000000:2.0:1789635261.929960:0:10331:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789635261.929980:0:10331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d056e1a2e00/0xb0c3a59caa40ef1a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.929996:0:10331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0540030200/0xb0c3a59caa40edb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40edae expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.930081:0:10331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d05820d3e00/0xb0c3a59caa40eddf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40edd8 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.930089:0:10331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d056f6e8200/0xb0c3a59caa40ee1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ee17 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.930095:0:10331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0540031800/0xb0c3a59caa40ee2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ee25 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.930102:0:10331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0540031400/0xb0c3a59caa40ee3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ee33 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.930109:0:10331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d056f6e9600/0xb0c3a59caa40ee56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ee4f expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.930180:0:10331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0540030a00/0xb0c3a59caa40ee80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ee79 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.930190:0:10331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d056e1a2000/0xb0c3a59caa40ee9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ee95 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.930196:0:10331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d058214a400/0xb0c3a59caa40eec6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40eebf expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.930206:0:10331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d058214b400/0xb0c3a59caa40eed4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73e62 expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.930214:0:10331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa40eedb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73e69 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.930233:0:10331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d056e1a2e00/0xb0c3a59caa40ef1a lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.930588:0:10331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa40eedb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73e69 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.930866:0:10331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa40eedb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73e69 expref: 9 pid: 6506 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635261.930880:0:10331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467ba300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1876568427258496:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789635261.938025:0:10331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d058214b400/0xb0c3a59caa40eed4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73e62 expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635261.938044:0:10331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d058214b400/0xb0c3a59caa40eed4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73e62 expref: 9 pid: 6508 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635261.938079:0:10331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447975c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1876568427258624:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789635261.938118:0:10331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d058214a400/0xb0c3a59caa40eec6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40eebf expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635261.938127:0:10331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d058214a400/0xb0c3a59caa40eec6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40eebf expref: 23 pid: 6506 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635261.938137:0:10331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447976300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1876568427258752:0@lo:104: 00000100:00100000:0.0:1789635261.938173:0:10331:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789635261.938208:0:10331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d056e1a2000/0xb0c3a59caa40ee9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40ee95 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635261.938217:0:10331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d056e1a2000/0xb0c3a59caa40ee9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40ee95 expref: 23 pid: 6506 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635261.938226:0:10331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447976680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1876568427258880:0@lo:104: 00000100:00100000:0.0:1789635261.938245:0:10331:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635261.938305:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427258752 00000100:00100000:3.0:1789635261.938313:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427258752 00000100:00100000:3.0:1789635261.938418:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427258880 00000100:00100000:3.0:1789635261.938422:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427258880 00000100:00100000:3.0:1789635261.938438:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789635261.938554:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447974380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+4:10331:x1876568427258752:12345-0@lo:104: 00010000:00010000:3.0:1789635261.938570:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d058214a200/0xb0c3a59caa40eebf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40eec6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635261.939401:0:10331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0540030a00/0xb0c3a59caa40ee80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40ee79 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635261.939413:0:10331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d0540030a00/0xb0c3a59caa40ee80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40ee79 expref: 23 pid: 6506 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635261.939425:0:10331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447975500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1876568427259008:0@lo:104: 00000100:00100000:0.0:1789635261.939460:0:10331:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789635261.939509:0:10331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d056f6e9600/0xb0c3a59caa40ee56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40ee4f expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635261.939531:0:10331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d056f6e9600/0xb0c3a59caa40ee56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40ee4f expref: 23 pid: 6509 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635261.939541:0:10331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447977b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1876568427259136:0@lo:104: 00000100:00100000:0.0:1789635261.939566:0:10331:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789635261.939584:0:10331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0540031400/0xb0c3a59caa40ee3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40ee33 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635261.939592:0:10331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d0540031400/0xb0c3a59caa40ee3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40ee33 expref: 23 pid: 6509 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635261.939617:0:10331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447977800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1876568427259264:0@lo:104: 00010000:00010000:0.0:1789635261.939640:0:10331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0540031800/0xb0c3a59caa40ee2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40ee25 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635261.939647:0:10331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d0540031800/0xb0c3a59caa40ee2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40ee25 expref: 23 pid: 6506 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635261.939655:0:10331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447974e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1876568427259392:0@lo:104: 00010000:00010000:0.0:1789635261.939679:0:10331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d056f6e8200/0xb0c3a59caa40ee1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40ee17 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635261.939687:0:10331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d056f6e8200/0xb0c3a59caa40ee1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40ee17 expref: 23 pid: 6506 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635261.939703:0:10331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447974a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1876568427259520:0@lo:104: 00010000:00010000:3.0:1789635261.939728:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789635261.939736:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447974380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+4:10331:x1876568427258752:12345-0@lo:104: Request processed in 1290us (1562us total) trans 0 rc 0/0 00010000:00010000:0.0:1789635261.939742:0:10331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d05820d3e00/0xb0c3a59caa40eddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40edd8 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635261.939744:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789635261.939774:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789635261.939792:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635261.939803:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635261.939811:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635261.939818:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427259008 00000100:00100000:3.0:1789635261.939822:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427259008 00000100:00100000:3.0:1789635261.939841:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427259136 00000100:00100000:3.0:1789635261.939843:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427259136 00000100:00100000:3.0:1789635261.939852:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427259264 00000100:00100000:3.0:1789635261.939854:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427259264 00000100:00100000:3.0:1789635261.939862:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427259392 00000100:00100000:2.0:1789635261.939863:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427259520 00000100:00100000:3.0:1789635261.939864:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427259392 00000100:00100000:2.0:1789635261.939867:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427259520 00000100:00100000:3.0:1789635261.939874:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789635261.939880:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447975180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+8:10331:x1876568427258880:12345-0@lo:104: 00010000:00010000:3.0:1789635261.939890:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2400/0xb0c3a59caa40ee95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ee9c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635261.940497:0:10331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d05820d3e00/0xb0c3a59caa40eddf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40edd8 expref: 23 pid: 6508 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635261.940507:0:10331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447976d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1876568427259648:0@lo:104: 00000100:00100000:0.0:1789635261.940535:0:10331:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789635261.940572:0:10331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0540030200/0xb0c3a59caa40edb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40edae expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635261.940580:0:10331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d0540030200/0xb0c3a59caa40edb5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40edae expref: 23 pid: 6506 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635261.940588:0:10331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447975880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1876568427259776:0@lo:104: 00000100:00100000:0.0:1789635261.940626:0:10331:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635261.940637:0:10331:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0565a289c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635261.940658:0:10331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447976300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1876568427258752:0@lo:104: 00000100:00100000:0.0:1789635261.940666:0:10331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447976680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1876568427258880:0@lo:104: 00010000:00010000:3.0:1789635261.943605:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789635261.943621:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447975180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+8:10331:x1876568427258880:12345-0@lo:104: Request processed in 3737us (5371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635261.943632:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789635261.943678:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427259648 00000100:00100000:3.0:1789635261.943686:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427259648 00000100:00100000:3.0:1789635261.943727:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427259776 00000100:00100000:3.0:1789635261.943730:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427259776 00000100:00100000:3.0:1789635261.943744:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789635261.943751:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447974700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+9:10331:x1876568427259008:12345-0@lo:104: 00010000:00010000:3.0:1789635261.943765:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8a00/0xb0c3a59caa40ee79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ee80 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635261.950929:0:10331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447975500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1876568427259008:0@lo:104: 00010000:00010000:2.0:1789635261.951703:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789635261.951714:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d058214a200/0xb0c3a59caa40eebf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40eec6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.951725:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d058214a200 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:2.0:1789635261.951730:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d058214a200/0xb0c3a59caa40eebf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40eec6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.951740:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d058214a200/0xb0c3a59caa40eebf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40eec6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789635261.951748:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d058214a200/0xb0c3a59caa40eebf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40eec6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635261.951765:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789635261.951817:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d058214a200/0xb0c3a59caa40eebf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40eec6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.951843:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789635261.951868:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d058214a200/0xb0c3a59caa40eebf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40eec6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.951876:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d058214a200/0xb0c3a59caa40eebf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40eec6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.951892:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789635261.951895:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2400/0xb0c3a59caa40ee95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ee9c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.951901:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a2400 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:2.0:1789635261.951903:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2400/0xb0c3a59caa40ee95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40ee9c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.951909:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2400/0xb0c3a59caa40ee95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40ee9c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789635261.951915:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2400/0xb0c3a59caa40ee95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40ee9c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635261.951920:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789635261.951934:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2400/0xb0c3a59caa40ee95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ee9c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.951940:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789635261.951944:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2400/0xb0c3a59caa40ee95 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ee9c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.951949:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2400/0xb0c3a59caa40ee95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ee9c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.951964:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635261.951968:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8a00/0xb0c3a59caa40ee79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ee80 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.951973:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056f6e8a00 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:2.0:1789635261.951976:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8a00/0xb0c3a59caa40ee79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40ee80 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.951984:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8a00/0xb0c3a59caa40ee79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40ee80 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789635261.951989:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8a00/0xb0c3a59caa40ee79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40ee80 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635261.951993:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789635261.952006:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8a00/0xb0c3a59caa40ee79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ee80 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.952011:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789635261.952025:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8a00/0xb0c3a59caa40ee79 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ee80 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.952031:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8a00/0xb0c3a59caa40ee79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ee80 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.952040:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635261.952042:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635261.952044:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635261.952069:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427259904:0@lo:103: 00000100:00100000:2.0:1789635261.952136:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635261.952180:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789635261.952186:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427260032:0@lo:103: 00000100:00100000:2.0:1789635261.952209:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635261.952237:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427260160:0@lo:103: 00000100:00100000:2.0:1789635261.952258:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635261.952291:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427259904 00000100:00100000:2.0:1789635261.952297:0:7457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427259904 00010000:00010000:2.0:1789635261.952327:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d058214a400/0xb0c3a59caa40eec6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40eebf expref: 24 pid: 6506 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635261.952352:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427260032 00000100:00100000:2.0:1789635261.952354:0:7457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427260032 00010000:00010000:2.0:1789635261.952366:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d056e1a2000/0xb0c3a59caa40ee9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ee95 expref: 25 pid: 6506 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635261.952376:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427260160 00000100:00100000:2.0:1789635261.952378:0:7457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427260160 00010000:00010000:2.0:1789635261.952387:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0540030a00/0xb0c3a59caa40ee80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ee79 expref: 26 pid: 6506 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635261.952401:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789635261.952409:0:7457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b407050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6356ed01-c755-4f9e-b839-20feb7c3f098+26:3640:x1876568427259904:12345-0@lo:103: 00010000:00010000:2.0:1789635261.952421:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635261.952427:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d058214a400/0xb0c3a59caa40eec6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40eebf expref: 26 pid: 6506 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.952435:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d058214a400/0xb0c3a59caa40eec6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40eebf expref: 26 pid: 6506 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.952458:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d058214a400/0xb0c3a59caa40eec6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40eebf expref: 26 pid: 6506 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.952471:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635261.952503:0:7457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b407050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6356ed01-c755-4f9e-b839-20feb7c3f098+25:3640:x1876568427259904:12345-0@lo:103: Request processed in 95us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635261.952510:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789635261.952550:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789635261.952557:0:7457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3640:x1876568427260032:12345-0@lo:103: 00010000:00010000:2.0:1789635261.952564:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635261.952568:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d056e1a2000/0xb0c3a59caa40ee9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ee95 expref: 24 pid: 6506 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.952576:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d056e1a2000/0xb0c3a59caa40ee9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40ee95 expref: 24 pid: 6506 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.952586:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056e1a2000/0xb0c3a59caa40ee9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40ee95 expref: 24 pid: 6506 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.952623:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635261.952646:0:7457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6356ed01-c755-4f9e-b839-20feb7c3f098+23:3640:x1876568427260032:12345-0@lo:103: Request processed in 91us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635261.952652:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789635261.952665:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789635261.952671:0:7457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6356ed01-c755-4f9e-b839-20feb7c3f098+22:3642:x1876568427260160:12345-0@lo:103: 00010000:00010000:2.0:1789635261.952678:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635261.952682:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0540030a00/0xb0c3a59caa40ee80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ee79 expref: 22 pid: 6506 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.952706:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0540030a00/0xb0c3a59caa40ee80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40ee79 expref: 22 pid: 6506 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.952716:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0540030a00/0xb0c3a59caa40ee80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40ee79 expref: 22 pid: 6506 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.952725:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635261.952750:0:7457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6356ed01-c755-4f9e-b839-20feb7c3f098+21:3642:x1876568427260160:12345-0@lo:103: Request processed in 79us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635261.952755:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789635261.952794:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427260160:0@lo:103: 00000100:00100000:2.0:1789635261.952815:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427260032:0@lo:103: 00000100:00100000:2.0:1789635261.952822:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427259904:0@lo:103: 00010000:00010000:0.0:1789635261.959783:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635261.964845:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1789635261.964863:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447974700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+9:10331:x1876568427259008:12345-0@lo:104: Request processed in 21107us (25398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635261.964876:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789635261.964910:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1789635261.964911:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635261.964923:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446dd1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+8:10331:x1876568427259136:12345-0@lo:104: 00010000:00010000:3.0:1789635261.964940:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3c00/0xb0c3a59caa40ee4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ee56 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635261.965041:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635261.965082:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635261.965167:0:10331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467ba300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1876568427258496:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789635261.965178:0:10331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447975c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1876568427258624:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789635261.965186:0:10331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447977b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1876568427259136:0@lo:104: 00000100:00100000:2.0:1789635261.965308:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411477376 00000100:00100000:2.0:1789635261.965315:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411477376 00010000:00010000:2.0:1789635261.965340:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa40eedb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73e69 expref: 10 pid: 6506 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635261.965364:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411477504 00000100:00100000:2.0:1789635261.965367:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411477504 00010000:00010000:2.0:1789635261.965378:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d058214b400/0xb0c3a59caa40eed4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73e62 expref: 11 pid: 6508 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635261.965405:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:2.0:1789635261.965413:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447658700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd20b267-9db1-4540-8a6a-0af57c4f3581+11:2397:x1876568411477376:12345-192.168.203.20@tcp:103: 00010000:00010000:2.0:1789635261.965423:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635261.965438:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa40eedb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73e69 expref: 11 pid: 6506 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.965448:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa40eedb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73e69 expref: 11 pid: 6506 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.965466:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa40eedb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73e69 expref: 11 pid: 6506 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.965480:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635261.965518:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447658700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:2397:x1876568411477376:12345-192.168.203.20@tcp:103: Request processed in 107us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635261.965525:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:2.0:1789635261.965540:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:2.0:1789635261.965546:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447659c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd20b267-9db1-4540-8a6a-0af57c4f3581+9:2397:x1876568411477504:12345-192.168.203.20@tcp:103: 00010000:00010000:2.0:1789635261.965554:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635261.965558:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d058214b400/0xb0c3a59caa40eed4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73e62 expref: 9 pid: 6508 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.965568:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d058214b400/0xb0c3a59caa40eed4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73e62 expref: 9 pid: 6508 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635261.965572:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789635261.965578:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446dd1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+8:10331:x1876568427259136:12345-0@lo:104: Request processed in 660us (26011us total) trans 0 rc 0/0 00010000:00010000:2.0:1789635261.965582:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d058214b400/0xb0c3a59caa40eed4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73e62 expref: 9 pid: 6508 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635261.965584:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1789635261.965592:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635261.965628:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447659c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd20b267-9db1-4540-8a6a-0af57c4f3581+8:2397:x1876568411477504:12345-192.168.203.20@tcp:103: Request processed in 82us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635261.965634:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:3.0:1789635261.965645:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789635261.965658:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044796b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+7:10331:x1876568427259264:12345-0@lo:104: 00010000:00010000:3.0:1789635261.965666:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8e00/0xb0c3a59caa40ee33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ee3a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635261.965714:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789635261.965719:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044796b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+7:10331:x1876568427259264:12345-0@lo:104: Request processed in 64us (25927us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635261.965725:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789635261.965738:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789635261.965744:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447969f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+6:10331:x1876568427259392:12345-0@lo:104: 00010000:00010000:3.0:1789635261.965751:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3800/0xb0c3a59caa40ee25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ee2c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635261.965782:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789635261.965786:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447969f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+6:10331:x1876568427259392:12345-0@lo:104: Request processed in 43us (25982us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635261.965791:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789635261.965804:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789635261.965810:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044796aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+5:10331:x1876568427259520:12345-0@lo:104: 00010000:00010000:3.0:1789635261.965818:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d0540031c00/0xb0c3a59caa40ee17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ee1e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635261.965858:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789635261.965862:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044796aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+5:10331:x1876568427259520:12345-0@lo:104: Request processed in 53us (26050us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635261.965969:0:10331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447977800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1876568427259264:0@lo:104: 00000100:00100000:1.0:1789635261.965978:0:10331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447974e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1876568427259392:0@lo:104: 00000100:00100000:1.0:1789635261.965985:0:10331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447974a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1876568427259520:0@lo:104: 00010000:00010000:1.0:1789635261.966832:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789635261.966840:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3c00/0xb0c3a59caa40ee4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ee56 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635261.966849:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3c00 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:1.0:1789635261.966852:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3c00/0xb0c3a59caa40ee4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40ee56 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635261.966861:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3c00/0xb0c3a59caa40ee4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40ee56 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789635261.966868:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3c00/0xb0c3a59caa40ee4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40ee56 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635261.966874:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789635261.966912:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3c00/0xb0c3a59caa40ee4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ee56 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635261.966919:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789635261.966948:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3c00/0xb0c3a59caa40ee4f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ee56 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635261.966955:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3c00/0xb0c3a59caa40ee4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ee56 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635261.966968:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789635261.966972:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8e00/0xb0c3a59caa40ee33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ee3a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635261.966977:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056f6e8e00 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:1.0:1789635261.966980:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8e00/0xb0c3a59caa40ee33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40ee3a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635261.966987:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8e00/0xb0c3a59caa40ee33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40ee3a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789635261.966994:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8e00/0xb0c3a59caa40ee33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40ee3a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635261.966999:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789635261.967012:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8e00/0xb0c3a59caa40ee33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ee3a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635261.967017:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789635261.967030:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8e00/0xb0c3a59caa40ee33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ee3a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635261.967049:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8e00/0xb0c3a59caa40ee33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ee3a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635261.967059:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789635261.967068:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3800/0xb0c3a59caa40ee25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ee2c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635261.967074:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3800 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:1.0:1789635261.967077:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3800/0xb0c3a59caa40ee25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40ee2c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635261.967083:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3800/0xb0c3a59caa40ee25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40ee2c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789635261.967090:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3800/0xb0c3a59caa40ee25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40ee2c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635261.967095:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789635261.967109:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3800/0xb0c3a59caa40ee25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ee2c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635261.967115:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789635261.967120:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3800/0xb0c3a59caa40ee25 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ee2c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635261.967126:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3800/0xb0c3a59caa40ee25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ee2c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635261.967135:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635261.967138:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d0540031c00/0xb0c3a59caa40ee17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ee1e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635261.967144:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540031c00 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:1.0:1789635261.967146:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d0540031c00/0xb0c3a59caa40ee17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40ee1e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635261.967162:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d0540031c00/0xb0c3a59caa40ee17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40ee1e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789635261.967168:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d0540031c00/0xb0c3a59caa40ee17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40ee1e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635261.967174:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789635261.967187:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d0540031c00/0xb0c3a59caa40ee17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ee1e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635261.967192:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789635261.967198:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d0540031c00/0xb0c3a59caa40ee17 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ee1e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635261.967203:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d0540031c00/0xb0c3a59caa40ee17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ee1e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635261.967212:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635261.967214:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635261.967216:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635261.967411:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427260544:0@lo:103: 00000100:00100000:2.0:1789635261.967457:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635261.967504:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789635261.967510:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427260416:0@lo:103: 00000100:00100000:2.0:1789635261.967528:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635261.967551:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427260544 00000100:00100000:2.0:1789635261.967557:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427260544 00010000:00010000:2.0:1789635261.967578:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0540031800/0xb0c3a59caa40ee2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ee25 expref: 21 pid: 6506 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635261.967622:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427260416 00000100:00100000:2.0:1789635261.967626:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427260416 00010000:00010000:2.0:1789635261.967715:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0540031400/0xb0c3a59caa40ee3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ee33 expref: 22 pid: 6509 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635261.967728:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789635261.967735:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+22:3641:x1876568427260544:12345-0@lo:103: 00010000:00010000:2.0:1789635261.967745:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635261.967749:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0540031800/0xb0c3a59caa40ee2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ee25 expref: 22 pid: 6506 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.967757:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0540031800/0xb0c3a59caa40ee2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40ee25 expref: 22 pid: 6506 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.967770:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0540031800/0xb0c3a59caa40ee2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40ee25 expref: 22 pid: 6506 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.967840:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635261.967872:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+21:3641:x1876568427260544:12345-0@lo:103: Request processed in 137us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635261.967888:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789635261.967904:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789635261.967911:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+20:3641:x1876568427260416:12345-0@lo:103: 00010000:00010000:2.0:1789635261.967924:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635261.967928:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0540031400/0xb0c3a59caa40ee3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ee33 expref: 20 pid: 6509 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.967936:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0540031400/0xb0c3a59caa40ee3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40ee33 expref: 20 pid: 6509 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.967945:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0540031400/0xb0c3a59caa40ee3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40ee33 expref: 20 pid: 6509 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.967954:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635261.967977:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+19:3641:x1876568427260416:12345-0@lo:103: Request processed in 68us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635261.967983:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789635261.968010:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427260416:0@lo:103: 00000100:00100000:2.0:1789635261.968017:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427260544:0@lo:103: 00000100:00100000:2.0:1789635261.968043:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427260288:0@lo:103: 00000100:00100000:2.0:1789635261.968066:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635261.968088:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789635261.968094:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427260672:0@lo:103: 00000100:00100000:2.0:1789635261.968111:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635261.968127:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427260288 00000100:00100000:2.0:1789635261.968131:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427260288 00010000:00010000:2.0:1789635261.968150:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d056f6e9600/0xb0c3a59caa40ee56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ee4f expref: 19 pid: 6509 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635261.968161:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427260672 00000100:00100000:2.0:1789635261.968164:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427260672 00010000:00010000:2.0:1789635261.968173:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d056f6e8200/0xb0c3a59caa40ee1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ee17 expref: 20 pid: 6506 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635261.968183:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789635261.968188:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b404050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+20:3643:x1876568427260288:12345-0@lo:103: 00010000:00010000:2.0:1789635261.968195:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635261.968199:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d056f6e9600/0xb0c3a59caa40ee56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ee4f expref: 20 pid: 6509 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.968207:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d056f6e9600/0xb0c3a59caa40ee56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40ee4f expref: 20 pid: 6509 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.968217:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056f6e9600/0xb0c3a59caa40ee56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40ee4f expref: 20 pid: 6509 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.968225:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635261.968249:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b404050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+19:3643:x1876568427260288:12345-0@lo:103: Request processed in 61us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635261.968255:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789635261.968284:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789635261.968290:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+18:3643:x1876568427260672:12345-0@lo:103: 00010000:00010000:2.0:1789635261.968297:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635261.968301:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d056f6e8200/0xb0c3a59caa40ee1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ee17 expref: 18 pid: 6506 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.968319:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d056f6e8200/0xb0c3a59caa40ee1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40ee17 expref: 18 pid: 6506 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.968328:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056f6e8200/0xb0c3a59caa40ee1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40ee17 expref: 18 pid: 6506 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.968336:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635261.968357:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+17:3643:x1876568427260672:12345-0@lo:103: Request processed in 68us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635261.968363:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789635261.968385:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427260672:0@lo:103: 00000100:00100000:2.0:1789635261.968391:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427260288:0@lo:103: 00010000:00010000:0.0:1789635261.968684:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635261.968689:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635261.970657:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789635261.970689:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789635261.970724:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447977480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+4:10331:x1876568427259648:12345-0@lo:104: 00010000:00010000:3.0:1789635261.970739:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2600/0xb0c3a59caa40edd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40eddf expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635261.970827:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789635261.970833:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447977480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+4:10331:x1876568427259648:12345-0@lo:104: Request processed in 116us (30298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635261.970999:0:10331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447976d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1876568427259648:0@lo:104: 00010000:00010000:0.0:1789635261.971057:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635261.971064:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2600/0xb0c3a59caa40edd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40eddf expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635261.971072:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a2600 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:0.0:1789635261.971076:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2600/0xb0c3a59caa40edd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40eddf expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635261.971091:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2600/0xb0c3a59caa40edd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40eddf expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789635261.971099:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2600/0xb0c3a59caa40edd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40eddf expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635261.971105:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789635261.971145:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2600/0xb0c3a59caa40edd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40eddf expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635261.971151:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789635261.971169:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2600/0xb0c3a59caa40edd8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40eddf expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635261.971177:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2600/0xb0c3a59caa40edd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40eddf expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635261.971189:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635261.971191:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635261.971193:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635261.971200:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789635261.971211:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044765aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427260800:0@lo:103: 00000100:00100000:0.0:1789635261.971245:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635261.971311:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427260800 00000100:00100000:0.0:1789635261.971318:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427260800 00010000:00010000:0.0:1789635261.971342:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d05820d3e00/0xb0c3a59caa40eddf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40edd8 expref: 17 pid: 6508 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635261.971362:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789635261.971368:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447659500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+17:3642:x1876568427260800:12345-0@lo:103: 00010000:00010000:0.0:1789635261.971384:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635261.971390:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d05820d3e00/0xb0c3a59caa40eddf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40edd8 expref: 17 pid: 6508 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635261.971399:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d05820d3e00/0xb0c3a59caa40eddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40edd8 expref: 17 pid: 6508 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635261.971411:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d05820d3e00/0xb0c3a59caa40eddf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40edd8 expref: 17 pid: 6508 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635261.971422:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635261.971449:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447659500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+16:3642:x1876568427260800:12345-0@lo:103: Request processed in 82us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635261.971456:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789635261.971484:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044765aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427260800:0@lo:103: 00000100:00100000:3.0:1789635261.975352:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789635261.975391:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789635261.975405:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447659180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+3:10331:x1876568427259776:12345-0@lo:104: 00010000:00010000:3.0:1789635261.975423:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8c00/0xb0c3a59caa40edae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40edb5 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635261.975533:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789635261.975540:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447659180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+3:10331:x1876568427259776:12345-0@lo:104: Request processed in 142us (34913us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635261.975546:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1789635261.975644:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635261.975653:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8c00/0xb0c3a59caa40edae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40edb5 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635261.975660:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056f6e8c00 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:0.0:1789635261.975665:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8c00/0xb0c3a59caa40edae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40edb5 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635261.975672:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8c00/0xb0c3a59caa40edae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40edb5 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789635261.975679:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8c00/0xb0c3a59caa40edae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40edb5 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635261.975684:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789635261.975749:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8c00/0xb0c3a59caa40edae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40edb5 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635261.975755:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789635261.975790:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8c00/0xb0c3a59caa40edae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40edb5 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635261.975797:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8c00/0xb0c3a59caa40edae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40edb5 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635261.975814:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635261.975815:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635261.975817:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635261.975831:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044765aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427260928:0@lo:103: 00000100:00100000:0.0:1789635261.975872:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635261.975911:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427260928 00000100:00100000:0.0:1789635261.975918:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427260928 00010000:00010000:0.0:1789635261.975941:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0540030200/0xb0c3a59caa40edb5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40edae expref: 16 pid: 6506 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635261.975965:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789635261.975971:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+16:3640:x1876568427260928:12345-0@lo:103: 00010000:00010000:0.0:1789635261.975981:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635261.975986:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0540030200/0xb0c3a59caa40edb5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40edae expref: 16 pid: 6506 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635261.975996:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0540030200/0xb0c3a59caa40edb5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40edae expref: 16 pid: 6506 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635261.976012:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d056e1a2e00/0xb0c3a59caa40ef1a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635261.976026:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e1a2e00/0xb0c3a59caa40ef1a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635261.976052:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d056e1a2e00/0xb0c3a59caa40ef1a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635261.976059:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d056e1a2e00/0xb0c3a59caa40ef1a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635261.976065:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d056e1a2e00/0xb0c3a59caa40ef1a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635261.976071:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d056e1a2e00/0xb0c3a59caa40ef1a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635261.976075:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a2e00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:0.0:1789635261.976078:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d056e1a2e00/0xb0c3a59caa40ef1a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635261.976085:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d056e1a2e00/0xb0c3a59caa40ef1a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635261.976092:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d056e1a2e00/0xb0c3a59caa40ef1a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635261.976101:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635261.976129:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+16:3640:x1876568427260928:12345-0@lo:103: Request processed in 159us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635261.976135:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789635261.976167:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044765aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427260928:0@lo:103: 00010000:00010000:1.0:1789635261.976578:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0540030200/0xb0c3a59caa40edb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40edae expref: 15 pid: 6506 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635261.976591:0:10331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447975880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1876568427259776:0@lo:104: 00010000:00010000:1.0:1789635261.976664:0:10331:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d056e1a2e00/0xb0c3a59caa40ef1a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635261.976674:0:10331:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d056e1a2e00/0xb0c3a59caa40ef1a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635261.976687:0:10331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d056e1a2e00/0xb0c3a59caa40ef1a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635261.976702:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056e1a2e00/0xb0c3a59caa40ef1a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635262.500034:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635262.883842:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789635262.883868:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427261056:0@lo:13: 00000100:00100000:1.0:1789635262.883935:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635262.884042:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427261056 00000100:00100000:3.0:1789635262.884049:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427261056 00000100:00100000:3.0:1789635262.884104:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789635262.884114:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427261056:12345-0@lo:13: 00002000:00000024:3.0:1789635262.884141:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635262.884194:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427261056:12345-0@lo:13: Request processed in 82us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635262.884202:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1789635262.884647:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04467b9500 x1876568427261056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635278 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635262.884664:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427261056:0@lo:13: 10000000:01000000:3.0:1789635263.331946:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789635263.331952:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d0577690000 from 48 10000000:01000000:3.0:1789635263.331957:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789635263.332024:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05820d2c00/0xb0c3a59caa40ef21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635263.332036:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d05820d2c00/0xb0c3a59caa40ef21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635263.332048:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d05820d2c00/0xb0c3a59caa40ef21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635263.332070:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044796ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427261184:0@lo:101: 00000100:00100000:3.0:1789635263.332131:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635263.332174:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b911600 going to sleep for 11 seconds 00000100:00100000:1.0:1789635263.333890:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427261184 00000100:00100000:1.0:1789635263.333901:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427261184 00000100:00100000:1.0:1789635263.333962:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789635263.334023:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+15:6512:x1876568427261184:12345-0@lo:101: 00010000:00010000:1.0:1789635263.334038:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635263.334056:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056e153400/0xb0c3a59caa40ef28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ef21 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635263.334081:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e153400/0xb0c3a59caa40ef28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ef21 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635263.334092:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056e153400/0xb0c3a59caa40ef28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ef21 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635263.334102:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e153400, rc 0) 00000100:00100000:1.0:1789635263.334172:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+16:6512:x1876568427261184:12345-0@lo:101: Request processed in 152us (2040us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635263.334179:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1789635263.334351:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044796ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427261184:0@lo:101: 00010000:00010000:2.0:1789635263.334369:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d05820d2c00/0xb0c3a59caa40ef21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ef28 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635263.334377:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d05820d2c00/0xb0c3a59caa40ef21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ef28 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635263.334442:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427261312:0@lo:501: 00000100:00100000:2.0:1789635263.334473:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635263.334503:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0565a28f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789635263.334877:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427261312 00000100:00100000:3.0:1789635263.334883:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427261312 00000100:00100000:3.0:1789635263.334920:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789635263.334927:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+16:6512:x1876568427261312:12345-0@lo:501: 00000100:00100000:3.0:1789635263.335058:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+16:6512:x1876568427261312:12345-0@lo:501: Request processed in 131us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635263.335065:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789635263.336106:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427261312:0@lo:501: 00000100:00100000:2.0:1789635263.336161:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427261440:0@lo:503: 00000100:00100000:2.0:1789635263.336215:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635263.336252:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0565a28f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789635263.336850:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427261440 00000100:00100000:0.0:1789635263.336858:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427261440 00000100:00100000:0.0:1789635263.336906:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789635263.336914:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+16:6512:x1876568427261440:12345-0@lo:503: 00000100:00100000:0.0:1789635263.337037:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+16:6512:x1876568427261440:12345-0@lo:503: Request processed in 123us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635263.337043:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1789635263.342000:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427261440:0@lo:503: 00000100:00100000:2.0:1789635263.343105:0:10348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467b9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10348:1876568427261568:0@lo:502: 00000100:00100000:2.0:1789635263.343185:0:10348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635263.343229:0:10348:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0565a28a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789635263.343726:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427261568 00000100:00100000:0.0:1789635263.343733:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427261568 00000100:00100000:0.0:1789635263.343781:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789635263.343797:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+16:10348:x1876568427261568:12345-0@lo:502: 00000100:00100000:0.0:1789635263.343934:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+16:10348:x1876568427261568:12345-0@lo:502: Request processed in 138us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635263.343942:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789635263.345844:0:10348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467b9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10348:1876568427261568:0@lo:502: 00000100:00100000:2.0:1789635263.345919:0:10348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467b9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10348:1876568427261696:0@lo:502: 00000100:00100000:2.0:1789635263.345982:0:10348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635263.346023:0:10348:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0565a28a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789635263.346133:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427261696 00000100:00100000:3.0:1789635263.346141:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427261696 00000100:00100000:3.0:1789635263.346186:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789635263.346205:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+16:10348:x1876568427261696:12345-0@lo:502: 00000100:00100000:3.0:1789635263.346442:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+16:10348:x1876568427261696:12345-0@lo:502: Request processed in 116us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635263.346449:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789635263.346585:0:10348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467b9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10348:1876568427261696:0@lo:502: 00000040:00080000:2.0:1789635263.346638:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789635263.350927:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1789635263.350964:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789635263.350976:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05820d2c00/0xb0c3a59caa40ef21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ef28 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635263.351004:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d05820d2c00/0xb0c3a59caa40ef21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ef28 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635263.351015:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1789635263.351017:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1789635263.351020:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789635263.351055:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40ef2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635263.351063:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40ef2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635263.351074:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40ef2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635263.351096:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447968a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427261824:0@lo:101: 00000100:00100000:3.0:1789635263.351167:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635263.351206:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b911780 going to sleep for 11 seconds 00000100:00100000:0.0:1789635263.351533:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427261824 00000100:00100000:0.0:1789635263.351541:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427261824 00000100:00100000:0.0:1789635263.351579:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789635263.351589:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+16:6512:x1876568427261824:12345-0@lo:101: 00010000:00010000:0.0:1789635263.351631:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635263.351644:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056f6e8c00/0xb0c3a59caa40ef36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ef2f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635263.351666:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056f6e8c00/0xb0c3a59caa40ef36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ef2f expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635263.351675:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056f6e8c00/0xb0c3a59caa40ef36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ef2f expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635263.351706:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056f6e8c00, rc 0) 00000100:00100000:0.0:1789635263.351749:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+17:6512:x1876568427261824:12345-0@lo:101: Request processed in 162us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635263.351755:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789635263.352962:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447968a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427261824:0@lo:101: 00010000:00010000:3.0:1789635263.352981:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40ef2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ef36 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635263.353002:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40ef2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ef36 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635263.353074:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447968a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427261952:0@lo:501: 00000100:00100000:3.0:1789635263.353120:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635263.353181:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b911780 going to sleep for 11 seconds 00000100:00100000:1.0:1789635263.353472:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427261952 00000100:00100000:1.0:1789635263.353485:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427261952 00000100:00100000:1.0:1789635263.353542:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1789635263.353552:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+17:6512:x1876568427261952:12345-0@lo:501: 00000100:00100000:1.0:1789635263.353722:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+17:6512:x1876568427261952:12345-0@lo:501: Request processed in 172us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635263.353729:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789635263.356291:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447968a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427261952:0@lo:501: 00000100:00100000:3.0:1789635263.356364:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447968a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427262080:0@lo:503: 00000100:00100000:3.0:1789635263.356435:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635263.356479:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b911780 going to sleep for 11 seconds 00000100:00100000:0.0:1789635263.358153:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427262080 00000100:00100000:0.0:1789635263.358166:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427262080 00000100:00100000:0.0:1789635263.358232:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1789635263.358242:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+17:6512:x1876568427262080:12345-0@lo:503: 00000100:00100000:0.0:1789635263.358401:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+17:6512:x1876568427262080:12345-0@lo:503: Request processed in 160us (1966us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635263.358409:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789635263.363024:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447968a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427262080:0@lo:503: 00000100:00100000:3.0:1789635263.372251:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447968a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10349:1876568427262208:0@lo:502: 00000100:00100000:3.0:1789635263.372345:0:10349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635263.372388:0:10349:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b911e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789635263.373004:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427262208 00000100:00100000:0.0:1789635263.373013:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427262208 00000100:00100000:0.0:1789635263.373072:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1789635263.373082:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+17:10349:x1876568427262208:12345-0@lo:502: 00000100:00100000:0.0:1789635263.373247:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+17:10349:x1876568427262208:12345-0@lo:502: Request processed in 166us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635263.373255:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789635263.373363:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447968a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10349:1876568427262208:0@lo:502: 00000020:01000000:1.0:1789635263.373390:0:10349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789635263.373399:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635263.373401:0:10349:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789635263.373408:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789635263.373435:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477aa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10349:1876568427262336:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635263.373475:0:10349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635263.373507:0:10349:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d056e1e4600 going to sleep for 11 seconds 00000100:00100000:0.0:1789635263.373649:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427262336 00000100:00100000:0.0:1789635263.373654:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427262336 00000100:00100000:0.0:1789635263.373695:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789635263.373703:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+17:10349:x1876568427262336:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789635263.374673:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+17:10349:x1876568427262336:12345-0@lo:502:llog_process_th.0 Request processed in 966us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635263.374693:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789635263.376097:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477aa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10349:1876568427262336:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789635263.376155:0:10349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789635263.376164:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635263.376166:0:10349:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789635263.376172:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1789635263.376665:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1789635263.376700:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789635263.376711:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40ef2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ef36 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635263.376722:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40ef2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ef36 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635263.376732:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789635263.376734:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d056f7ce800 from 48 10000000:01000000:0.0:1789635263.376737:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789635263.376770:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9c00/0xb0c3a59caa40ef3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635263.376778:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9c00/0xb0c3a59caa40ef3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635263.376788:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9c00/0xb0c3a59caa40ef3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635263.376811:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044765aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427262464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789635263.376871:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635263.376908:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446df5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789635263.376926:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427262464 00000100:00100000:0.0:1789635263.376932:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427262464 00000100:00100000:0.0:1789635263.376972:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1789635263.376981:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b817c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+17:6512:x1876568427262464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789635263.376993:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635263.377005:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056f6e8200/0xb0c3a59caa40ef44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ef3d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635263.377039:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056f6e8200/0xb0c3a59caa40ef44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ef3d expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635263.377049:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056f6e8200/0xb0c3a59caa40ef44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ef3d expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635263.377057:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056f6e8200, rc 0) 00000100:00100000:0.0:1789635263.377102:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b817c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+18:6512:x1876568427262464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635263.377108:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789635263.377736:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044765aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427262464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789635263.377750:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9c00/0xb0c3a59caa40ef3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ef44 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635263.377758:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9c00/0xb0c3a59caa40ef3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ef44 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635263.377825:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427262592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635263.377866:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635263.377889:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05461e8300 going to sleep for 11 seconds 00000100:00100000:0.0:1789635263.381433:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427262592 00000100:00100000:0.0:1789635263.381447:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427262592 00000100:00100000:0.0:1789635263.381511:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789635263.381521:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+18:6512:x1876568427262592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789635263.381721:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+18:6512:x1876568427262592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 202us (3854us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635263.381729:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789635263.388829:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427262592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635263.388900:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447968a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427262720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789635263.388977:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635263.389014:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b911240 going to sleep for 11 seconds 00000100:00100000:0.0:1789635263.390477:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427262720 00000100:00100000:0.0:1789635263.390488:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427262720 00000100:00100000:0.0:1789635263.390552:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789635263.390561:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+18:6512:x1876568427262720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789635263.390744:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+18:6512:x1876568427262720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 184us (1766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635263.390752:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789635263.391633:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447968a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427262720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789635263.395973:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427262848:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789635263.396048:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635263.396256:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427262848 00000100:00100000:1.0:1789635263.396265:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427262848 00000100:00100000:1.0:1789635263.396350:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789635263.396362:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427262848:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789635263.396394:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1789635263.396394:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789635263.396456:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427262848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635263.396463:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1789635263.396571:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04477a8380 x1876568427262848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635263.396590:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427262848:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789635263.398034:0:10350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467b9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10350:1876568427262976:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789635263.398101:0:10350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635263.398462:0:10350:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0565a28a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789635263.400161:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427262976 00000100:00100000:1.0:1789635263.400171:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427262976 00000100:00100000:1.0:1789635263.400220:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789635263.400228:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+18:10350:x1876568427262976:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635263.400672:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+18:10350:x1876568427262976:12345-0@lo:502:llog_process_th.0 Request processed in 444us (2570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635263.400680:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789635263.400939:0:10350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467b9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10350:1876568427262976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789635263.400994:0:10350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447968a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10350:1876568427263104:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789635263.401049:0:10350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635263.401083:0:10350:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b911240 going to sleep for 11 seconds 00000100:00100000:0.0:1789635263.401528:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427263104 00000100:00100000:0.0:1789635263.401534:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427263104 00000100:00100000:0.0:1789635263.401575:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789635263.401583:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+18:10350:x1876568427263104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789635263.401716:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+18:10350:x1876568427263104:12345-0@lo:502:llog_process_th.0 Request processed in 133us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635263.401723:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789635263.403965:0:10350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447968a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10350:1876568427263104:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789635263.404017:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789635263.404568:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1789635263.404591:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789635263.404619:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9c00/0xb0c3a59caa40ef3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ef44 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635263.404629:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9c00/0xb0c3a59caa40ef3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ef44 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635263.404652:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789635263.404654:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1789635263.404657:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789635263.404721:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05820d3c00/0xb0c3a59caa40ef4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635263.404730:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d05820d3c00/0xb0c3a59caa40ef4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635263.404739:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d05820d3c00/0xb0c3a59caa40ef4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635263.404760:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044796ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427263232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789635263.404831:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635263.404866:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b911240 going to sleep for 11 seconds 00000100:00100000:1.0:1789635263.406217:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427263232 00000100:00100000:1.0:1789635263.406230:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427263232 00000100:00100000:1.0:1789635263.406283:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789635263.406292:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+18:6512:x1876568427263232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789635263.406309:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635263.406325:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056e153800/0xb0c3a59caa40ef52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ef4b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635263.406364:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e153800/0xb0c3a59caa40ef52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ef4b expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635263.406389:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056e153800/0xb0c3a59caa40ef52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ef4b expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635263.406397:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e153800, rc 0) 00000100:00100000:1.0:1789635263.408919:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+19:6512:x1876568427263232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2621us (4080us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635263.408930:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789635263.413983:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044796ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427263232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789635263.414010:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d05820d3c00/0xb0c3a59caa40ef4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ef52 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635263.416126:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d05820d3c00/0xb0c3a59caa40ef4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ef52 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635263.416255:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044796ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427263360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635263.416339:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635263.416376:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b911240 going to sleep for 11 seconds 00000100:00100000:0.0:1789635263.419648:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427263360 00000100:00100000:0.0:1789635263.419663:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427263360 00000100:00100000:0.0:1789635263.419733:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789635263.419744:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+19:6512:x1876568427263360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789635263.419940:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+19:6512:x1876568427263360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 198us (3599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635263.419948:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789635263.421180:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044796ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427263360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635263.421252:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044796ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427263488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789635263.421337:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635263.421379:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b911240 going to sleep for 11 seconds 00000100:00100000:0.0:1789635263.425863:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427263488 00000100:00100000:0.0:1789635263.425880:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427263488 00000100:00100000:0.0:1789635263.425937:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789635263.425947:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+19:6512:x1876568427263488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789635263.426150:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+19:6512:x1876568427263488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 204us (4812us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635263.426165:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789635263.426279:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044796ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427263488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789635263.428585:0:10351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10351:1876568427263616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635263.428870:0:10351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635263.428928:0:10351:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05461e8480 going to sleep for 11 seconds 00000100:00100000:3.0:1789635263.430403:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635263.430433:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635263.430475:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635263.430496:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635263.430518:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635263.430635:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411477760 00000100:00100000:3.0:1789635263.430644:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411477760 00000100:00100000:3.0:1789635263.430708:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411477888 00000100:00100000:3.0:1789635263.430711:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411477888 00000100:00100000:3.0:1789635263.430734:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 71 00000100:00100000:3.0:1789635263.430743:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044796ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2399:x1876568411477760:12345-192.168.203.20@tcp:400: 00000100:00100000:0.0:1789635263.430953:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427263616 00000100:00100000:0.0:1789635263.430958:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427263616 00000100:00100000:0.0:1789635263.431005:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411477632 00000100:00100000:0.0:1789635263.431009:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411477632 00000100:00100000:0.0:1789635263.431022:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1789635263.431029:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+19:10351:x1876568427263616:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789635263.431046:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044796ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2399:x1876568411477760:12345-192.168.203.20@tcp:400: Request processed in 304us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635263.431052:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 71 00000100:00100000:3.0:1789635263.431069:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 72 00000100:00100000:3.0:1789635263.431075:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575adbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411477888:12345-192.168.203.20@tcp:400: 00000100:00100000:3.0:1789635263.431100:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575adbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411477888:12345-192.168.203.20@tcp:400: Request processed in 25us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635263.431106:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 72 00000100:00100000:3.0:1789635263.431135:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411478016 00000100:00100000:3.0:1789635263.431139:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411478016 00000100:00100000:3.0:1789635263.431185:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411478144 00000100:00100000:3.0:1789635263.431189:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411478144 00000100:00100000:3.0:1789635263.431210:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:3.0:1789635263.431216:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411478016:12345-192.168.203.20@tcp:400: 00000100:00100000:3.0:1789635263.431250:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411478016:12345-192.168.203.20@tcp:400: Request processed in 34us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635263.431257:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:3.0:1789635263.431268:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:3.0:1789635263.431274:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411478144:12345-192.168.203.20@tcp:400: 00000100:00100000:0.0:1789635263.431547:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+19:10351:x1876568427263616:12345-0@lo:502:llog_process_th.0 Request processed in 517us (2676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635263.431554:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1789635263.431588:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 221 00000100:00100000:0.0:1789635263.431622:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+8:2399:x1876568411477632:12345-192.168.203.20@tcp:400: 00000100:00100000:0.0:1789635263.431649:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+8:2399:x1876568411477632:12345-192.168.203.20@tcp:400: Request processed in 55us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635263.431655:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 221 00000100:00100000:3.0:1789635263.432567:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411478144:12345-192.168.203.20@tcp:400: Request processed in 1290us (2045us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635263.432576:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00080000:3.0:1789635263.432623:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789635263.432628:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789635263.432630:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789635263.432633:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635263.435886:0:10351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10351:1876568427263616:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789635263.435931:0:10351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789635263.435940:0:10351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635263.435942:0:10351:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789635263.435947:0:10351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789635263.435983:0:10351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10351:1876568427263744:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635263.438926:0:10351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635263.438966:0:10351:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05461e8480 going to sleep for 11 seconds 00000100:00100000:0.0:1789635263.441587:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427263744 00000100:00100000:0.0:1789635263.441632:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427263744 00000100:00100000:0.0:1789635263.441711:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1789635263.441722:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+19:10351:x1876568427263744:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789635263.441891:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+19:10351:x1876568427263744:12345-0@lo:502:llog_process_th.0 Request processed in 171us (2972us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635263.441898:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789635263.443134:0:10351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10351:1876568427263744:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789635263.443703:0:10351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789635263.443712:0:10351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635263.443722:0:10351:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789635263.443727:0:10351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:2.0:1789635263.444057:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1789635263.444078:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789635263.444089:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05820d3c00/0xb0c3a59caa40ef4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ef52 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635263.444106:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d05820d3c00/0xb0c3a59caa40ef4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ef52 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635263.444116:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789635263.444118:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d0550107000 from 48 10000000:01000000:2.0:1789635263.444121:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789635263.444168:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2800/0xb0c3a59caa40ef59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635263.444176:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2800/0xb0c3a59caa40ef59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635263.444185:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2800/0xb0c3a59caa40ef59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635263.444225:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427263872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789635263.444295:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635263.444335:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0565a28f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789635263.447351:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427263872 00000100:00100000:0.0:1789635263.447365:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427263872 00000100:00100000:0.0:1789635263.447445:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789635263.447455:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+19:6512:x1876568427263872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789635263.447472:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635263.447491:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056f6e9600/0xb0c3a59caa40ef60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ef59 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635263.447518:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056f6e9600/0xb0c3a59caa40ef60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ef59 expref: 20 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635263.447547:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056f6e9600/0xb0c3a59caa40ef60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ef59 expref: 20 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635263.447554:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056f6e9600, rc 0) 00000100:00100000:0.0:1789635263.447663:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+20:6512:x1876568427263872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 209us (3367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635263.447670:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789635263.454572:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427263872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635263.454648:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2800/0xb0c3a59caa40ef59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ef60 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635263.454660:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2800/0xb0c3a59caa40ef59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ef60 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635263.455510:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427264000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635263.455581:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635263.455660:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0565a28f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789635263.456334:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427264000 00000100:00100000:0.0:1789635263.456343:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427264000 00000100:00100000:0.0:1789635263.456393:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789635263.456403:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+20:6512:x1876568427264000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789635263.456548:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+20:6512:x1876568427264000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 146us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635263.456555:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789635263.456844:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427264000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635263.456889:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427264128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789635263.456934:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635263.456971:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b911780 going to sleep for 11 seconds 00000100:00100000:0.0:1789635263.458185:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427264128 00000100:00100000:0.0:1789635263.458195:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427264128 00000100:00100000:0.0:1789635263.458251:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789635263.458261:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+20:6512:x1876568427264128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789635263.458400:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+20:6512:x1876568427264128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (1465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635263.458418:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789635263.458696:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427264128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789635263.459877:0:10352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10352:1876568427264256:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635263.459936:0:10352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635263.459964:0:10352:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05461e8480 going to sleep for 11 seconds 00000100:00100000:0.0:1789635263.460783:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427264256 00000100:00100000:0.0:1789635263.460791:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427264256 00000100:00100000:0.0:1789635263.460847:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1789635263.460856:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+20:10352:x1876568427264256:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789635263.461044:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+20:10352:x1876568427264256:12345-0@lo:502:llog_process_th.0 Request processed in 189us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635263.461052:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789635263.461154:0:10352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10352:1876568427264256:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635263.461201:0:10352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10352:1876568427264384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635263.461240:0:10352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635263.461271:0:10352:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05461e8480 going to sleep for 11 seconds 00000100:00100000:3.0:1789635263.461907:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427264384 00000100:00100000:3.0:1789635263.461913:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427264384 00000100:00100000:3.0:1789635263.461953:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789635263.461960:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+20:10352:x1876568427264384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789635263.462077:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+20:10352:x1876568427264384:12345-0@lo:502:llog_process_th.0 Request processed in 116us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635263.462083:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789635263.462173:0:10352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10352:1876568427264384:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789635263.462195:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789635263.462840:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1789635263.462864:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789635263.462874:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2800/0xb0c3a59caa40ef59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ef60 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635263.462885:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2800/0xb0c3a59caa40ef59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ef60 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635263.462894:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789635263.462897:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1789635263.462900:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789635263.462928:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05820d3e00/0xb0c3a59caa40ef67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635263.462936:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d05820d3e00/0xb0c3a59caa40ef67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635263.462945:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d05820d3e00/0xb0c3a59caa40ef67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635263.462963:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427264512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789635263.463014:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635263.463048:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b911e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789635263.463100:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427264512 00000100:00100000:1.0:1789635263.463116:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427264512 00000100:00100000:1.0:1789635263.463162:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789635263.463170:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b811450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+20:6512:x1876568427264512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789635263.463179:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635263.463190:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056e153c00/0xb0c3a59caa40ef6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ef67 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635263.463211:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e153c00/0xb0c3a59caa40ef6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ef67 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635263.463220:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056e153c00/0xb0c3a59caa40ef6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ef67 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635263.463227:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e153c00, rc 0) 00000100:00100000:1.0:1789635263.463256:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b811450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+21:6512:x1876568427264512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635263.463270:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789635263.463741:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427264512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789635263.463770:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d05820d3e00/0xb0c3a59caa40ef67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ef6e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635263.463779:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d05820d3e00/0xb0c3a59caa40ef67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ef6e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635263.463844:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427264640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635263.463871:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635263.463898:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b911e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789635263.463944:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427264640 00000100:00100000:1.0:1789635263.463949:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427264640 00000100:00100000:1.0:1789635263.463979:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789635263.463997:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b811050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+21:6512:x1876568427264640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635263.464097:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b811050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+21:6512:x1876568427264640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635263.464115:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789635263.464588:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427264640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635263.464650:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427264768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789635263.464702:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635263.464720:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b911e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789635263.464825:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427264768 00000100:00100000:1.0:1789635263.464830:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427264768 00000100:00100000:1.0:1789635263.464851:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789635263.464857:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+21:6512:x1876568427264768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789635263.464932:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+21:6512:x1876568427264768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635263.464938:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1789635263.465571:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427264768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789635263.466970:0:10353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759cbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10353:1876568427264896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789635263.467041:0:10353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635263.467078:0:10353:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b9119c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635263.467316:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427264896 00000100:00100000:1.0:1789635263.467324:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427264896 00000100:00100000:1.0:1789635263.467372:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789635263.467531:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+21:10353:x1876568427264896:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635263.467680:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+21:10353:x1876568427264896:12345-0@lo:502:llog_process_th.0 Request processed in 152us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635263.467702:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789635263.467800:0:10353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759cbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10353:1876568427264896:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789635263.467828:0:10353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789635263.467836:0:10353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635263.467838:0:10353:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789635263.467844:0:10353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789635263.467865:0:10353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447658380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10353:1876568427265024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789635263.467899:0:10353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635263.467926:0:10353:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d054a0bdb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789635263.468081:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427265024 00000100:00100000:1.0:1789635263.468087:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427265024 00000100:00100000:1.0:1789635263.468280:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789635263.468289:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+21:10353:x1876568427265024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635263.468395:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+21:10353:x1876568427265024:12345-0@lo:502:llog_process_th.0 Request processed in 108us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635263.468503:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789635263.468580:0:10353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447658380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10353:1876568427265024:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789635263.468622:0:10353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789635263.468627:0:10353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635263.468629:0:10353:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789635263.468633:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:1.0:1789635263.497157:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:1.0:1789635263.497190:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789635263.497202:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05820d3e00/0xb0c3a59caa40ef67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ef6e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635263.497214:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d05820d3e00/0xb0c3a59caa40ef67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ef6e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635263.497227:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789635263.497230:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d0558960000 from 48 10000000:01000000:1.0:1789635263.497234:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789635263.497272:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152200/0xb0c3a59caa40ef75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635263.497281:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056e152200/0xb0c3a59caa40ef75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635263.497292:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056e152200/0xb0c3a59caa40ef75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635263.497318:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427265152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789635263.497401:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635263.497869:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549fa8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789635263.498590:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427265152 00000100:00100000:0.0:1789635263.498625:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427265152 00000100:00100000:0.0:1789635263.498679:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789635263.498699:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+21:6512:x1876568427265152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789635263.498713:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635263.498729:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056f6e8e00/0xb0c3a59caa40ef7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ef75 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635263.498897:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056f6e8e00/0xb0c3a59caa40ef7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ef75 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635263.498912:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056f6e8e00/0xb0c3a59caa40ef7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ef75 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635263.498920:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056f6e8e00, rc 0) 00000100:00100000:0.0:1789635263.499510:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+22:6512:x1876568427265152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 812us (2108us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635263.499536:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789635263.505923:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427265152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635263.505950:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056e152200/0xb0c3a59caa40ef75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ef7c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635263.505963:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056e152200/0xb0c3a59caa40ef75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ef7c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635263.507665:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427265280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635263.508060:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635263.508251:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0565a28a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789635263.511891:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427265280 00000100:00100000:3.0:1789635263.511905:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427265280 00000100:00100000:3.0:1789635263.511970:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789635263.511980:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+22:6512:x1876568427265280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635263.512514:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+22:6512:x1876568427265280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 534us (4454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635263.512523:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789635263.512640:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427265280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635263.512701:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427265408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789635263.512780:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635263.512808:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549fa8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789635263.512972:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427265408 00000100:00100000:0.0:1789635263.512977:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427265408 00000100:00100000:0.0:1789635263.513027:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789635263.513035:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+22:6512:x1876568427265408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789635263.513150:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+22:6512:x1876568427265408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635263.513157:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789635263.513665:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427265408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789635263.514674:0:10354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477a9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10354:1876568427265536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635263.514757:0:10354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635263.514803:0:10354:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549fa8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789635263.514965:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427265536 00000100:00100000:3.0:1789635263.514971:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427265536 00000100:00100000:3.0:1789635263.515012:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789635263.515020:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+22:10354:x1876568427265536:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789635263.515153:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+22:10354:x1876568427265536:12345-0@lo:502:llog_process_th.0 Request processed in 134us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635263.515161:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789635263.517964:0:10354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477a9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10354:1876568427265536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635263.518053:0:10354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477a9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10354:1876568427265664:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635263.518135:0:10354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635263.518181:0:10354:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05746cf0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635263.518924:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427265664 00000100:00100000:0.0:1789635263.518932:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427265664 00000100:00100000:0.0:1789635263.518981:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789635263.519002:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+22:10354:x1876568427265664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789635263.519149:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+22:10354:x1876568427265664:12345-0@lo:502:llog_process_th.0 Request processed in 141us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635263.519157:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789635263.520193:0:10354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477a9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10354:1876568427265664:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789635263.520230:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789635263.520934:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789635263.520957:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789635263.520967:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152200/0xb0c3a59caa40ef75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ef7c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635263.520978:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e152200/0xb0c3a59caa40ef75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ef7c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635263.521000:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789635263.521003:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1789635263.521006:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789635263.521040:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8a00/0xb0c3a59caa40ef83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635263.521059:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8a00/0xb0c3a59caa40ef83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635263.521070:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8a00/0xb0c3a59caa40ef83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635263.521095:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447658a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427265792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789635263.521167:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635263.521202:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549c0ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1789635263.521787:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427265792 00000100:00100000:0.0:1789635263.521795:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427265792 00000100:00100000:0.0:1789635263.521841:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789635263.521850:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+22:6512:x1876568427265792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789635263.521862:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635263.521876:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056f6e9200/0xb0c3a59caa40ef8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ef83 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635263.521896:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056f6e9200/0xb0c3a59caa40ef8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ef83 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635263.521906:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056f6e9200/0xb0c3a59caa40ef8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ef83 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635263.521915:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056f6e9200, rc 0) 00000100:00100000:0.0:1789635263.521964:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+23:6512:x1876568427265792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635263.521971:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789635263.522124:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447658a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427265792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635263.522146:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8a00/0xb0c3a59caa40ef83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ef8a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635263.522155:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8a00/0xb0c3a59caa40ef83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ef8a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635263.522212:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427265920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635263.522239:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635263.522269:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0565a289c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635263.522522:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427265920 00000100:00100000:3.0:1789635263.522528:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427265920 00000100:00100000:3.0:1789635263.522562:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789635263.522569:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+23:6512:x1876568427265920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635263.522711:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+23:6512:x1876568427265920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635263.522717:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789635263.523084:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427265920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635263.523137:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427266048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789635263.523185:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635263.523208:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0565a289c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635263.523222:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427266048 00000100:00100000:2.0:1789635263.523226:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427266048 00000100:00100000:2.0:1789635263.523245:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789635263.523252:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+23:6512:x1876568427266048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789635263.523327:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+23:6512:x1876568427266048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635263.523345:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789635263.523395:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427266048:0@lo:503:ll_cfg_requeue.0 00010000:00010000:3.0:1789635263.524119:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635263.524787:0:10355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044765a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10355:1876568427266176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789635263.524845:0:10355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635263.524880:0:10355:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05513aecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635263.525014:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427266176 00000100:00100000:2.0:1789635263.525021:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427266176 00000100:00100000:2.0:1789635263.525061:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789635263.525070:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+23:10355:x1876568427266176:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789635263.525193:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+23:10355:x1876568427266176:12345-0@lo:502:llog_process_th.0 Request processed in 123us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635263.525200:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789635263.525958:0:10355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044765a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10355:1876568427266176:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789635263.526002:0:10355:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789635263.526011:0:10355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635263.526014:0:10355:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789635263.526020:0:10355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789635263.526047:0:10355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044765a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10355:1876568427266304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789635263.526093:0:10355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635263.526286:0:10355:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05513aecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635263.530277:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427266304 00000100:00100000:3.0:1789635263.530293:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427266304 00000100:00100000:3.0:1789635263.530359:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789635263.530369:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+23:10355:x1876568427266304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789635263.531035:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+23:10355:x1876568427266304:12345-0@lo:502:llog_process_th.0 Request processed in 667us (4940us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635263.531044:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789635263.531269:0:10355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044765a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10355:1876568427266304:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789635263.531303:0:10355:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635263.531310:0:10355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635263.531312:0:10355:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789635263.531317:0:10355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1789635263.531718:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:2.0:1789635263.531746:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789635263.531756:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8a00/0xb0c3a59caa40ef83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ef8a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635263.531776:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8a00/0xb0c3a59caa40ef83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ef8a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635263.531798:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789635263.531801:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d057ae4b380 from 1 10000000:01000000:2.0:1789635263.531803:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789635263.531832:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2000/0xb0c3a59caa40ef91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635263.531840:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2000/0xb0c3a59caa40ef91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635263.531850:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2000/0xb0c3a59caa40ef91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635263.531870:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427266432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789635263.531910:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635263.531946:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0565a28a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789635263.532148:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427266432 00000100:00100000:3.0:1789635263.532154:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427266432 00000100:00100000:3.0:1789635263.532192:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789635263.532201:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+23:6512:x1876568427266432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789635263.532212:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635263.532225:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d054139ce00/0xb0c3a59caa40ef98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40ef91 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635263.532247:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d054139ce00/0xb0c3a59caa40ef98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40ef91 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635263.532266:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d054139ce00/0xb0c3a59caa40ef98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ef91 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635263.532275:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d054139ce00, rc 0) 00000100:00100000:3.0:1789635263.532313:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+24:6512:x1876568427266432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635263.532319:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789635263.532647:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427266432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789635263.532660:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2000/0xb0c3a59caa40ef91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ef98 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635263.532667:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2000/0xb0c3a59caa40ef91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ef98 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635263.532726:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044765a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427266560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789635263.532769:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635263.532788:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05513aecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635263.533151:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427266560 00000100:00100000:2.0:1789635263.533157:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427266560 00000100:00100000:2.0:1789635263.533194:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789635263.533202:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:6512:x1876568427266560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635263.533284:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:6512:x1876568427266560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 81us (520us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789635263.533291:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789635263.533643:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044765a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427266560:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789635263.533694:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789635263.533701:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2000/0xb0c3a59caa40ef91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ef98 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635263.533710:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2000/0xb0c3a59caa40ef91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ef98 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635263.609851:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635263.610006:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411478272 00000100:00100000:0.0:1789635263.610017:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411478272 00000100:00100000:0.0:1789635263.610075:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 245 00000100:00100000:0.0:1789635263.610085:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+8:6165:x1876568411478272:12345-192.168.203.20@tcp:101: 00010000:00010000:0.0:1789635263.610102:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635263.610129:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056f6e9400/0xb0c3a59caa40ef9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73ed9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635263.610165:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056f6e9400/0xb0c3a59caa40ef9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ed9 expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635263.610176:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056f6e9400/0xb0c3a59caa40ef9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ed9 expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635263.610185:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056f6e9400, rc 0) 00000100:00100000:0.0:1789635263.610237:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+9:6165:x1876568411478272:12345-192.168.203.20@tcp:101: Request processed in 153us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635263.610244:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 245 00000100:00100000:1.0:1789635263.623511:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635263.623728:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411478400 00000100:00100000:3.0:1789635263.623738:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411478400 00000100:00100000:3.0:1789635263.624087:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 246 00000100:00100000:3.0:1789635263.624098:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054645ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+9:6165:x1876568411478400:12345-192.168.203.20@tcp:501: 00000100:00100000:3.0:1789635263.624264:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054645ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+9:6165:x1876568411478400:12345-192.168.203.20@tcp:501: Request processed in 168us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635263.624271:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 246 00000100:00100000:1.0:1789635263.635035:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635263.636225:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411478528 00000100:00100000:3.0:1789635263.636238:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411478528 00000100:00100000:3.0:1789635263.636336:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 247 00000100:00100000:3.0:1789635263.636468:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546459850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+9:6165:x1876568411478528:12345-192.168.203.20@tcp:503: 00000100:00100000:3.0:1789635263.636671:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546459850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+9:6165:x1876568411478528:12345-192.168.203.20@tcp:503: Request processed in 270us (1643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635263.636688:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 247 00000100:00100000:2.0:1789635263.642276:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635263.642518:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411478656 00000100:00100000:3.0:1789635263.642528:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411478656 00000100:00100000:3.0:1789635263.642645:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 248 00000100:00100000:3.0:1789635263.642654:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054645b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+9:6646:x1876568411478656:12345-192.168.203.20@tcp:502: 00000100:00100000:3.0:1789635263.642849:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054645b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+9:6646:x1876568411478656:12345-192.168.203.20@tcp:502: Request processed in 195us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635263.642857:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 248 00000100:00100000:1.0:1789635263.647669:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635263.648239:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411478784 00000100:00100000:3.0:1789635263.648250:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411478784 00000100:00100000:3.0:1789635263.648353:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 249 00000100:00100000:3.0:1789635263.648363:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546458850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+9:6646:x1876568411478784:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789635263.648517:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546458850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+9:6646:x1876568411478784:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 155us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635263.648525:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 249 00000100:00100000:1.0:1789635263.654524:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635263.655325:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411478912 00000100:00100000:3.0:1789635263.655397:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411478912 00000100:00100000:3.0:1789635263.655576:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 250 00000100:00100000:3.0:1789635263.655588:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054645bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+9:6165:x1876568411478912:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789635263.655623:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635263.655641:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d054139c800/0xb0c3a59caa40efa6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73ee0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635263.655669:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d054139c800/0xb0c3a59caa40efa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ee0 expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635263.655679:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d054139c800/0xb0c3a59caa40efa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ee0 expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635263.655700:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d054139c800, rc 0) 00000100:00100000:3.0:1789635263.655795:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054645bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:6165:x1876568411478912:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 Request processed in 209us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635263.655815:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 250 00000100:00100000:2.0:1789635263.659679:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635263.660691:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411479040 00000100:00100000:3.0:1789635263.660703:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411479040 00000100:00100000:2.0:1789635263.661263:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 251 00000100:00100000:2.0:1789635263.661276:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546459450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:6165:x1876568411479040:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635263.661435:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546459450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:6165:x1876568411479040:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 Request processed in 162us (1763us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789635263.661444:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 251 00010000:00010000:1.0:1789635264.551300:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635264.931951:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427266688:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789635264.932019:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635264.932075:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427266688 00000100:00100000:2.0:1789635264.932083:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427266688 00000100:00100000:2.0:1789635264.932132:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789635264.932141:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427266688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789635264.932173:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789635264.932231:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427266688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635264.932237:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789635264.932280:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427266688:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789635264.932367:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789635264.932380:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044765a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427266816:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789635264.932410:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635264.932453:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427266816 00000100:00100000:0.0:1789635264.932458:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427266816 00000100:00100000:0.0:1789635264.932484:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789635264.932491:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427266816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789635264.932510:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789635264.932545:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427266816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635264.932551:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789635264.932583:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044765a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427266816:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1789635265.390899:0:10392:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea1ab14a0 20000000:00000080:3.0:1789635265.390916:0:10392:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d04479b3000 uarg=0000000000000000 20000000:01000000:3.0:1789635265.390954:0:10392:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789635265.390960:0:10392:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789635265.390965:0:10392:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789635265.393070:0:10393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1789635265.393260:0:10392:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1789635265.398489:0:10392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1789635265.398521:0:10392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1789635265.398534:0:10392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1789635265.398547:0:10392:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789635265.398567:0:10392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40efad lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635265.398583:0:10392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d056f6e8600/0xb0c3a59caa40ec49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ec42 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635265.398590:0:10392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0540030c00/0xb0c3a59caa40ec57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40ec50 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635265.398623:0:10392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d056f6e8400/0xb0c3a59caa40ecab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40eca4 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635265.398630:0:10392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40edd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40edca expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635265.398639:0:10392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d056f6e9a00/0xb0c3a59caa40eee9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ea1 expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635265.398665:0:10392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40efad lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635265.398743:0:10392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d056f6e9a00/0xb0c3a59caa40eee9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ea1 expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635265.398767:0:10392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d056f6e9a00/0xb0c3a59caa40eee9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ea1 expref: 9 pid: 6509 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635265.398783:0:10392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759cbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1876568427266944:192.168.203.20@tcp:104: 00010000:00010000:3.0:1789635265.398927:0:10392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40edd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40edca expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635265.398936:0:10392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40edd1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40edca expref: 23 pid: 6508 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635265.398946:0:10392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447975880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1876568427267072:0@lo:104: 00000100:00100000:3.0:1789635265.398985:0:10392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789635265.399023:0:10392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d056f6e8400/0xb0c3a59caa40ecab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40eca4 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635265.399030:0:10392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d056f6e8400/0xb0c3a59caa40ecab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40eca4 expref: 23 pid: 6509 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635265.399039:0:10392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447974a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1876568427267200:0@lo:104: 00000100:00100000:3.0:1789635265.399062:0:10392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635265.399091:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427267072 00000100:00100000:2.0:1789635265.399097:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789635265.399099:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427267072 00000100:00100000:2.0:1789635265.399107:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427267200 00000100:00100000:2.0:1789635265.399109:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427267200 00000100:00100000:2.0:1789635265.399140:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789635265.399148:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446765050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+4:10392:x1876568427267200:12345-0@lo:104: 00010000:00010000:2.0:1789635265.399165:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8000/0xb0c3a59caa40eca4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ecab expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.399213:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1789635265.399385:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635265.399392:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8000/0xb0c3a59caa40eca4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ecab expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635265.399400:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056f6e8000 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:0.0:1789635265.399404:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8000/0xb0c3a59caa40eca4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40ecab expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635265.399412:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8000/0xb0c3a59caa40eca4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40ecab expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789635265.399419:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8000/0xb0c3a59caa40eca4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40ecab expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635265.399424:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789635265.399466:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8000/0xb0c3a59caa40eca4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ecab expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635265.399473:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789635265.399494:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8000/0xb0c3a59caa40eca4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ecab expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635265.399512:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8000/0xb0c3a59caa40eca4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ecab expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635265.399525:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635265.399527:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635265.399528:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635265.399547:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044765a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427267328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789635265.399579:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635265.399752:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446765050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+4:10392:x1876568427267200:12345-0@lo:104: Request processed in 604us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635265.399779:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427267328 00000100:00100000:0.0:1789635265.399847:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427267328 00010000:00010000:0.0:1789635265.399869:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d056f6e8400/0xb0c3a59caa40ecab lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40eca4 expref: 24 pid: 6509 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635265.399894:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789635265.399901:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447659f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3641:x1876568427267328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789635265.399911:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635265.399916:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d056f6e8400/0xb0c3a59caa40ecab lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40eca4 expref: 24 pid: 6509 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635265.399924:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d056f6e8400/0xb0c3a59caa40ecab lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40eca4 expref: 24 pid: 6509 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635265.399938:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635265.399968:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447659f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3641:x1876568427267328:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635265.399974:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789635265.400025:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044765a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427267328:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789635265.400330:0:10392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0540030c00/0xb0c3a59caa40ec57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40ec50 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635265.400340:0:10392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d0540030c00/0xb0c3a59caa40ec57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40ec50 expref: 23 pid: 6509 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635265.400351:0:10392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447974e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1876568427267456:0@lo:104: 00000100:00100000:3.0:1789635265.400375:0:10392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789635265.400451:0:10392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d056f6e8600/0xb0c3a59caa40ec49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40ec42 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635265.400459:0:10392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d056f6e8600/0xb0c3a59caa40ec49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40ec42 expref: 23 pid: 6506 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635265.400467:0:10392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447977b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1876568427267584:0@lo:104: 00000100:00100000:3.0:1789635265.400485:0:10392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635265.400505:0:6498:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1789635265.400532:0:10392:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d054c33ccc0 going to sleep for 11 seconds 00010000:00010000:3.0:1789635265.400544:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056f6e8400/0xb0c3a59caa40ecab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40eca4 expref: 23 pid: 6509 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635265.400553:0:10392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447974a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1876568427267200:0@lo:104: 00000100:00100000:0.0:1789635265.400586:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:0.0:1789635265.401292:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427267456 00000100:00100000:0.0:1789635265.401299:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427267456 00000100:00100000:0.0:1789635265.401324:0:6498:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1789635265.401328:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427267584 00000100:00100000:0.0:1789635265.401330:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427267584 00000100:00100000:3.0:1789635265.401411:0:10394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789635265.401420:0:10394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447976d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+6:10392:x1876568427267072:12345-0@lo:104: 00010000:00010000:3.0:1789635265.401433:0:10394:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d05820d3000/0xb0c3a59caa40edca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40edd1 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635265.401528:0:10394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789635265.401534:0:10394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447976d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+6:10392:x1876568427267072:12345-0@lo:104: Request processed in 116us (2549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635265.401550:0:10394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789635265.401567:0:10394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789635265.401573:0:10394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447977800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+5:10392:x1876568427267456:12345-0@lo:104: 00010000:00010000:3.0:1789635265.401581:0:10394:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d054139de00/0xb0c3a59caa40ec50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ec57 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635265.401651:0:10394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789635265.401656:0:10394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447977800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+5:10392:x1876568427267456:12345-0@lo:104: Request processed in 84us (1280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635265.401661:0:10394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789635265.401684:0:10394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789635265.401691:0:10394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447975c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+4:10392:x1876568427267584:12345-0@lo:104: 00010000:00010000:3.0:1789635265.401698:0:10394:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d05820d3600/0xb0c3a59caa40ec42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ec49 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635265.401745:0:10394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789635265.401751:0:10394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447975c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+4:10392:x1876568427267584:12345-0@lo:104: Request processed in 61us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635265.401763:0:10394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1789635265.401910:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789635265.401917:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d05820d3000/0xb0c3a59caa40edca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40edd1 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.401924:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05820d3000 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:1.0:1789635265.401928:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d05820d3000/0xb0c3a59caa40edca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40edd1 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.401937:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d05820d3000/0xb0c3a59caa40edca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40edd1 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789635265.401954:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d05820d3000/0xb0c3a59caa40edca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40edd1 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635265.401960:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789635265.401996:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d05820d3000/0xb0c3a59caa40edca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40edd1 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.402001:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789635265.402019:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d05820d3000/0xb0c3a59caa40edca lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40edd1 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.402026:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d05820d3000/0xb0c3a59caa40edca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40edd1 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.402038:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789635265.402041:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d054139de00/0xb0c3a59caa40ec50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ec57 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.402047:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d054139de00 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:1.0:1789635265.402050:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d054139de00/0xb0c3a59caa40ec50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40ec57 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.402056:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d054139de00/0xb0c3a59caa40ec50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40ec57 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789635265.402063:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d054139de00/0xb0c3a59caa40ec50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40ec57 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635265.402068:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789635265.402087:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d054139de00/0xb0c3a59caa40ec50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ec57 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.402093:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789635265.402099:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d054139de00/0xb0c3a59caa40ec50 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ec57 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.402105:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d054139de00/0xb0c3a59caa40ec50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ec57 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.402115:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635265.402118:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d05820d3600/0xb0c3a59caa40ec42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40ec49 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.402123:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05820d3600 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:1.0:1789635265.402126:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d05820d3600/0xb0c3a59caa40ec42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40ec49 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.402133:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d05820d3600/0xb0c3a59caa40ec42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40ec49 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789635265.402139:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d05820d3600/0xb0c3a59caa40ec42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40ec49 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635265.402143:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789635265.402152:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d05820d3600/0xb0c3a59caa40ec42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ec49 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.402157:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789635265.402168:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d05820d3600/0xb0c3a59caa40ec42 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ec49 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.402183:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d05820d3600/0xb0c3a59caa40ec42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40ec49 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.402195:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635265.402196:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635265.402198:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635265.402204:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635265.402214:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427267712:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789635265.402246:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635265.402274:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789635265.402279:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427267840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789635265.402305:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635265.402330:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427267712 00000100:00100000:1.0:1789635265.402335:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427267712 00010000:00010000:1.0:1789635265.402353:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40edd1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40edca expref: 23 pid: 6508 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635265.402371:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427267840 00000100:00100000:1.0:1789635265.402373:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427267840 00010000:00010000:1.0:1789635265.402380:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0540030c00/0xb0c3a59caa40ec57 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ec50 expref: 24 pid: 6509 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635265.402394:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789635265.402400:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3642:x1876568427267712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789635265.402407:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635265.402412:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40edd1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40edca expref: 24 pid: 6508 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.402430:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40edd1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40edca expref: 24 pid: 6508 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.402443:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635265.402466:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3642:x1876568427267712:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635265.402472:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789635265.402483:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789635265.402488:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+23:3642:x1876568427267840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789635265.402495:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635265.402499:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0540030c00/0xb0c3a59caa40ec57 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ec50 expref: 23 pid: 6509 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.402507:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0540030c00/0xb0c3a59caa40ec57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40ec50 expref: 23 pid: 6509 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.402515:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635265.402530:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+23:3642:x1876568427267840:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635265.402535:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789635265.402552:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427267968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789635265.402571:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635265.402590:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427267968 00000100:00100000:1.0:1789635265.402617:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427267968 00010000:00010000:1.0:1789635265.402629:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d056f6e8600/0xb0c3a59caa40ec49 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ec42 expref: 23 pid: 6506 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635265.402646:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789635265.402659:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b405c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+23:3640:x1876568427267968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789635265.402710:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635265.402716:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d056f6e8600/0xb0c3a59caa40ec49 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40ec42 expref: 23 pid: 6506 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.402723:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d056f6e8600/0xb0c3a59caa40ec49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40ec42 expref: 23 pid: 6506 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.402741:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635265.402922:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b405c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+23:3640:x1876568427267968:12345-0@lo:103:ldlm_bl.0 Request processed in 264us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635265.402928:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789635265.402976:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427267968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789635265.402997:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427267840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789635265.403004:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427267712:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789635265.403131:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40edd1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40edca expref: 22 pid: 6508 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635265.403142:0:10392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447975880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1876568427267072:0@lo:104: 00010000:00010000:0.0:1789635265.403152:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0540030c00/0xb0c3a59caa40ec57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40ec50 expref: 21 pid: 6509 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635265.403160:0:10392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447974e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1876568427267456:0@lo:104: 00010000:00010000:0.0:1789635265.403167:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056f6e8600/0xb0c3a59caa40ec49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40ec42 expref: 20 pid: 6506 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635265.403174:0:10392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447977b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1876568427267584:0@lo:104: 00010000:00010000:0.0:1789635265.403188:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635265.403266:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789635265.414754:0:10392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759cbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1876568427266944:192.168.203.20@tcp:104: 00010000:00010000:3.0:1789635265.414798:0:10392:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40efad lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635265.414893:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635265.415021:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411479168 00000100:00100000:1.0:1789635265.415029:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411479168 00010000:00010000:1.0:1789635265.415063:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d056f6e9a00/0xb0c3a59caa40eee9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ea1 expref: 10 pid: 6509 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635265.415104:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 39 00000100:00100000:1.0:1789635265.415113:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:2396:x1876568411479168:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635265.415127:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635265.415132:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d056f6e9a00/0xb0c3a59caa40eee9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ea1 expref: 10 pid: 6509 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.415144:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d056f6e9a00/0xb0c3a59caa40eee9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ea1 expref: 10 pid: 6509 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.415174:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056f6e9a00/0xb0c3a59caa40eee9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ea1 expref: 10 pid: 6509 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.415189:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40efad lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.415198:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40efad lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.415213:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40efad lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.415219:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40efad lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.415225:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40efad lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.415232:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40efad lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.415238:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d054139c000 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:1.0:1789635265.415242:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40efad lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.415249:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40efad lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.415270:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40efad lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.415290:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789635265.415292:0:10392:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40efad lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635265.415298:0:10392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40efad lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635265.415303:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d054139c000/0xb0c3a59caa40efad lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635265.415339:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd20b267-9db1-4540-8a6a-0af57c4f3581+9:2396:x1876568411479168:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 227us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635265.415346:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 39 00010000:00010000:3.0:1789635265.592585:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635266.631431:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789635266.915691:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789635266.915698:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0577690000 from 4 10000000:01000000:3.0:1789635266.915702:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789635266.915767:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d054139c600/0xb0c3a59caa40efb4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635266.915780:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d054139c600/0xb0c3a59caa40efb4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635266.915792:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d054139c600/0xb0c3a59caa40efb4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635266.915815:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447977b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427268096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789635266.916077:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635266.916124:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0550647f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789635266.916161:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427268096 00000100:00100000:2.0:1789635266.916170:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427268096 00000100:00100000:2.0:1789635266.916233:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1789635266.916243:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546459050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+20:6512:x1876568427268096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635266.916256:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635266.916270:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056e1a2c00/0xb0c3a59caa40efbb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40efb4 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635266.916292:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e1a2c00/0xb0c3a59caa40efbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40efb4 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635266.916301:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056e1a2c00/0xb0c3a59caa40efbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40efb4 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635266.916310:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a2c00, rc 0) 00000100:00100000:2.0:1789635266.916349:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546459050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+21:6512:x1876568427268096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635266.916356:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789635266.917116:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447977b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427268096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789635266.917134:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d054139c600/0xb0c3a59caa40efb4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40efbb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635266.917144:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d054139c600/0xb0c3a59caa40efb4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40efbb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635266.917207:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447977b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427268224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635266.917239:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635266.917265:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0550647f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789635266.919876:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427268224 00000100:00100000:2.0:1789635266.919889:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427268224 00000100:00100000:2.0:1789635266.919949:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789635266.919958:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054645b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+21:6512:x1876568427268224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635266.920097:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054645b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+21:6512:x1876568427268224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (2857us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635266.920104:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789635266.920313:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447977b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427268224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635266.920360:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447adfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427268352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789635266.920400:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635266.920432:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05746cf540 going to sleep for 11 seconds 00000100:00100000:3.0:1789635266.920623:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427268352 00000100:00100000:3.0:1789635266.920628:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427268352 00000100:00100000:3.0:1789635266.920669:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789635266.920677:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054645a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+21:6512:x1876568427268352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789635266.921088:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054645a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+21:6512:x1876568427268352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 411us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635266.921105:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789635266.921147:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447adfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427268352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789635266.934073:0:10425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10425:1876568427268480:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789635266.934162:0:10425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635266.934200:0:10425:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446df53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635266.934251:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427268480 00000100:00100000:1.0:1789635266.934258:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427268480 00000100:00100000:1.0:1789635266.934302:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789635266.934312:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054645a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+21:10425:x1876568427268480:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635266.934424:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054645a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+21:10425:x1876568427268480:12345-0@lo:502:llog_process_th.0 Request processed in 114us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635266.934432:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789635266.935395:0:10425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10425:1876568427268480:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789635266.935429:0:10425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789635266.935438:0:10425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635266.935440:0:10425:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789635266.935446:0:10425:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d0577690000 00000020:00000080:2.0:1789635266.935449:0:10425:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789635266.935527:0:10425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10425:1876568427268608:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789635266.935569:0:10425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635266.935622:0:10425:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446df53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635266.937873:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427268608 00000100:00100000:1.0:1789635266.937886:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427268608 00000100:00100000:1.0:1789635266.937942:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789635266.937951:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0565a0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+21:10425:x1876568427268608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635266.938098:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0565a0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+21:10425:x1876568427268608:12345-0@lo:502:llog_process_th.0 Request processed in 148us (2528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635266.938106:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789635266.938346:0:10425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10425:1876568427268608:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789635266.938378:0:10425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789635266.938385:0:10425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635266.938387:0:10425:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789635266.938391:0:10425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789635266.938674:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789635266.938701:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789635266.938709:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d054139c600/0xb0c3a59caa40efb4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40efbb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635266.938727:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d054139c600/0xb0c3a59caa40efb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40efbb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635266.938737:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789635266.938739:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d056f7ce800 from 4 10000000:01000000:1.0:1789635266.938742:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789635266.938770:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40efc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635266.938778:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40efc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635266.938787:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40efc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635266.938879:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447adf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427268736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789635266.938915:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635266.938946:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05746cf600 going to sleep for 11 seconds 00000100:00100000:2.0:1789635266.939313:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427268736 00000100:00100000:2.0:1789635266.939319:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427268736 00000100:00100000:2.0:1789635266.939350:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789635266.939356:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0565a08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+21:6512:x1876568427268736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635266.939366:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635266.939377:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056e1a3000/0xb0c3a59caa40efc9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40efc2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635266.939399:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e1a3000/0xb0c3a59caa40efc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40efc2 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635266.939419:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056e1a3000/0xb0c3a59caa40efc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40efc2 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635266.939427:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a3000, rc 0) 00000100:00100000:2.0:1789635266.939460:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0565a08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+22:6512:x1876568427268736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635266.939466:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789635266.939498:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447adf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427268736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635266.939509:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40efc2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40efc9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635266.939517:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40efc2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40efc9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635266.939561:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427268864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635266.939582:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635266.939628:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446df5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789635266.939640:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427268864 00000100:00100000:2.0:1789635266.939644:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427268864 00000100:00100000:2.0:1789635266.939676:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789635266.939682:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0565a0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+22:6512:x1876568427268864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635266.939765:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0565a0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+22:6512:x1876568427268864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 83us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635266.939772:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789635266.939909:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427268864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635266.939941:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427268992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789635266.939971:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635266.939982:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446df5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789635266.939993:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427268992 00000100:00100000:2.0:1789635266.939996:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427268992 00000100:00100000:2.0:1789635266.940012:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789635266.940018:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0565a09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+22:6512:x1876568427268992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789635266.940080:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0565a09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+22:6512:x1876568427268992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635266.940086:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789635266.940118:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427268992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789635266.944017:0:10427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447974e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10427:1876568427269120:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789635266.944083:0:10427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635266.944119:0:10427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05759636c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635266.944180:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427269120 00000100:00100000:2.0:1789635266.944187:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427269120 00000100:00100000:2.0:1789635266.944405:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789635266.944415:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0565a09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+22:10427:x1876568427269120:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789635266.944529:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0565a09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+22:10427:x1876568427269120:12345-0@lo:502:llog_process_th.0 Request processed in 115us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635266.944536:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789635266.945160:0:10427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447974e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10427:1876568427269120:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789635266.945295:0:10427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789635266.945306:0:10427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635266.945308:0:10427:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789635266.945314:0:10427:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d056f7ce800 00000020:00000080:3.0:1789635266.945317:0:10427:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789635266.946396:0:10427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447974e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10427:1876568427269248:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789635266.946476:0:10427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635266.946512:0:10427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549d8f300 going to sleep for 11 seconds 00000100:00100000:3.0:1789635266.946549:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427269248 00000100:00100000:3.0:1789635266.946555:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427269248 00000100:00100000:3.0:1789635266.946592:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789635266.946617:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0565a0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+22:10427:x1876568427269248:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789635266.946723:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0565a0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+22:10427:x1876568427269248:12345-0@lo:502:llog_process_th.0 Request processed in 107us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635266.946731:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789635266.946772:0:10427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447974e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10427:1876568427269248:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789635266.952100:0:10427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789635266.952131:0:10427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635266.952134:0:10427:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789635266.952585:0:10427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789635266.957859:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789635266.957887:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789635266.957897:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40efc2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40efc9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635266.957910:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40efc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40efc9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635266.957933:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789635266.957935:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0550107000 from 4 10000000:01000000:2.0:1789635266.957938:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789635266.957969:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3a00/0xb0c3a59caa40efd0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635266.957977:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3a00/0xb0c3a59caa40efd0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635266.957987:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3a00/0xb0c3a59caa40efd0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635266.958008:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427269376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789635266.958063:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635266.958103:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446df56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635266.959322:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427269376 00000100:00100000:0.0:1789635266.959336:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427269376 00000100:00100000:0.0:1789635266.959432:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789635266.959476:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+22:6512:x1876568427269376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789635266.959501:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635266.959542:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40efd7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40efd0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635266.962316:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40efd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40efd0 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635266.962339:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40efd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40efd0 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635266.962349:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056f6e9000, rc 0) 00000100:00100000:0.0:1789635266.962426:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+23:6512:x1876568427269376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2985us (4361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635266.962435:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789635266.963019:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427269376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789635266.963037:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3a00/0xb0c3a59caa40efd0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40efd7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635266.963047:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3a00/0xb0c3a59caa40efd0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40efd7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635266.963117:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447adce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427269504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635266.963149:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635266.963183:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05746cf600 going to sleep for 11 seconds 00000100:00100000:2.0:1789635266.964935:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427269504 00000100:00100000:2.0:1789635266.964948:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427269504 00000100:00100000:2.0:1789635266.964999:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789635266.965008:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+23:6512:x1876568427269504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635266.965137:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+23:6512:x1876568427269504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (1988us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635266.965144:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789635266.965184:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447adce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427269504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635266.965289:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467b8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427269632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789635266.965329:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635266.965355:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446df56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635266.965373:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427269632 00000100:00100000:2.0:1789635266.965377:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427269632 00000100:00100000:2.0:1789635266.965397:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789635266.965402:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+23:6512:x1876568427269632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789635266.965463:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+23:6512:x1876568427269632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635266.965469:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789635266.965502:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467b8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427269632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789635266.968340:0:10430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447adc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10430:1876568427269760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635266.968422:0:10430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635266.968464:0:10430:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05746cf600 going to sleep for 11 seconds 00000100:00100000:2.0:1789635266.968562:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427269760 00000100:00100000:2.0:1789635266.968569:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427269760 00000100:00100000:2.0:1789635266.968649:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789635266.968668:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+23:10430:x1876568427269760:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789635266.968766:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+23:10430:x1876568427269760:12345-0@lo:502:llog_process_th.0 Request processed in 109us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635266.968773:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789635266.969681:0:10430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447adc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10430:1876568427269760:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789635266.969716:0:10430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789635266.969725:0:10430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635266.969728:0:10430:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789635266.969735:0:10430:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d0550107000 00000020:00000080:1.0:1789635266.969737:0:10430:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789635266.970705:0:10430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447adc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10430:1876568427269888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635266.970763:0:10430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635266.970920:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427269888 00000100:00100000:1.0:1789635266.970927:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427269888 00000100:00100000:1.0:1789635266.970965:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789635266.970972:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+23:10430:x1876568427269888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635266.971059:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+23:10430:x1876568427269888:12345-0@lo:502:llog_process_th.0 Request processed in 87us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635266.971067:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789635266.971106:0:10430:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b911540 going to sleep for 11 seconds 00000100:00100000:1.0:1789635266.971119:0:10430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447adc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10430:1876568427269888:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789635266.971140:0:10430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789635266.971145:0:10430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635266.971147:0:10430:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789635266.971151:0:10430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789635266.971554:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789635266.971574:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789635266.971583:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3a00/0xb0c3a59caa40efd0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40efd7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635266.971867:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3a00/0xb0c3a59caa40efd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40efd7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635266.971881:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789635266.971884:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0558960000 from 4 10000000:01000000:2.0:1789635266.971887:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789635266.971912:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3e00/0xb0c3a59caa40efde lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635266.971929:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3e00/0xb0c3a59caa40efde lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635266.971939:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3e00/0xb0c3a59caa40efde lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635266.971954:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467b8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427270016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789635266.971988:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635266.972012:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05513aef00 going to sleep for 11 seconds 00000100:00100000:2.0:1789635266.972027:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427270016 00000100:00100000:2.0:1789635266.972031:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427270016 00000100:00100000:2.0:1789635266.972057:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789635266.972063:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+23:6512:x1876568427270016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635266.972072:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635266.972083:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056e1a3600/0xb0c3a59caa40efe5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40efde expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635266.972105:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e1a3600/0xb0c3a59caa40efe5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40efde expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635266.972115:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056e1a3600/0xb0c3a59caa40efe5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40efde expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635266.972123:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a3600, rc 0) 00000100:00100000:2.0:1789635266.972149:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+24:6512:x1876568427270016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635266.972155:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789635266.972199:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467b8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427270016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635266.972211:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3e00/0xb0c3a59caa40efde lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40efe5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635266.973920:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3e00/0xb0c3a59caa40efde lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40efe5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635266.974001:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467b8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427270144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635266.974047:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635266.974077:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05513ae900 going to sleep for 11 seconds 00000100:00100000:2.0:1789635266.974105:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427270144 00000100:00100000:2.0:1789635266.974111:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427270144 00000100:00100000:2.0:1789635266.974142:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789635266.974149:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:6512:x1876568427270144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635266.976500:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:6512:x1876568427270144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2342us (2445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635266.976513:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789635266.977779:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467b8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427270144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789635266.979662:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447659180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427270272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789635266.979753:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635266.979791:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446c1a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635266.981035:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447659500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876568427270400:0@lo:400:kworker.0 00000100:00100000:2.0:1789635266.981080:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635266.981208:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427270784:0@lo:400:kworker.0 00000100:00100000:0.0:1789635266.981238:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635266.981260:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427271296:0@lo:400:kworker.0 00000100:00100000:0.0:1789635266.981284:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635266.981293:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1876568427270912:0@lo:400:kworker.0 00000100:00100000:0.0:1789635266.981305:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427271808:0@lo:400:kworker.0 00000100:00100000:2.0:1789635266.981325:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635266.981338:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635266.981347:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1876568427271424:0@lo:400:kworker.0 00000100:00100000:2.0:1789635266.981372:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635266.981376:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044765a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427270528:0@lo:400:kworker.0 00000100:00100000:0.0:1789635266.981413:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635266.981440:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044765aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427271040:0@lo:400:kworker.0 00000100:00100000:0.0:1789635266.981532:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635266.981553:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1876568427271552:0@lo:400:kworker.0 00000100:00100000:0.0:1789635266.981575:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635266.981589:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789635266.981805:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427270656:0@lo:400:kworker.0 00000100:00100000:0.0:1789635266.981831:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635266.981850:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427271168:0@lo:400:kworker.0 00000100:00100000:0.0:1789635266.981884:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635266.981902:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427271680:0@lo:400:kworker.0 00000100:00100000:0.0:1789635266.981921:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635266.981956:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427270400 00000100:00100000:0.0:1789635266.981963:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427270400 00000100:00100000:2.0:1789635266.981970:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427270528 00000100:00100000:2.0:1789635266.981976:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427270528 00000100:00100000:0.0:1789635266.982002:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427270784 00000100:00100000:0.0:1789635266.982007:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427270784 00000100:00100000:2.0:1789635266.982009:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427270656 00000100:00100000:2.0:1789635266.982013:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427270656 00000100:00100000:0.0:1789635266.982029:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427270912 00000100:00100000:0.0:1789635266.982034:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427270912 00000100:00100000:2.0:1789635266.982035:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789635266.982051:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427270528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635266.982065:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427271424 00000100:00100000:0.0:1789635266.982069:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427271424 00000100:00100000:0.0:1789635266.982085:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427271040 00000100:00100000:0.0:1789635266.982088:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427271040 00000100:00100000:0.0:1789635266.982104:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427271552 00000100:00100000:0.0:1789635266.982107:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427271552 00000100:00100000:2.0:1789635266.982111:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427270528:12345-0@lo:400:kworker.0 Request processed in 60us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635266.982120:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789635266.982124:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789635266.982132:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876568427270400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635266.982139:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789635266.982148:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427270656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635266.982180:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876568427270400:12345-0@lo:400:kworker.0 Request processed in 48us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635266.982186:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427270656:12345-0@lo:400:kworker.0 Request processed in 38us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635266.982194:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789635266.982203:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789635266.982219:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789635266.982224:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427270784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635266.982370:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427270784:12345-0@lo:400:kworker.0 Request processed in 145us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635266.982377:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789635266.982389:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789635266.982394:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876568427270912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635266.982418:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876568427270912:12345-0@lo:400:kworker.0 Request processed in 24us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635266.982423:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789635266.982432:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789635266.982436:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876568427271424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635266.982555:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876568427271424:12345-0@lo:400:kworker.0 Request processed in 118us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635266.982561:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789635266.982571:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789635266.982576:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427271040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635266.982621:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427271040:12345-0@lo:400:kworker.0 Request processed in 46us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635266.982626:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789635266.982636:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789635266.982641:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876568427271552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635266.982776:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876568427271552:12345-0@lo:400:kworker.0 Request processed in 134us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635266.982787:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789635266.982805:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427271296 00000100:00100000:0.0:1789635266.982809:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427271296 00000100:00100000:0.0:1789635266.982828:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427271808 00000100:00100000:0.0:1789635266.982832:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427271808 00000100:00100000:0.0:1789635266.982841:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427271168 00000100:00100000:0.0:1789635266.982844:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427271168 00000100:00100000:0.0:1789635266.982853:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427271680 00000100:00100000:0.0:1789635266.982856:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427271680 00000100:00100000:0.0:1789635266.982871:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789635266.982877:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427271296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635266.982909:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427271296:12345-0@lo:400:kworker.0 Request processed in 33us (1624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635266.982916:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789635266.982926:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789635266.982932:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427271808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635266.982957:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427271808:12345-0@lo:400:kworker.0 Request processed in 26us (1621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635266.982963:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789635266.982975:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789635266.982980:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427271168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635266.983008:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427271168:12345-0@lo:400:kworker.0 Request processed in 29us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635266.983015:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789635266.983025:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789635266.983031:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427271680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635266.983193:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427271680:12345-0@lo:400:kworker.0 Request processed in 162us (1270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635266.983200:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1789635266.983271:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789635266.983276:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789635266.983278:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789635266.983281:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635266.983304:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427270656:0@lo:400:kworker.0 00010000:00080000:0.0:1789635266.983317:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447658700 x1876568427271168/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635266.983327:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427271168:0@lo:400:kworker.0 00010000:00080000:0.0:1789635266.983336:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447a86a00 x1876568427271680/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635266.983344:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427271680:0@lo:400:kworker.0 00000100:00100000:0.0:1789635266.983355:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044765a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427270528:0@lo:400:kworker.0 00010000:00080000:0.0:1789635266.983364:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d044765aa00 x1876568427271040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635266.983372:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044765aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427271040:0@lo:400:kworker.0 00010000:00080000:0.0:1789635266.983380:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447a85f80 x1876568427271552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635266.983388:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1876568427271552:0@lo:400:kworker.0 00000100:00100000:0.0:1789635266.983422:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427271936:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789635266.983567:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635266.983622:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1876568427270912:0@lo:400:kworker.0 00000100:00100000:0.0:1789635266.983632:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1876568427271424:0@lo:400:kworker.0 00000100:00100000:0.0:1789635266.983644:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447659500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876568427270400:0@lo:400:kworker.0 00000100:00100000:0.0:1789635266.983688:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427271936 00000100:00100000:0.0:1789635266.983693:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427271936 00000100:00100000:0.0:1789635266.983728:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789635266.983734:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427271936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789635266.983754:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635266.983793:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427271936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635266.983799:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1789635266.983822:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447a87b80 x1876568427271936/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635266.983834:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427271936:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789635266.983896:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427270272 00000100:00100000:0.0:1789635266.983900:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427270272 00000100:00100000:0.0:1789635266.983925:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789635266.983931:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:6512:x1876568427270272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789635266.984033:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:6512:x1876568427270272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (4279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635266.984039:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789635266.984087:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447659180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427270272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789635266.984297:0:10431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a87b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10431:1876568427272064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789635266.984342:0:10431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635266.984360:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427270784:0@lo:400:kworker.0 00000100:00100000:0.0:1789635266.984379:0:10431:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446c1a480 going to sleep for 11 seconds 00010000:00080000:2.0:1789635266.984380:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447659c00 x1876568427271296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635266.984392:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427271296:0@lo:400:kworker.0 00010000:00080000:2.0:1789635266.984403:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447a86d80 x1876568427271808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635266.984412:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427271808:0@lo:400:kworker.0 00000100:00100000:2.0:1789635266.984469:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427272192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789635266.984499:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635266.984570:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427272192 00000100:00100000:0.0:1789635266.984575:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427272192 00000100:00100000:0.0:1789635266.984649:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789635266.984672:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427272192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789635266.984685:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635266.984723:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427272192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635266.984730:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1789635266.984743:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447a87480 x1876568427272192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635266.984773:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427272192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789635266.990087:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427272064 00000100:00100000:3.0:1789635266.990099:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427272064 00000100:00100000:3.0:1789635266.990153:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789635266.990164:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:10431:x1876568427272064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789635266.990318:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:10431:x1876568427272064:12345-0@lo:502:llog_process_th.0 Request processed in 155us (5976us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635266.990326:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789635266.990392:0:10431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a87b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10431:1876568427272064:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789635266.990432:0:10431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789635266.990442:0:10431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635266.990445:0:10431:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789635266.990453:0:10431:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d0558960000 00000020:00000080:3.0:1789635266.990456:0:10431:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789635266.990539:0:10431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447974e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10431:1876568427272320:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789635266.990583:0:10431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635266.990640:0:10431:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446ce0780 going to sleep for 11 seconds 00000100:00100000:0.0:1789635266.990703:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427272320 00000100:00100000:0.0:1789635266.990709:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427272320 00000100:00100000:0.0:1789635266.990740:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1789635266.990748:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+24:10431:x1876568427272320:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789635266.990928:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+24:10431:x1876568427272320:12345-0@lo:502:llog_process_th.0 Request processed in 181us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635266.990937:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1789635266.993317:0:10431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447974e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:10431:1876568427272320:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789635266.993359:0:10431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789635266.993367:0:10431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635266.993369:0:10431:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789635266.993374:0:10431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789635266.993464:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789635266.993493:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789635266.993505:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3e00/0xb0c3a59caa40efde lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40efe5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635266.993517:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3e00/0xb0c3a59caa40efde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40efe5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635267.385457:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635267.397311:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411479296 00000100:00100000:3.0:1789635267.397335:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411479296 00000100:00100000:3.0:1789635267.397397:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 272 00000100:00100000:3.0:1789635267.397407:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+9:6165:x1876568411479296:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789635267.397423:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635267.397441:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d054139c400/0xb0c3a59caa40efec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73ee7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635267.397468:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d054139c400/0xb0c3a59caa40efec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ee7 expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635267.397480:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d054139c400/0xb0c3a59caa40efec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ee7 expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635267.397490:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d054139c400, rc 0) 00000100:00100000:3.0:1789635267.397550:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:6165:x1876568411479296:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 Request processed in 144us (12102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635267.397557:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 272 00000100:00100000:3.0:1789635267.416871:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635267.417002:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411479424 00000100:00100000:1.0:1789635267.417013:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411479424 00000100:00100000:1.0:1789635267.417074:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 273 00000100:00100000:1.0:1789635267.417085:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:6165:x1876568411479424:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635267.417232:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:6165:x1876568411479424:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 Request processed in 149us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635267.417240:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 273 00000100:00100000:1.0:1789635267.437091:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635267.442038:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411479552 00000100:00100000:0.0:1789635267.442052:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411479552 00000100:00100000:1.0:1789635267.442239:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 274 00000100:00100000:1.0:1789635267.442250:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:6165:x1876568411479552:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789635267.442391:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:6165:x1876568411479552:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 Request processed in 142us (5306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635267.442398:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 274 00000100:00100000:1.0:1789635267.448923:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635267.450363:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411479680 00000100:00100000:2.0:1789635267.450374:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411479680 00000100:00100000:2.0:1789635267.450471:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 275 00000100:00100000:2.0:1789635267.450482:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:6709:x1876568411479680:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789635267.450635:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:6709:x1876568411479680:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 155us (1718us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635267.450643:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 275 00000100:00100000:0.0:1789635267.458114:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635267.458497:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411479808 00000100:00100000:2.0:1789635267.458506:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411479808 00000100:00100000:2.0:1789635267.458558:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 276 00000100:00100000:2.0:1789635267.458568:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b817c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:6709:x1876568411479808:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789635267.458745:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b817c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:6709:x1876568411479808:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 177us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635267.458754:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 276 00010000:00010000:0.0:1789635267.683920:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635268.003796:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427272448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789635268.003890:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635268.003958:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427272448 00000100:00100000:2.0:1789635268.003966:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427272448 00000100:00100000:2.0:1789635268.004015:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789635268.004025:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427272448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789635268.004054:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635268.004096:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427272448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635268.004103:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1789635268.004123:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789635268.004151:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04467b8e00 x1876568427272448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635268.004178:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427272448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789635268.537425:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427272576:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789635268.537491:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635268.540410:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427272576 00000100:00100000:2.0:1789635268.540424:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427272576 00000100:00100000:2.0:1789635268.540497:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789635268.540507:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427272576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789635268.540532:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635268.540620:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427272576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (3128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635268.540627:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1789635268.540663:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789635268.540698:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04467b8e00 x1876568427272576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635268.540719:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427272576:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789635268.569450:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635268.569514:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635268.569546:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635268.569569:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635268.569590:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635268.570348:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411479936 00000100:00100000:2.0:1789635268.570358:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411479936 00000100:00100000:2.0:1789635268.570405:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 277 00000100:00100000:2.0:1789635268.570415:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:2396:x1876568411479936:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635268.572855:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:2396:x1876568411479936:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 2432us (3404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635268.572869:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 277 00000100:00100000:3.0:1789635268.580190:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411480192 00000100:00100000:3.0:1789635268.580206:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411480192 00000100:00100000:1.0:1789635268.583517:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411480448 00000100:00100000:1.0:1789635268.583531:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411480448 00000100:00100000:3.0:1789635268.584501:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411480064 00000100:00100000:3.0:1789635268.584508:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411480064 00000100:00100000:0.0:1789635268.587682:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 79 00000100:00100000:0.0:1789635268.587715:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2396:x1876568411480192:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635268.590629:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2396:x1876568411480192:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 2915us (21096us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635268.590650:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 79 00000100:00100000:1.0:1789635268.599139:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411480320 00000100:00100000:1.0:1789635268.599153:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411480320 00000100:00100000:1.0:1789635268.599198:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:1.0:1789635268.599208:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2396:x1876568411480448:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789635268.599533:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2396:x1876568411480448:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 325us (29984us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635268.599542:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:1.0:1789635268.599560:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:1.0:1789635268.599568:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447adea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2396:x1876568411480320:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789635268.599611:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447adea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2396:x1876568411480320:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 27us (30002us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635268.601322:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:3.0:1789635268.602535:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 80 00000100:00100000:3.0:1789635268.602551:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2396:x1876568411480064:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635268.602639:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2396:x1876568411480064:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 94us (33069us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635268.602660:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 80 00000100:00080000:2.0:1789635268.602933:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789635268.603416:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789635268.603420:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789635268.603423:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789635268.707858:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635269.731894:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635270.051933:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427272704:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789635270.051996:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635270.052258:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789635270.052269:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427272832:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789635270.052299:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635270.052376:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427272704 00000100:00100000:2.0:1789635270.052385:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427272704 00000100:00100000:2.0:1789635270.052434:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427272832 00000100:00100000:2.0:1789635270.052438:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427272832 00000100:00100000:2.0:1789635270.052454:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789635270.052463:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427272704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789635270.052496:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789635270.052664:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789635270.052674:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427272832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789635270.052693:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789635270.052749:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427272832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635270.052756:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789635270.052796:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427272832:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789635270.052944:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427272704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 482us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635270.052950:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789635270.053174:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427272704:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789635270.800885:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635271.849891:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635272.100918:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427272960:0@lo:400:kworker.0 00000100:00100000:3.0:1789635272.100988:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635272.101032:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876568427273472:0@lo:400:kworker.0 00000100:00100000:3.0:1789635272.101054:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635272.101070:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427273984:0@lo:400:kworker.0 00000100:00100000:3.0:1789635272.101088:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635272.101102:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427274496:0@lo:400:kworker.0 00000100:00100000:3.0:1789635272.101117:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635272.101139:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789635272.101145:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427273344:0@lo:400:kworker.0 00000100:00100000:3.0:1789635272.101173:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635272.101192:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427273856:0@lo:400:kworker.0 00000100:00100000:3.0:1789635272.101209:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635272.101221:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427274368:0@lo:400:kworker.0 00000100:00100000:3.0:1789635272.101237:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635272.101257:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427273088:0@lo:400:kworker.0 00000100:00100000:3.0:1789635272.101288:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635272.101304:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427273600:0@lo:400:kworker.0 00000100:00100000:3.0:1789635272.101321:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635272.101334:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427274112:0@lo:400:kworker.0 00000100:00100000:3.0:1789635272.101350:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635272.101363:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789635272.101367:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427273216:0@lo:400:kworker.0 00000100:00100000:3.0:1789635272.101383:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635272.101411:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1876568427273728:0@lo:400:kworker.0 00000100:00100000:3.0:1789635272.101429:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635272.101441:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1876568427274240:0@lo:400:kworker.0 00000100:00100000:3.0:1789635272.101456:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635272.101478:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427272960 00000100:00100000:3.0:1789635272.101485:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427272960 00000100:00100000:3.0:1789635272.101519:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1789635272.101527:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3643:x1876568427272960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635272.101567:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3643:x1876568427272960:12345-0@lo:400:kworker.0 Request processed in 41us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635272.101573:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1789635272.101628:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427273984 00000100:00100000:3.0:1789635272.101632:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427273984 00000100:00100000:3.0:1789635272.101655:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427274496 00000100:00100000:3.0:1789635272.101658:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427274496 00000100:00100000:3.0:1789635272.101669:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427273856 00000100:00100000:3.0:1789635272.101671:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427273856 00000100:00100000:3.0:1789635272.101681:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427274368 00000100:00100000:3.0:1789635272.101682:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427274368 00000100:00100000:3.0:1789635272.101694:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789635272.102117:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0441469c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427273984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635272.102151:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0441469c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427273984:12345-0@lo:400:kworker.0 Request processed in 39us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635272.102157:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789635272.102223:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789635272.102230:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0441468700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427274496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635272.102256:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0441468700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427274496:12345-0@lo:400:kworker.0 Request processed in 27us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635272.102379:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789635272.102392:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789635272.102398:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0441468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427273856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635272.102426:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0441468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427273856:12345-0@lo:400:kworker.0 Request processed in 28us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635272.102431:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789635272.102440:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789635272.102445:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044146a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427274368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635272.102465:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044146a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427274368:12345-0@lo:400:kworker.0 Request processed in 21us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635272.102470:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789635272.102490:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427273344 00000100:00100000:3.0:1789635272.102493:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427273344 00000100:00100000:3.0:1789635272.102557:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427273216 00000100:00100000:3.0:1789635272.102561:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427273216 00000100:00100000:3.0:1789635272.102574:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789635272.102579:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044146aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427273344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635272.102634:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044146aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427273344:12345-0@lo:400:kworker.0 Request processed in 55us (1470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635272.102640:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789635272.102651:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789635272.102656:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0441468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427273216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635272.102684:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0441468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427273216:12345-0@lo:400:kworker.0 Request processed in 28us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635272.102690:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1789635272.104222:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789635272.104228:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789635272.104609:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427274752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789635272.104670:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635272.104816:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427273472 00000100:00100000:3.0:1789635272.105570:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427273472 00000100:00100000:3.0:1789635272.105631:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427273088 00000100:00100000:3.0:1789635272.105634:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427273088 00000100:00100000:3.0:1789635272.105645:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427273600 00000100:00100000:3.0:1789635272.105647:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427273600 00000100:00100000:3.0:1789635272.105669:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427274112 00000100:00100000:3.0:1789635272.105671:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427274112 00000100:00100000:3.0:1789635272.105682:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427273728 00000100:00100000:3.0:1789635272.105684:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427273728 00000100:00100000:3.0:1789635272.105694:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427274240 00000100:00100000:3.0:1789635272.105696:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427274240 00000100:00100000:2.0:1789635272.106008:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789635272.106018:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427274624:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789635272.106059:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635272.106091:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427274752 00000100:00100000:2.0:1789635272.106095:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427274752 00000100:00100000:2.0:1789635272.106118:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427274624 00000100:00100000:2.0:1789635272.106120:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427274624 00000100:00100000:2.0:1789635272.106132:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789635272.106140:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427274752:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789635272.106995:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789635272.107002:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0441469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876568427273472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635272.107054:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0441469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876568427273472:12345-0@lo:400:kworker.0 Request processed in 53us (5999us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635272.107061:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789635272.107075:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789635272.107081:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044146ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427273088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635272.107104:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044146ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427273088:12345-0@lo:400:kworker.0 Request processed in 23us (5815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635272.107109:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789635272.107118:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789635272.107123:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044146a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427273600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635272.107145:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044146a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427273600:12345-0@lo:400:kworker.0 Request processed in 21us (5823us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635272.107150:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789635272.107160:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789635272.107791:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789635272.107802:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044146b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876568427273728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635272.107920:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044146b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876568427273728:12345-0@lo:400:kworker.0 Request processed in 121us (6489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635272.107927:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789635272.107944:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789635272.107950:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0441469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876568427274240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635272.107974:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0441469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876568427274240:12345-0@lo:400:kworker.0 Request processed in 25us (6518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635272.107979:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00002000:00000024:2.0:1789635272.108321:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635272.108376:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427274752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2236us (3705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635272.108383:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789635272.108411:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789635272.108418:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427274624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789635272.108432:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635272.108455:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427274624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (2396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635272.108460:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1789635272.108481:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789635272.108485:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635272.108634:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044146bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427274112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635272.108672:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044146bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427274112:12345-0@lo:400:kworker.0 Request processed in 1507us (7321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635272.108678:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789635272.108726:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427273216:0@lo:400:kworker.0 00010000:00080000:3.0:1789635272.108738:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447974380 x1876568427273728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635272.108749:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1876568427273728:0@lo:400:kworker.0 00010000:00080000:3.0:1789635272.108758:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447977480 x1876568427274240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635272.108767:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1876568427274240:0@lo:400:kworker.0 00000100:00100000:3.0:1789635272.108776:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427273088:0@lo:400:kworker.0 00000100:00100000:3.0:1789635272.108784:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427273600:0@lo:400:kworker.0 00000100:00100000:3.0:1789635272.108793:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427274112:0@lo:400:kworker.0 00000100:00100000:3.0:1789635272.108832:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427273344:0@lo:400:kworker.0 00010000:00080000:0.0:1789635272.113869:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04467ba680 x1876568427274624/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635288 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635272.113895:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427274624:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1789635272.113907:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04467b8380 x1876568427274752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635288 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635272.113919:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427274752:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789635272.114096:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447975180 x1876568427273856/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635272.114105:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427273856:0@lo:400:kworker.0 00010000:00080000:3.0:1789635272.114114:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447976d80 x1876568427274368/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635272.114121:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427274368:0@lo:400:kworker.0 00000100:00100000:3.0:1789635272.114130:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427272960:0@lo:400:kworker.0 00000100:00100000:3.0:1789635272.114149:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876568427273472:0@lo:400:kworker.0 00010000:00080000:3.0:1789635272.114158:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447974700 x1876568427273984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635272.114166:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427273984:0@lo:400:kworker.0 00010000:00080000:3.0:1789635272.114175:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05759cbb80 x1876568427274496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635272.114182:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427274496:0@lo:400:kworker.0 00010000:00010000:2.0:1789635272.871769:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635273.124062:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789635273.124084:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427274880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635273.124151:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635273.126783:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427274880 00000100:00100000:2.0:1789635273.126796:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427274880 00000100:00100000:2.0:1789635273.126857:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789635273.126867:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427274880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789635273.126897:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635273.126986:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427274880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (2834us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635273.126993:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1789635273.141479:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04467ba300 x1876568427274880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635273.141505:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427274880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789635273.643413:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427275008:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789635273.643479:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635273.649513:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427275008 00000100:00100000:1.0:1789635273.649528:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427275008 00000100:00100000:1.0:1789635273.649662:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789635273.649683:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427275008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789635273.649709:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789635273.649784:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427275008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (6304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635273.649791:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1789635273.655426:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447974700 x1876568427275008/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635273.655453:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427275008:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789635273.664684:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635273.664725:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635273.664750:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635273.664774:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635273.664845:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635273.664876:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411480832 00000100:00100000:2.0:1789635273.664886:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411480832 00000100:00100000:3.0:1789635273.664917:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411480960 00000100:00100000:3.0:1789635273.664924:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411480960 00000100:00100000:2.0:1789635273.664951:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411480704 00000100:00100000:2.0:1789635273.664956:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411480704 00000100:00100000:2.0:1789635273.664981:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 87 00000100:00100000:2.0:1789635273.664990:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2397:x1876568411480832:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635273.665060:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2397:x1876568411480832:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 72us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635273.665067:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 87 00000100:00100000:2.0:1789635273.665085:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 88 00000100:00100000:2.0:1789635273.665091:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2397:x1876568411480704:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635273.665118:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2397:x1876568411480704:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 27us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635273.665123:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 88 00000100:00100000:2.0:1789635273.665141:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411481088 00000100:00100000:2.0:1789635273.665146:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411481088 00000100:00100000:2.0:1789635273.665183:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:2.0:1789635273.665190:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2395:x1876568411481088:12345-192.168.203.20@tcp:9:kworker.0 00000020:00000080:2.0:1789635273.665214:0:8432:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40ef05 00000100:00080000:2.0:1789635273.665223:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8d0446454000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789635273.665263:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789635273.665284:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:3.0:1789635273.665294:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2395:x1876568411480960:12345-192.168.203.20@tcp:9:kworker.0 00000020:00000080:3.0:1789635273.665314:0:8430:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40eefe 00000100:00080000:3.0:1789635273.665361:0:8430:0:(import.c:65:import_set_state_nolock()) ffff8d0446452000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789635273.665392:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789635273.665496:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+2:2395:x1876568411480960:12345-192.168.203.20@tcp:9:kworker.0 Request processed in 204us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635273.665505:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:1.0:1789635273.665543:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411480576 00000100:00100000:1.0:1789635273.665548:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411480576 00000100:00100000:1.0:1789635273.665586:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 279 00000100:00100000:1.0:1789635273.665618:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:2397:x1876568411480576:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789635273.665654:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:2397:x1876568411480576:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 61us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635273.665662:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 279 00000100:00100000:2.0:1789635273.665772:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+2:2395:x1876568411481088:12345-192.168.203.20@tcp:9:kworker.0 Request processed in 582us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635273.665779:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00080000:2.0:1789635273.668344:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789635273.668352:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789635273.668355:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789635273.668358:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789635273.668707:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635273.668720:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635273.905993:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635274.916663:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635275.171781:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789635275.171804:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427275136:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789635275.171868:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635275.171931:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427275136 00000100:00100000:1.0:1789635275.171940:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427275136 00000100:00100000:1.0:1789635275.171983:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789635275.171992:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427275136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789635275.172024:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789635275.172066:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427275136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635275.172084:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789635275.172125:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427275136:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789635275.174356:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789635275.174375:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427275264:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789635275.174443:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635275.174487:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427275264 00000100:00100000:3.0:1789635275.174505:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427275264 00000100:00100000:3.0:1789635275.174543:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789635275.174550:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427275264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789635275.174581:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789635275.174658:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427275264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635275.174665:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789635275.174706:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427275264:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789635275.943416:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789635276.264062:0:10694:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1789635276.968307:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635277.219801:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427275648:0@lo:400:kworker.0 00000100:00100000:3.0:1789635277.219869:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635277.219958:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427275648 00000100:00100000:3.0:1789635277.219967:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427275648 00000100:00100000:3.0:1789635277.220010:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789635277.220020:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427275648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635277.220074:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427275648:12345-0@lo:400:kworker.0 Request processed in 55us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635277.220081:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789635277.220123:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427275648:0@lo:400:kworker.0 00000100:00100000:3.0:1789635277.220156:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789635277.220664:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427275776:0@lo:400:kworker.0 00000100:00100000:3.0:1789635277.220697:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635277.220811:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1876568427276160:0@lo:400:kworker.0 00000100:00100000:3.0:1789635277.220837:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635277.220857:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1876568427276672:0@lo:400:kworker.0 00000100:00100000:3.0:1789635277.220891:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635277.220908:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789635277.220913:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427276288:0@lo:400:kworker.0 00000100:00100000:3.0:1789635277.221105:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635277.221121:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427276800:0@lo:400:kworker.0 00000100:00100000:3.0:1789635277.221141:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635277.221227:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427276160 00000100:00100000:3.0:1789635277.221233:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427276160 00000100:00100000:3.0:1789635277.221269:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427276672 00000100:00100000:3.0:1789635277.221272:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427276672 00000100:00100000:3.0:1789635277.221291:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789635277.221299:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876568427276160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635277.221342:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876568427276160:12345-0@lo:400:kworker.0 Request processed in 44us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635277.221349:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789635277.221363:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789635277.221369:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876568427276672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635277.221394:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876568427276672:12345-0@lo:400:kworker.0 Request processed in 25us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635277.221399:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:3.0:1789635277.221428:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447975880 x1876568427276160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635277.221439:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1876568427276160:0@lo:400:kworker.0 00010000:00080000:3.0:1789635277.221448:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447974700 x1876568427276672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635277.221456:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1876568427276672:0@lo:400:kworker.0 00000100:00100000:2.0:1789635277.221613:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876568427275520:0@lo:400:kworker.0 00000100:00100000:2.0:1789635277.221654:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635277.221680:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1876568427276032:0@lo:400:kworker.0 00000100:00100000:2.0:1789635277.221700:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635277.221717:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1876568427276544:0@lo:400:kworker.0 00000100:00100000:2.0:1789635277.221736:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635277.221749:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1789635277.221754:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427275392:0@lo:400:kworker.0 00000100:00100000:2.0:1789635277.221794:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635277.221818:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876568427275904:0@lo:400:kworker.0 00000100:00100000:2.0:1789635277.221839:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635277.221850:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427276416:0@lo:400:kworker.0 00000100:00100000:2.0:1789635277.221868:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635277.221885:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427276928:0@lo:400:kworker.0 00000100:00100000:2.0:1789635277.221904:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635277.221942:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427275520 00000100:00100000:2.0:1789635277.221946:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427275520 00000100:00100000:2.0:1789635277.221968:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427276032 00000100:00100000:2.0:1789635277.221970:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427276032 00000100:00100000:2.0:1789635277.221983:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427276544 00000100:00100000:2.0:1789635277.221985:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427276544 00000100:00100000:2.0:1789635277.221996:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427275904 00000100:00100000:2.0:1789635277.221998:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427275904 00000100:00100000:2.0:1789635277.222008:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789635277.222014:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876568427275520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635277.222063:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876568427275520:12345-0@lo:400:kworker.0 Request processed in 48us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635277.222070:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789635277.222082:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789635277.222087:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876568427276032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635277.222114:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876568427276032:12345-0@lo:400:kworker.0 Request processed in 27us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635277.222118:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789635277.222128:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789635277.222132:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876568427276544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635277.222154:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876568427276544:12345-0@lo:400:kworker.0 Request processed in 21us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635277.222159:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789635277.222429:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789635277.222437:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876568427275904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635277.222468:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876568427275904:12345-0@lo:400:kworker.0 Request processed in 33us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635277.222474:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789635277.222492:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427276288 00000100:00100000:2.0:1789635277.222496:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427276288 00000100:00100000:2.0:1789635277.222515:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427276800 00000100:00100000:2.0:1789635277.222518:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427276800 00000100:00100000:2.0:1789635277.222528:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427276416 00000100:00100000:2.0:1789635277.222531:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427276416 00000100:00100000:2.0:1789635277.222541:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427276928 00000100:00100000:2.0:1789635277.222544:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427276928 00000100:00100000:2.0:1789635277.222556:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789635277.222568:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427276288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635277.222652:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427276288:12345-0@lo:400:kworker.0 Request processed in 84us (1546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635277.222719:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789635277.222731:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789635277.222737:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427276800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635277.222768:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427276800:12345-0@lo:400:kworker.0 Request processed in 32us (1626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635277.222774:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789635277.222784:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789635277.222790:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427276416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635277.222815:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427276416:12345-0@lo:400:kworker.0 Request processed in 26us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635277.222821:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789635277.222832:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789635277.222837:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427276928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635277.222862:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427276928:12345-0@lo:400:kworker.0 Request processed in 26us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635277.222868:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1789635277.222888:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789635277.222892:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789635277.222894:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789635277.222896:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789635277.222911:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427275392 00000100:00100000:1.0:1789635277.223247:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427275776 00000100:00100000:1.0:1789635277.223253:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427275776 00000100:00100000:1.0:1789635277.223285:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789635277.223292:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427275776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635277.223331:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427275776:12345-0@lo:400:kworker.0 Request processed in 39us (2634us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635277.223337:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789635277.223517:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427275392 00000100:00100000:2.0:1789635277.223556:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789635277.223563:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3643:x1876568427275392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635277.223891:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427275392:0@lo:400:kworker.0 00000100:00100000:3.0:1789635277.223906:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876568427275904:0@lo:400:kworker.0 00000100:00100000:2.0:1789635277.224057:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3643:x1876568427275392:12345-0@lo:400:kworker.0 Request processed in 69us (1837us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635277.224064:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00010000:00080000:2.0:1789635277.224107:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447977480 x1876568427276288/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635277.224118:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427276288:0@lo:400:kworker.0 00010000:00080000:2.0:1789635277.224128:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0546df1500 x1876568427276800/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635277.224135:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427276800:0@lo:400:kworker.0 00000100:00100000:2.0:1789635277.224145:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427275776:0@lo:400:kworker.0 00010000:00080000:3.0:1789635277.224254:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447974380 x1876568427276416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635277.224264:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427276416:0@lo:400:kworker.0 00010000:00080000:3.0:1789635277.224278:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0546df1180 x1876568427276928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635277.224285:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427276928:0@lo:400:kworker.0 00000100:00100000:3.0:1789635277.224296:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876568427275520:0@lo:400:kworker.0 00000100:00100000:3.0:1789635277.224305:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1876568427276032:0@lo:400:kworker.0 00000100:00100000:3.0:1789635277.224315:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1876568427276544:0@lo:400:kworker.0 00000100:00100000:1.0:1789635277.232117:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789635277.232140:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044796b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427277056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635277.232203:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635277.232556:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789635277.232566:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427277184:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789635277.232635:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635277.232795:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427277056 00000100:00100000:2.0:1789635277.232803:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427277056 00000100:00100000:2.0:1789635277.232847:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427277184 00000100:00100000:2.0:1789635277.232850:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427277184 00000100:00100000:2.0:1789635277.232864:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789635277.232872:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427277056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789635277.232899:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635277.232958:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427277056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635277.232966:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789635277.232991:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789635277.232997:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427277184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789635277.233007:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635277.233034:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427277184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635277.233051:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1789635277.233234:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d044796b480 x1876568427277056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635293 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635277.233252:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044796b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427277056:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789635277.233326:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04459dc700 x1876568427277184/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635293 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635277.233338:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427277184:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789635277.997888:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635278.244489:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427277312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789635278.244554:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635278.244797:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427277312 00000100:00100000:3.0:1789635278.244806:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427277312 00000100:00100000:3.0:1789635278.244848:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789635278.244857:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447adc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427277312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789635278.244884:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635278.244927:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447adc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427277312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635278.244934:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1789635278.245020:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04459df800 x1876568427277312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635278.246993:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427277312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789635278.757498:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789635278.757534:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427277440:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789635278.757623:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635278.757849:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427277440 00000100:00100000:3.0:1789635278.757858:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427277440 00000100:00100000:3.0:1789635278.757905:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789635278.757914:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427277440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789635278.757941:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635278.757989:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427277440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635278.757995:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1789635278.758163:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04459ddf80 x1876568427277440/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635278.758180:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427277440:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789635278.779258:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635278.779326:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635278.779359:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635278.779529:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411481216 00000100:00100000:1.0:1789635278.779540:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411481216 00000100:00100000:1.0:1789635278.779631:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 281 00000100:00100000:1.0:1789635278.779641:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:2397:x1876568411481216:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789635278.779707:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:2397:x1876568411481216:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 68us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635278.779723:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 281 00000100:00100000:3.0:1789635278.780042:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411481344 00000100:00100000:3.0:1789635278.780048:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411481344 00000100:00100000:3.0:1789635278.780094:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411481472 00000100:00100000:3.0:1789635278.780098:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411481472 00000100:00100000:3.0:1789635278.780124:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 95 00000100:00100000:3.0:1789635278.780131:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2397:x1876568411481344:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635278.780170:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2397:x1876568411481344:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 40us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635278.780176:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 95 00000100:00100000:3.0:1789635278.780190:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 96 00000100:00100000:3.0:1789635278.780195:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2397:x1876568411481472:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635278.780220:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2397:x1876568411481472:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 25us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635278.780225:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 96 00000100:00080000:1.0:1789635278.781253:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789635278.781258:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789635279.012062:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789635279.271167:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e1c17f2-a595-4ed0-97c8-b9260d0850ab 00000020:00000080:0.0:1789635279.271177:0:9509:0:(genops.c:885:class_export_put()) final put ffff8d0446455800/6e1c17f2-a595-4ed0-97c8-b9260d0850ab 00000001:00100000:0.0:1789635279.286412:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e1c17f2-a595-4ed0-97c8-b9260d0850ab 00000020:00000080:0.0:1789635279.286421:0:8425:0:(genops.c:885:class_export_put()) final put ffff8d0446453800/6e1c17f2-a595-4ed0-97c8-b9260d0850ab 00000020:00000080:3.0:1789635279.286487:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0446455800/6e1c17f2-a595-4ed0-97c8-b9260d0850ab for lustre-OST0001 00000020:00000080:3.0:1789635279.286548:0:492:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d0446454000 for lustre-OST0001 00000020:00000080:1.0:1789635279.290576:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0446453800/6e1c17f2-a595-4ed0-97c8-b9260d0850ab for lustre-OST0000 00000020:00000080:1.0:1789635279.290660:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d0446452000 for lustre-OST0000 00010000:00010000:3.0:1789635280.037223:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635280.292345:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427277568:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789635280.292413:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635280.292509:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427277696:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789635280.292548:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635280.292625:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427277568 00000100:00100000:1.0:1789635280.293764:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427277568 00000100:00100000:1.0:1789635280.293819:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427277696 00000100:00100000:1.0:1789635280.293825:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427277696 00000100:00100000:1.0:1789635280.293844:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789635280.293853:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427277568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789635280.293911:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789635280.293973:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427277568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (1559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635280.293981:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789635280.293997:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789635280.294004:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427277696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789635280.294019:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789635280.294049:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427277696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 46us (1501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635280.294055:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789635280.295419:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427277568:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789635280.295467:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427277696:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789635281.062152:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635282.092429:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635282.344639:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427277824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635282.344714:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635282.344798:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427277824 00000100:00100000:1.0:1789635282.344806:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427277824 00000100:00100000:1.0:1789635282.344854:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789635282.344864:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447add500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427277824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789635282.344893:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789635282.344936:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447add500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427277824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635282.344943:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1789635282.344964:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789635282.344993:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447a84000 x1876568427277824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635298 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635282.345030:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427277824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635282.345849:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427277952:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789635282.345886:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635282.345993:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427277952 00000100:00100000:2.0:1789635282.345999:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427277952 00000100:00100000:2.0:1789635282.346050:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789635282.346058:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427277952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789635282.346074:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635282.346110:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427277952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635282.346116:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1789635282.346284:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789635282.346308:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447a85880 x1876568427277952/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635298 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635282.346323:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427277952:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789635282.347718:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447adce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427278208:0@lo:400:kworker.0 00000100:00100000:1.0:1789635282.347765:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635282.347791:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427278720:0@lo:400:kworker.0 00000100:00100000:1.0:1789635282.347832:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635282.347854:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427279232:0@lo:400:kworker.0 00000100:00100000:1.0:1789635282.347878:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635282.347909:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789635282.347925:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427278336:0@lo:400:kworker.0 00000100:00100000:1.0:1789635282.347948:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635282.347966:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1876568427278848:0@lo:400:kworker.0 00000100:00100000:1.0:1789635282.347990:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635282.348008:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1876568427279360:0@lo:400:kworker.0 00000100:00100000:1.0:1789635282.348027:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635282.348054:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427278208 00000100:00100000:1.0:1789635282.348059:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427278208 00000100:00100000:1.0:1789635282.348087:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427278720 00000100:00100000:1.0:1789635282.348096:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427278720 00000100:00100000:1.0:1789635282.348118:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427279232 00000100:00100000:1.0:1789635282.348120:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427279232 00000100:00100000:1.0:1789635282.348133:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427278848 00000100:00100000:1.0:1789635282.348135:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427278848 00000100:00100000:1.0:1789635282.348144:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427279360 00000100:00100000:1.0:1789635282.348146:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427279360 00000100:00100000:1.0:1789635282.348176:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789635282.348184:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427278208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635282.348231:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427278208:12345-0@lo:400:kworker.0 Request processed in 48us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635282.348238:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789635282.348267:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789635282.348273:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044782b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427278720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635282.348302:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044782b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427278720:12345-0@lo:400:kworker.0 Request processed in 29us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635282.348308:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789635282.348319:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789635282.348325:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427279232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635282.348351:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427279232:12345-0@lo:400:kworker.0 Request processed in 27us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635282.348357:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789635282.348367:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789635282.348373:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876568427278848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635282.348400:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876568427278848:12345-0@lo:400:kworker.0 Request processed in 27us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635282.348405:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789635282.348422:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789635282.348428:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044782b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876568427279360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635282.348592:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427278080:0@lo:400:kworker.0 00000100:00100000:0.0:1789635282.348637:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635282.348664:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876568427278592:0@lo:400:kworker.0 00000100:00100000:0.0:1789635282.348696:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635282.348708:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427279104:0@lo:400:kworker.0 00000100:00100000:0.0:1789635282.348730:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635282.348751:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789635282.348756:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427278464:0@lo:400:kworker.0 00000100:00100000:0.0:1789635282.348777:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635282.348795:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427278976:0@lo:400:kworker.0 00000100:00100000:0.0:1789635282.348813:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635282.348841:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427279104 00000100:00100000:0.0:1789635282.348846:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427279104 00000100:00100000:0.0:1789635282.348872:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427278976 00000100:00100000:0.0:1789635282.348882:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427278976 00000100:00100000:0.0:1789635282.348907:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789635282.348913:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427279104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635282.348948:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427279104:12345-0@lo:400:kworker.0 Request processed in 35us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635282.348954:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789635282.348966:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789635282.348971:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427278976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635282.348997:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427278976:12345-0@lo:400:kworker.0 Request processed in 26us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635282.349003:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789635282.349020:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427278336 00000100:00100000:0.0:1789635282.349023:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427278336 00000100:00100000:0.0:1789635282.349044:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427278464 00000100:00100000:0.0:1789635282.349046:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427278464 00000100:00100000:0.0:1789635282.349057:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789635282.349063:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427278336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635282.349094:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427278336:12345-0@lo:400:kworker.0 Request processed in 30us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635282.349100:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789635282.349110:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789635282.349116:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427278464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635282.349140:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427278464:12345-0@lo:400:kworker.0 Request processed in 25us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635282.349146:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789635282.349202:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427278464:0@lo:400:kworker.0 00010000:00080000:0.0:1789635282.349224:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04477aa300 x1876568427278976/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635282.349235:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427278976:0@lo:400:kworker.0 00010000:00080000:0.0:1789635282.349244:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04477a9180 x1876568427279104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635282.349251:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427279104:0@lo:400:kworker.0 00000100:00100000:1.0:1789635282.350378:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044782b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876568427279360:12345-0@lo:400:kworker.0 Request processed in 1946us (2345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635282.350388:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789635282.350406:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427278592 00000100:00100000:1.0:1789635282.350410:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427278592 00000100:00100000:1.0:1789635282.350568:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789635282.350579:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876568427278592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635282.350632:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876568427278592:12345-0@lo:400:kworker.0 Request processed in 56us (1936us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635282.350639:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789635282.350676:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427278080 00000100:00100000:1.0:1789635282.350680:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427278080 00000100:00100000:1.0:1789635282.350717:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1789635282.350724:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3643:x1876568427278080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635282.350754:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3643:x1876568427278080:12345-0@lo:400:kworker.0 Request processed in 31us (2117us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635282.350760:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00080000:1.0:1789635282.350787:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789635282.350792:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789635282.350795:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635282.350827:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427278336:0@lo:400:kworker.0 00010000:00080000:1.0:1789635282.350842:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04477ab100 x1876568427278848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635282.350852:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1876568427278848:0@lo:400:kworker.0 00010000:00080000:1.0:1789635282.350878:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04477a8380 x1876568427279360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635282.350887:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1876568427279360:0@lo:400:kworker.0 00000100:00100000:1.0:1789635282.350898:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447adce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427278208:0@lo:400:kworker.0 00000100:00100000:1.0:1789635282.350909:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427278720:0@lo:400:kworker.0 00000100:00100000:1.0:1789635282.350918:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427279232:0@lo:400:kworker.0 00000100:00100000:0.0:1789635282.352271:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427278080:0@lo:400:kworker.0 00000100:00100000:0.0:1789635282.352290:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876568427278592:0@lo:400:kworker.0 00010000:00010000:3.0:1789635283.113106:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635283.370944:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789635283.370967:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427279488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635283.371032:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635283.371416:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427279488 00000100:00100000:3.0:1789635283.371424:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427279488 00000100:00100000:3.0:1789635283.371482:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789635283.371492:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427279488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789635283.371541:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635283.371588:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427279488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635283.371615:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1789635283.371861:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04459df800 x1876568427279488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635299 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635283.371879:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427279488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789635283.878625:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789635283.878650:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427279616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789635283.878719:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635283.878860:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427279616 00000100:00100000:0.0:1789635283.878869:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427279616 00000100:00100000:0.0:1789635283.878916:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789635283.878925:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447969f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427279616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789635283.878947:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635283.879031:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447969f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427279616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635283.879038:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1789635283.879165:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04459dc700 x1876568427279616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635299 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635283.879185:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427279616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789635283.905560:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635283.905635:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635283.905666:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635283.905692:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411481856 00000100:00100000:2.0:1789635283.905701:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411481856 00000100:00100000:2.0:1789635283.905756:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411481728 00000100:00100000:2.0:1789635283.905760:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411481728 00000100:00100000:2.0:1789635283.905784:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 103 00000100:00100000:2.0:1789635283.905803:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044796aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411481856:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635283.905876:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044796aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411481856:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 76us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635283.905882:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 103 00000100:00100000:2.0:1789635283.905899:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 104 00000100:00100000:2.0:1789635283.905906:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044796b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2399:x1876568411481728:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635283.905930:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044796b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2399:x1876568411481728:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 24us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635283.905935:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 104 00000100:00080000:2.0:1789635283.905953:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789635283.905956:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789635283.906899:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411481600 00000100:00100000:1.0:1789635283.906907:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411481600 00000100:00100000:1.0:1789635283.906952:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 283 00000100:00100000:1.0:1789635283.906959:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:2399:x1876568411481600:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789635283.907007:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:2399:x1876568411481600:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 48us (1457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635283.907015:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 283 00000001:02000400:2.0:1789635284.013145:0:10938:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing yml_node 00010000:00010000:1.0:1789635284.133949:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635285.156186:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635285.411933:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427279744:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789635285.412003:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635285.412112:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427279744 00000100:00100000:1.0:1789635285.412121:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427279744 00000100:00100000:1.0:1789635285.412173:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789635285.412182:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427279744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789635285.412215:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789635285.412254:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427279744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635285.412260:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789635285.412387:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427279744:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789635285.412405:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789635285.412411:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427279872:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789635285.412431:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635285.412509:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427279872 00000100:00100000:1.0:1789635285.412521:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427279872 00000100:00100000:1.0:1789635285.412566:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789635285.412573:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427279872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789635285.412592:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789635285.412653:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427279872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635285.412659:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789635285.412724:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427279872:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789635286.180593:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635287.204072:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635287.460464:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044782ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876568427280128:0@lo:400:kworker.0 00000100:00100000:1.0:1789635287.460560:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635287.460571:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044782aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427280000:0@lo:400:kworker.0 00000100:00100000:3.0:1789635287.460627:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635287.460650:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876568427280512:0@lo:400:kworker.0 00000100:00100000:3.0:1789635287.460688:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635287.460706:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427281024:0@lo:400:kworker.0 00000100:00100000:3.0:1789635287.460742:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635287.460762:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427281536:0@lo:400:kworker.0 00000100:00100000:3.0:1789635287.460783:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635287.460830:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427281024 00000100:00100000:3.0:1789635287.460838:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427281024 00000100:00100000:0.0:1789635287.460873:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044782b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427280384:0@lo:400:kworker.0 00000100:00100000:3.0:1789635287.460883:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427281536 00000100:00100000:3.0:1789635287.460886:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427281536 00000100:00100000:3.0:1789635287.460908:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789635287.460908:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635287.460916:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427281024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635287.460927:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044782a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427280896:0@lo:400:kworker.0 00000100:00100000:0.0:1789635287.460945:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635287.460955:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044782bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427281408:0@lo:400:kworker.0 00000100:00100000:3.0:1789635287.460958:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427281024:12345-0@lo:400:kworker.0 Request processed in 43us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635287.460964:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789635287.460971:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635287.460978:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427280896 00000100:00100000:3.0:1789635287.460981:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427280896 00000100:00100000:0.0:1789635287.460982:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789635287.460987:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427280256:0@lo:400:kworker.0 00000100:00100000:3.0:1789635287.460993:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427281408 00000100:00100000:3.0:1789635287.461002:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427281408 00000100:00100000:0.0:1789635287.461007:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635287.461020:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789635287.461022:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447828380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1876568427280768:0@lo:400:kworker.0 00000100:00100000:3.0:1789635287.461025:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427281536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635287.461056:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635287.461063:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427281536:12345-0@lo:400:kworker.0 Request processed in 39us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635287.461069:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789635287.461069:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1876568427281280:0@lo:400:kworker.0 00000100:00100000:3.0:1789635287.461081:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789635287.461087:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427280896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635287.461087:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635287.461112:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427280896:12345-0@lo:400:kworker.0 Request processed in 25us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635287.461118:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789635287.461127:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789635287.461133:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427281408:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789635287.461133:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d044782a680 x1876568427280896/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635287.461145:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044782a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427280896:0@lo:400:kworker.0 00000100:00100000:3.0:1789635287.461442:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427281408:12345-0@lo:400:kworker.0 Request processed in 308us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635287.461449:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789635287.461476:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427280384 00000100:00100000:3.0:1789635287.461480:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427280384 00000100:00100000:3.0:1789635287.461511:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427280256 00000100:00100000:3.0:1789635287.461514:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427280256 00000100:00100000:3.0:1789635287.461527:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789635287.461532:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427280384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635287.461566:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427280384:12345-0@lo:400:kworker.0 Request processed in 33us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635287.461572:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789635287.461576:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427280128 00000100:00100000:0.0:1789635287.461581:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427280128 00000100:00100000:3.0:1789635287.461582:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789635287.461587:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427280256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635287.461625:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427280512 00000100:00100000:0.0:1789635287.461640:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427280512 00000100:00100000:3.0:1789635287.461642:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427280256:12345-0@lo:400:kworker.0 Request processed in 55us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635287.461649:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789635287.461654:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427280768 00000100:00100000:0.0:1789635287.461656:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427280768 00000100:00100000:0.0:1789635287.461669:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427281280 00000100:00100000:0.0:1789635287.461671:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427281280 00000100:00100000:0.0:1789635287.461684:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789635287.461689:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876568427280128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635287.461722:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876568427280128:12345-0@lo:400:kworker.0 Request processed in 32us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635287.461735:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789635287.461747:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789635287.461753:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876568427280512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635287.461782:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876568427280512:12345-0@lo:400:kworker.0 Request processed in 30us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635287.461787:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789635287.461809:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789635287.461815:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876568427280768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635287.461844:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876568427280768:12345-0@lo:400:kworker.0 Request processed in 29us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635287.461849:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789635287.461859:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789635287.461865:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876568427281280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635287.461891:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876568427281280:12345-0@lo:400:kworker.0 Request processed in 26us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635287.461896:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789635287.462014:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427280000 00000100:00100000:2.0:1789635287.462018:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427280000 00000100:00100000:2.0:1789635287.462047:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1789635287.462055:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3642:x1876568427280000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635287.462088:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3642:x1876568427280000:12345-0@lo:400:kworker.0 Request processed in 35us (1461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635287.462117:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00080000:2.0:1789635287.462148:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789635287.462152:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789635287.462154:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789635287.462177:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0446c3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427281792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789635287.462204:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635287.462231:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044782aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427280000:0@lo:400:kworker.0 00000100:00100000:2.0:1789635287.462236:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427281792 00000100:00100000:2.0:1789635287.462239:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427281792 00000100:00100000:3.0:1789635287.462243:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876568427280512:0@lo:400:kworker.0 00010000:00080000:3.0:1789635287.462254:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447829180 x1876568427281024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635287.462264:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427281024:0@lo:400:kworker.0 00010000:00080000:3.0:1789635287.462273:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447829f80 x1876568427281536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635287.462280:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427281536:0@lo:400:kworker.0 00000100:00100000:3.0:1789635287.462299:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789635287.462306:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427281664:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789635287.462330:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635287.462740:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427280256:0@lo:400:kworker.0 00010000:00080000:0.0:1789635287.462753:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447828380 x1876568427280768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635287.462762:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447828380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1876568427280768:0@lo:400:kworker.0 00010000:00080000:0.0:1789635287.462772:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447828700 x1876568427281280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635287.462780:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1876568427281280:0@lo:400:kworker.0 00000100:00100000:0.0:1789635287.462813:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044782b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427280384:0@lo:400:kworker.0 00010000:00080000:0.0:1789635287.462823:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d044782bb80 x1876568427281408/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635287.462830:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044782bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427281408:0@lo:400:kworker.0 00000100:00100000:1.0:1789635287.463743:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044782ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876568427280128:0@lo:400:kworker.0 00000100:00100000:1.0:1789635287.463753:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044782a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1876568427280640:0@lo:400:kworker.0 00000100:00100000:1.0:1789635287.463788:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635287.463810:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1876568427281152:0@lo:400:kworker.0 00000100:00100000:1.0:1789635287.463831:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635287.463868:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427280640 00000100:00100000:1.0:1789635287.463874:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427280640 00000100:00100000:1.0:1789635287.463912:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427281152 00000100:00100000:1.0:1789635287.463915:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427281152 00000100:00100000:1.0:1789635287.463937:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789635287.463944:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876568427280640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635287.463988:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876568427280640:12345-0@lo:400:kworker.0 Request processed in 44us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635287.463995:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789635287.464008:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789635287.464014:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876568427281152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635287.464041:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876568427281152:12345-0@lo:400:kworker.0 Request processed in 28us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635287.464055:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789635287.464085:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044782a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1876568427280640:0@lo:400:kworker.0 00000100:00100000:1.0:1789635287.464094:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1876568427281152:0@lo:400:kworker.0 00000100:00080000:1.0:1789635287.464128:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635287.470532:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427281664 00000100:00100000:2.0:1789635287.470550:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427281664 00000100:00100000:2.0:1789635287.470619:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789635287.470766:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427281792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789635287.470814:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635287.470906:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427281792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 278us (8700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635287.470913:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789635287.470933:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789635287.470939:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427281664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789635287.470949:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635287.470984:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427281664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (8654us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635287.470990:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1789635287.471048:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447a84700 x1876568427281664/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635303 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635287.471068:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427281664:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1789635287.473661:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0446c3d880 x1876568427281792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635303 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635287.473689:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0446c3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427281792:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789635288.229352:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635288.484069:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789635288.484091:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427281920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789635288.484161:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635288.484291:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427281920 00000100:00100000:2.0:1789635288.484299:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427281920 00000100:00100000:2.0:1789635288.484346:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789635288.484355:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427281920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789635288.484383:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635288.484432:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427281920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635288.484439:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1789635288.484518:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447974a80 x1876568427281920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635304 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635288.484535:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427281920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635288.998143:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789635288.998164:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427282048:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789635288.998224:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635288.998279:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427282048 00000100:00100000:0.0:1789635288.998286:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427282048 00000100:00100000:0.0:1789635288.998325:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789635288.998333:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427282048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789635288.998353:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635288.998388:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427282048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635288.998395:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1789635288.998428:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447976300 x1876568427282048/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635304 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635288.998444:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427282048:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789635289.017510:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635289.017582:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635289.017650:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635289.017697:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411482112 00000100:00100000:2.0:1789635289.017709:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411482112 00000100:00100000:2.0:1789635289.017797:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411482240 00000100:00100000:2.0:1789635289.017801:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411482240 00000100:00100000:2.0:1789635289.017829:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 111 00000100:00100000:2.0:1789635289.017840:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2399:x1876568411482112:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635289.017926:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2399:x1876568411482112:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 88us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635289.017934:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 111 00000100:00100000:2.0:1789635289.017954:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 112 00000100:00100000:2.0:1789635289.017961:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411482240:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635289.017987:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411482240:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 27us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635289.017993:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 112 00000100:00080000:2.0:1789635289.018011:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789635289.018016:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635289.018290:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411481984 00000100:00100000:0.0:1789635289.018304:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411481984 00000100:00100000:0.0:1789635289.018363:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 285 00000100:00100000:0.0:1789635289.018372:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:2399:x1876568411481984:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635289.018446:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:2399:x1876568411481984:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 75us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635289.018463:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 285 00010000:00010000:3.0:1789635289.253094:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635290.277229:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789635290.362232:0:11121:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00000100:00100000:0.0:1789635290.532153:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427282176:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789635290.532247:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635290.533574:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789635290.533591:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427282304:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789635290.533676:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635290.533730:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427282176 00000100:00100000:0.0:1789635290.533739:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427282176 00000100:00100000:0.0:1789635290.533876:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427282304 00000100:00100000:0.0:1789635290.533880:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427282304 00000100:00100000:0.0:1789635290.533900:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789635290.533909:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427282176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789635290.533957:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789635290.534025:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427282176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (1778us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635290.534032:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789635290.534051:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789635290.534057:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427282304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789635290.534075:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789635290.534107:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427282304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635290.534113:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789635290.534160:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427282304:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789635290.534198:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427282176:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789635291.305667:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635292.324544:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635292.580896:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789635292.580917:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427282432:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789635292.580994:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635292.581209:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427282432 00000100:00100000:3.0:1789635292.581217:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427282432 00000100:00100000:3.0:1789635292.581267:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789635292.581278:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427282432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789635292.581318:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635292.581358:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427282432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635292.581365:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789635292.581826:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427282944:0@lo:400:kworker.0 00000100:00100000:2.0:1789635292.581861:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635292.581898:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427283456:0@lo:400:kworker.0 00000100:00100000:2.0:1789635292.581922:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635292.581951:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427283968:0@lo:400:kworker.0 00000100:00100000:2.0:1789635292.581970:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635292.581989:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789635292.581995:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427282816:0@lo:400:kworker.0 00000100:00100000:2.0:1789635292.582014:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635292.582031:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1876568427283328:0@lo:400:kworker.0 00000100:00100000:2.0:1789635292.582051:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635292.582084:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1876568427283840:0@lo:400:kworker.0 00000100:00100000:2.0:1789635292.582103:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789635292.582126:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789635292.582137:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427283456 00000100:00100000:2.0:1789635292.582142:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427283456 00000100:00100000:2.0:1789635292.582175:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427283968 00000100:00100000:2.0:1789635292.582179:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427283968 00000100:00100000:2.0:1789635292.582201:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789635292.582207:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427283456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635292.582245:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427283456:12345-0@lo:400:kworker.0 Request processed in 39us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635292.582251:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789635292.582261:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789635292.582266:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427283968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635292.582547:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427283968:12345-0@lo:400:kworker.0 Request processed in 279us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635292.582554:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789635292.582578:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427282944 00000100:00100000:2.0:1789635292.582582:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427282944 00000100:00100000:2.0:1789635292.582628:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427282816 00000100:00100000:2.0:1789635292.582631:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427282816 00000100:00100000:2.0:1789635292.582645:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789635292.582651:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427282944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635292.582684:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427282944:12345-0@lo:400:kworker.0 Request processed in 34us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635292.582690:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789635292.582701:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789635292.582707:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427282816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635292.582735:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427282816:12345-0@lo:400:kworker.0 Request processed in 28us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635292.582740:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789635292.582756:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427283328 00000100:00100000:2.0:1789635292.582759:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427283328 00000100:00100000:2.0:1789635292.582780:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427283840 00000100:00100000:2.0:1789635292.582782:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427283840 00000100:00100000:2.0:1789635292.582799:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789635292.582805:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876568427283328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635292.582833:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876568427283328:12345-0@lo:400:kworker.0 Request processed in 29us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635292.582838:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789635292.582848:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789635292.582861:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876568427283840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635292.582889:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876568427283840:12345-0@lo:400:kworker.0 Request processed in 29us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635292.582894:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:2.0:1789635292.582923:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789635292.582926:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789635292.582928:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789635292.582964:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427282816:0@lo:400:kworker.0 00010000:00080000:2.0:1789635292.582978:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447974e00 x1876568427283328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635292.582987:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1876568427283328:0@lo:400:kworker.0 00010000:00080000:2.0:1789635292.582995:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447918000 x1876568427283840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635292.583004:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1876568427283840:0@lo:400:kworker.0 00000100:00100000:2.0:1789635292.583012:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427282944:0@lo:400:kworker.0 00010000:00080000:2.0:1789635292.583020:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447976300 x1876568427283456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635292.583027:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427283456:0@lo:400:kworker.0 00010000:00080000:2.0:1789635292.583035:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447919c00 x1876568427283968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635292.583041:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427283968:0@lo:400:kworker.0 00000100:00100000:0.0:1789635292.583716:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876568427282688:0@lo:400:kworker.0 00000100:00100000:0.0:1789635292.583754:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635292.583783:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1876568427283200:0@lo:400:kworker.0 00000100:00100000:0.0:1789635292.583802:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635292.583819:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1876568427283712:0@lo:400:kworker.0 00000100:00100000:0.0:1789635292.583837:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635292.583855:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1789635292.583861:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427282560:0@lo:400:kworker.0 00000100:00100000:0.0:1789635292.583886:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635292.583911:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876568427283072:0@lo:400:kworker.0 00000100:00100000:0.0:1789635292.583930:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635292.583959:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427283584:0@lo:400:kworker.0 00000100:00100000:0.0:1789635292.583977:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635292.583991:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427284096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789635292.584007:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635292.584033:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427284096 00000100:00100000:0.0:1789635292.584037:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427284096 00000100:00100000:0.0:1789635292.584085:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789635292.584092:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447828380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427284096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789635292.584109:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635292.584143:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447828380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427284096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635292.584150:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789635292.584168:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427282688 00000100:00100000:0.0:1789635292.584171:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427282688 00000100:00100000:0.0:1789635292.584197:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427283200 00000100:00100000:0.0:1789635292.584200:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427283200 00000100:00100000:0.0:1789635292.584219:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427283712 00000100:00100000:0.0:1789635292.584222:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427283712 00000100:00100000:0.0:1789635292.584234:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427283072 00000100:00100000:0.0:1789635292.584237:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427283072 00000100:00100000:0.0:1789635292.584248:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789635292.584252:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044782a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876568427282688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635292.584283:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044782a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876568427282688:12345-0@lo:400:kworker.0 Request processed in 31us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635292.584485:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427282560 00000100:00100000:3.0:1789635292.584498:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427282560 00000100:00100000:3.0:1789635292.584526:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1789635292.584532:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3643:x1876568427282560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635292.584564:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3643:x1876568427282560:12345-0@lo:400:kworker.0 Request processed in 32us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635292.584569:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1789635292.584636:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789635292.584644:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044782ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876568427283200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635292.584675:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044782ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876568427283200:12345-0@lo:400:kworker.0 Request processed in 33us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635292.584680:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789635292.584692:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789635292.584698:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044782bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876568427283712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635292.584725:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044782bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876568427283712:12345-0@lo:400:kworker.0 Request processed in 28us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635292.584730:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789635292.584741:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789635292.584747:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044782b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876568427283072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635292.584770:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044782b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876568427283072:12345-0@lo:400:kworker.0 Request processed in 24us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635292.584775:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789635292.584876:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427283584 00000100:00100000:3.0:1789635292.584880:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427283584 00000100:00100000:3.0:1789635292.584906:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789635292.584913:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427283584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635292.584942:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427283584:12345-0@lo:400:kworker.0 Request processed in 31us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635292.584954:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789635292.584997:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427282560:0@lo:400:kworker.0 00000100:00100000:3.0:1789635292.585009:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876568427283072:0@lo:400:kworker.0 00010000:00080000:3.0:1789635292.585019:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447974a80 x1876568427283584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635292.585028:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427283584:0@lo:400:kworker.0 00010000:00080000:3.0:1789635292.585037:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447829500 x1876568427284096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635308 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635292.585051:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427284096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789635292.585062:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876568427282688:0@lo:400:kworker.0 00000100:00100000:3.0:1789635292.585071:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1876568427283200:0@lo:400:kworker.0 00000100:00100000:3.0:1789635292.585079:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1876568427283712:0@lo:400:kworker.0 00000100:00100000:0.0:1789635292.585818:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:0.0:1789635292.585842:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789635292.585843:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04477a9180 x1876568427282432/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635308 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789635292.585846:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635292.585858:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427282432:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789635293.347720:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635293.611807:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427284224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635293.611874:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635293.611975:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427284224 00000100:00100000:3.0:1789635293.611983:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427284224 00000100:00100000:3.0:1789635293.612039:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789635293.612049:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447828a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427284224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789635293.612076:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635293.612121:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447828a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427284224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635293.612127:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1789635293.612165:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447918700 x1876568427284224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635309 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635293.612194:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427284224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635294.129005:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789635294.129028:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427284352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789635294.129093:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635294.129138:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427284352 00000100:00100000:0.0:1789635294.129146:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427284352 00000100:00100000:0.0:1789635294.129197:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789635294.129206:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447829f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427284352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789635294.129227:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635294.129269:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447829f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427284352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635294.129275:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1789635294.129298:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789635294.129328:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447918700 x1876568427284352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635310 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635294.129357:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427284352:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789635294.158822:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635294.158871:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635294.158907:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635294.158957:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411482496 00000100:00100000:2.0:1789635294.158966:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411482496 00000100:00100000:2.0:1789635294.159019:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411482624 00000100:00100000:2.0:1789635294.159022:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411482624 00000100:00100000:2.0:1789635294.159042:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 119 00000100:00100000:2.0:1789635294.159050:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2396:x1876568411482496:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635294.159111:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2396:x1876568411482496:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 62us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635294.159118:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 119 00000100:00100000:2.0:1789635294.159133:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 120 00000100:00100000:2.0:1789635294.159139:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2396:x1876568411482624:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635294.159160:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2396:x1876568411482624:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 22us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635294.159166:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 120 00000100:00080000:2.0:1789635294.159179:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789635294.159182:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635294.159365:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411482368 00000100:00100000:1.0:1789635294.159370:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411482368 00000100:00100000:1.0:1789635294.162878:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 287 00000100:00100000:1.0:1789635294.162893:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:2396:x1876568411482368:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789635294.163148:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:2396:x1876568411482368:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 258us (4275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635294.163156:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 287 00000001:02000400:1.0:1789635294.293378:0:11219:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00010000:00010000:2.0:1789635294.373628:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635295.398533:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635295.654047:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427284480:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789635295.654196:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635295.654245:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427284480 00000100:00100000:2.0:1789635295.654254:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427284480 00000100:00100000:1.0:1789635295.654390:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044791ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427284608:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789635295.654413:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635295.654510:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427284608 00000100:00100000:2.0:1789635295.654524:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427284608 00000100:00100000:2.0:1789635295.654551:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789635295.654561:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427284480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789635295.654593:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789635295.654846:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789635295.654852:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427284480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 290us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635295.654861:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427284608:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789635295.654879:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000004:00000024:3.0:1789635295.654883:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789635295.654944:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427284608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635295.654951:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789635295.654993:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044791ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427284608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789635295.655097:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427284480:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789635296.419881:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789635297.325689:0:11316:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00010000:00010000:2.0:1789635297.445485:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635297.701537:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789635297.701560:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427284736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789635297.701647:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635297.701760:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427284736 00000100:00100000:0.0:1789635297.701769:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427284736 00000100:00100000:0.0:1789635297.701825:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789635297.701835:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427284736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789635297.701862:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635297.701904:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427284736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635297.701911:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1789635297.703037:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789635297.703079:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447977480 x1876568427284736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635297.703100:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427284736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789635297.705156:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427285248:0@lo:400:kworker.0 00000100:00100000:0.0:1789635297.705232:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635297.705290:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427285760:0@lo:400:kworker.0 00000100:00100000:0.0:1789635297.705327:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635297.705353:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1876568427286272:0@lo:400:kworker.0 00000100:00100000:2.0:1789635297.705671:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427284864:0@lo:400:kworker.0 00000100:00100000:2.0:1789635297.705707:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635297.705737:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427285376:0@lo:400:kworker.0 00000100:00100000:2.0:1789635297.705767:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876568427284992:0@lo:400:kworker.0 00000100:00100000:2.0:1789635297.705799:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427285248 00000100:00100000:2.0:1789635297.705806:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427285248 00000100:00100000:3.0:1789635297.705855:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427284864 00000100:00100000:2.0:1789635297.705859:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789635297.705860:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427284864 00000100:00100000:2.0:1789635297.705867:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044782aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427285248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635297.705883:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789635297.705889:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3640:x1876568427284864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635297.705916:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044782aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427285248:12345-0@lo:400:kworker.0 Request processed in 50us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635297.705919:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3640:x1876568427284864:12345-0@lo:400:kworker.0 Request processed in 31us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635297.705923:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789635297.705925:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1789635297.705944:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427285760 00000100:00100000:2.0:1789635297.705948:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427285760 00000100:00080000:3.0:1789635297.705995:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789635297.705998:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789635297.706004:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044782a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427285760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635297.706036:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044782a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427285760:12345-0@lo:400:kworker.0 Request processed in 33us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635297.706040:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789635297.706057:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427285120:0@lo:400:kworker.0 00000100:00100000:2.0:1789635297.706082:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635297.706103:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427285632:0@lo:400:kworker.0 00000100:00100000:3.0:1789635297.706176:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427285120 00000100:00100000:3.0:1789635297.706181:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427285120 00000100:00100000:3.0:1789635297.706210:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789635297.706217:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05677d1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427285120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635297.706293:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05677d1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427285120:12345-0@lo:400:kworker.0 Request processed in 76us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635297.706299:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789635297.707630:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635297.707690:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635297.707724:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1876568427285504:0@lo:400:kworker.0 00000100:00100000:2.0:1789635297.707760:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635297.707787:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427286016:0@lo:400:kworker.0 00000100:00100000:2.0:1789635297.707808:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635297.707844:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427286272 00000100:00100000:2.0:1789635297.707850:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427286272 00000100:00100000:2.0:1789635297.707889:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427284992 00000100:00100000:2.0:1789635297.707892:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427284992 00000100:00100000:2.0:1789635297.707924:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427285504 00000100:00100000:2.0:1789635297.707927:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427285504 00000100:00100000:0.0:1789635297.707933:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789635297.707947:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876568427286272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635297.707958:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789635297.707962:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635297.707967:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876568427284992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635297.707982:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427285888:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789635297.708004:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635297.708007:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876568427284992:12345-0@lo:400:kworker.0 Request processed in 42us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635297.708013:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789635297.708020:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427286400:0@lo:400:kworker.0 00000100:00100000:2.0:1789635297.708026:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427285376 00000100:00100000:2.0:1789635297.708029:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427285376 00000100:00100000:2.0:1789635297.708045:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789635297.708045:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635297.708062:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876568427285504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635297.708251:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789635297.708274:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427285376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635297.708480:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427284864:0@lo:400:kworker.0 00000100:00100000:0.0:1789635297.708523:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876568427286272:12345-0@lo:400:kworker.0 Request processed in 579us (3143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635297.708531:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789635297.708666:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427285888 00000100:00100000:1.0:1789635297.708671:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427285888 00000100:00100000:1.0:1789635297.708708:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789635297.708715:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427285888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789635297.708732:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789635297.708775:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427285888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635297.708782:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1789635297.708816:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447829c00 x1876568427285888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635297.708834:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427285888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789635297.710378:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427286016 00000100:00100000:0.0:1789635297.710387:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427286016 00000100:00100000:0.0:1789635297.710454:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427286400 00000100:00100000:0.0:1789635297.710472:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427286400 00000100:00100000:0.0:1789635297.710503:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789635297.710512:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447974a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427286016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635297.710649:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789635297.710662:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427286400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635297.712087:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876568427285504:12345-0@lo:400:kworker.0 Request processed in 4018us (4318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635297.712087:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447974a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427286016:12345-0@lo:400:kworker.0 Request processed in 1570us (4271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635297.712106:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789635297.712107:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789635297.712186:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876568427284992:0@lo:400:kworker.0 00000100:00100000:2.0:1789635297.712197:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1876568427285504:0@lo:400:kworker.0 00010000:00080000:2.0:1789635297.712208:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447a3ed80 x1876568427286016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635297.712218:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427286016:0@lo:400:kworker.0 00000100:00100000:2.0:1789635297.712249:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635297.712283:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1876568427286144:0@lo:400:kworker.0 00000100:00100000:2.0:1789635297.712313:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635297.712342:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427285120:0@lo:400:kworker.0 00010000:00080000:2.0:1789635297.712488:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447a3f100 x1876568427286272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635297.712500:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1876568427286272:0@lo:400:kworker.0 00000100:00100000:2.0:1789635297.712583:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427285248:0@lo:400:kworker.0 00010000:00080000:2.0:1789635297.712614:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447a3ea00 x1876568427285760/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635297.712622:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427285760:0@lo:400:kworker.0 00000100:00100000:2.0:1789635297.712642:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427285632 00000100:00100000:2.0:1789635297.712647:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427285632 00000100:00100000:2.0:1789635297.712687:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427286144 00000100:00100000:2.0:1789635297.712690:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427286144 00000100:00100000:2.0:1789635297.712709:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789635297.712716:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427285632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635297.712764:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427285632:12345-0@lo:400:kworker.0 Request processed in 48us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635297.712771:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789635297.712778:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789635297.712783:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876568427286144:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1789635297.712815:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447a3df80 x1876568427285632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635297.712826:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876568427286144:12345-0@lo:400:kworker.0 Request processed in 45us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635297.712829:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427285632:0@lo:400:kworker.0 00000100:00100000:0.0:1789635297.712841:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789635297.712849:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1876568427286144:0@lo:400:kworker.0 00000100:00080000:2.0:1789635297.713705:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789635297.713712:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789635297.713715:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789635297.713718:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789635297.715732:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427285376:12345-0@lo:400:kworker.0 Request processed in 7462us (7762us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635297.715746:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789635297.715855:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427286400:12345-0@lo:400:kworker.0 Request processed in 5197us (7806us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635297.715864:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789635297.717056:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427285376:0@lo:400:kworker.0 00010000:00080000:0.0:1789635297.717077:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04477a9180 x1876568427286400/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635297.717087:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427286400:0@lo:400:kworker.0 00010000:00010000:3.0:1789635298.468052:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635298.727268:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044791ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427286528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635298.727365:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635298.727744:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427286528 00000100:00100000:3.0:1789635298.727755:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427286528 00000100:00100000:3.0:1789635298.727820:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789635298.727830:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447829500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427286528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789635298.727865:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635298.727923:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447829500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427286528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635298.727930:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1789635298.728034:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d044791ad80 x1876568427286528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635314 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635298.728054:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044791ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427286528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635299.238727:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789635299.238761:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427286656:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789635299.238865:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635299.238927:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427286656 00000100:00100000:0.0:1789635299.238944:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427286656 00000100:00100000:0.0:1789635299.239000:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789635299.239008:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447829c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427286656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789635299.239033:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635299.239078:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447829c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427286656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635299.239084:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1789635299.239104:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789635299.239135:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04477a8e00 x1876568427286656/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635315 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635299.239153:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427286656:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789635299.291266:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635299.291314:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635299.291365:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635299.291411:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411483008 00000100:00100000:0.0:1789635299.291424:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411483008 00000100:00100000:0.0:1789635299.291501:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411482880 00000100:00100000:0.0:1789635299.291505:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411482880 00000100:00100000:0.0:1789635299.291530:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 127 00000100:00100000:0.0:1789635299.291544:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2396:x1876568411483008:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635299.291676:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2396:x1876568411483008:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 135us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635299.291685:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 127 00000100:00100000:0.0:1789635299.291707:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 128 00000100:00100000:0.0:1789635299.291714:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044782aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2396:x1876568411482880:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635299.291741:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044782aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2396:x1876568411482880:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 28us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635299.291759:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 128 00000100:00080000:0.0:1789635299.291778:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789635299.291783:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789635299.292217:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411482752 00000100:00100000:3.0:1789635299.292225:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411482752 00000100:00100000:3.0:1789635299.292259:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 289 00000100:00100000:3.0:1789635299.292267:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:2396:x1876568411482752:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635299.292306:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:2396:x1876568411482752:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 40us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635299.292313:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 289 00010000:00010000:1.0:1789635299.500150:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789635299.614469:0:11365:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Sep 17 04:54:57 EDT 2026 00010000:00010000:2.0:1789635300.517078:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635300.771742:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789635300.771765:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427286784:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789635300.771859:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635300.771923:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427286784 00000100:00100000:2.0:1789635300.771931:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427286784 00000100:00100000:2.0:1789635300.771976:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789635300.771985:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427286784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789635300.772018:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789635300.772062:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427286784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635300.772068:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789635300.772127:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427286784:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789635300.775294:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789635300.775315:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427286912:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789635300.775376:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635300.775428:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427286912 00000100:00100000:2.0:1789635300.775434:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427286912 00000100:00100000:2.0:1789635300.775490:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789635300.775614:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427286912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789635300.775645:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789635300.775686:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427286912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635300.775693:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789635300.775791:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427286912:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789635301.539843:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635302.566076:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635302.820979:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789635302.821004:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427287040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789635302.821072:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635302.821203:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427287040 00000100:00100000:0.0:1789635302.821211:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427287040 00000100:00100000:0.0:1789635302.821282:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789635302.821293:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427287040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789635302.821323:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635302.821365:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427287040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635302.821372:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1789635302.821435:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789635302.821687:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447aded80 x1876568427287040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635302.821706:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427287040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789635302.821917:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789635302.821926:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427287168:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789635302.821954:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635302.821986:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427287168 00000100:00100000:0.0:1789635302.821989:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427287168 00000100:00100000:0.0:1789635302.822017:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789635302.822024:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447add180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427287168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789635302.822038:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635302.822067:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447add180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427287168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635302.822073:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1789635302.822086:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789635302.822101:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447addc00 x1876568427287168/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635302.822113:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427287168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789635302.834880:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044791ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427287296:0@lo:400:kworker.0 00000100:00100000:3.0:1789635302.834950:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635302.834988:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876568427287808:0@lo:400:kworker.0 00000100:00100000:3.0:1789635302.835013:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635302.835031:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427288320:0@lo:400:kworker.0 00000100:00100000:3.0:1789635302.835055:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635302.835081:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789635302.835087:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427287680:0@lo:400:kworker.0 00000100:00100000:3.0:1789635302.835110:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635302.835128:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427288192:0@lo:400:kworker.0 00000100:00100000:3.0:1789635302.835148:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635302.835178:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427287296 00000100:00100000:3.0:1789635302.835186:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427287296 00000100:00100000:3.0:1789635302.835232:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789635302.835242:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3643:x1876568427287296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635302.835293:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3643:x1876568427287296:12345-0@lo:400:kworker.0 Request processed in 52us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635302.835300:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789635302.835334:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427287808 00000100:00100000:3.0:1789635302.835338:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427287808 00000100:00100000:3.0:1789635302.835365:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789635302.835371:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044796b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876568427287808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635302.835433:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044796b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876568427287808:12345-0@lo:400:kworker.0 Request processed in 63us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635302.835440:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789635302.835461:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427288320 00000100:00100000:3.0:1789635302.835464:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427288320 00000100:00100000:3.0:1789635302.835498:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427288192 00000100:00100000:3.0:1789635302.835502:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427288192 00000100:00100000:3.0:1789635302.835523:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789635302.835530:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427288320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635302.835560:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427288320:12345-0@lo:400:kworker.0 Request processed in 32us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635302.835566:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789635302.835578:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789635302.835584:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427288192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635302.839679:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427288192:12345-0@lo:400:kworker.0 Request processed in 52us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635302.839698:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789635302.839740:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427287680 00000100:00100000:3.0:1789635302.839750:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427287680 00000100:00100000:3.0:1789635302.839797:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789635302.839806:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427287680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635302.839891:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427287680:12345-0@lo:400:kworker.0 Request processed in 86us (4780us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635302.839897:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1789635302.839929:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789635302.839960:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427287552:0@lo:400:kworker.0 00000100:00100000:3.0:1789635302.840010:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635302.840084:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1876568427288064:0@lo:400:kworker.0 00000100:00100000:3.0:1789635302.840108:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635302.840129:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447969180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1876568427288576:0@lo:400:kworker.0 00000100:00100000:3.0:1789635302.840147:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635302.840168:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789635302.840176:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876568427287424:0@lo:400:kworker.0 00000100:00100000:3.0:1789635302.840196:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635302.840220:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1876568427287936:0@lo:400:kworker.0 00000100:00100000:3.0:1789635302.840242:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635302.840259:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044796a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1876568427288448:0@lo:400:kworker.0 00000100:00100000:3.0:1789635302.840280:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635302.840306:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427288064 00000100:00100000:3.0:1789635302.840311:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427288064 00000100:00100000:3.0:1789635302.840336:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427288576 00000100:00100000:3.0:1789635302.840339:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427288576 00000100:00100000:3.0:1789635302.840351:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427287424 00000100:00100000:3.0:1789635302.840353:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427287424 00000100:00100000:3.0:1789635302.840364:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427287936 00000100:00100000:3.0:1789635302.840366:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427287936 00000100:00100000:3.0:1789635302.840390:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427288448 00000100:00100000:3.0:1789635302.840393:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427288448 00000100:00100000:3.0:1789635302.840409:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789635302.840415:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876568427288064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635302.840451:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876568427288064:12345-0@lo:400:kworker.0 Request processed in 36us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635302.840457:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789635302.840479:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789635302.840484:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876568427288576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635302.840511:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876568427288576:12345-0@lo:400:kworker.0 Request processed in 28us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635302.840516:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789635302.840525:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789635302.840530:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876568427287424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635302.840552:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876568427287424:12345-0@lo:400:kworker.0 Request processed in 22us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635302.840557:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789635302.840566:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789635302.840571:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876568427287936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635302.840592:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876568427287936:12345-0@lo:400:kworker.0 Request processed in 22us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635302.840620:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789635302.840631:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789635302.844477:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876568427288448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635302.844572:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876568427288448:12345-0@lo:400:kworker.0 Request processed in 3935us (4290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635302.844583:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:3.0:1789635302.844635:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789635302.844641:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789635302.844684:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427287680:0@lo:400:kworker.0 00010000:00080000:3.0:1789635302.844702:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04459dfb80 x1876568427288192/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635302.844730:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427288192:0@lo:400:kworker.0 00000100:00100000:3.0:1789635302.844743:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044791ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427287296:0@lo:400:kworker.0 00000100:00100000:3.0:1789635302.844754:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876568427287808:0@lo:400:kworker.0 00010000:00080000:3.0:1789635302.844765:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04459df480 x1876568427288320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635302.844773:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427288320:0@lo:400:kworker.0 00000100:00100000:3.0:1789635302.844816:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876568427287424:0@lo:400:kworker.0 00000100:00100000:3.0:1789635302.844827:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1876568427287936:0@lo:400:kworker.0 00000100:00100000:3.0:1789635302.844836:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044796a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1876568427288448:0@lo:400:kworker.0 00010000:00080000:3.0:1789635302.844848:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04459dca80 x1876568427288064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635302.844855:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1876568427288064:0@lo:400:kworker.0 00010000:00080000:3.0:1789635302.844866:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447969180 x1876568427288576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635302.844873:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447969180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1876568427288576:0@lo:400:kworker.0 00000100:00100000:2.0:1789635302.850698:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427287552 00000100:00100000:2.0:1789635302.850713:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427287552 00000100:00100000:2.0:1789635302.850773:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789635302.850783:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427287552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635302.850877:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427287552:12345-0@lo:400:kworker.0 Request processed in 95us (10866us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635302.850884:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789635302.850933:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427287552:0@lo:400:kworker.0 00010000:00010000:3.0:1789635303.589037:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635303.843916:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427288704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635303.843981:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635303.844215:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427288704 00000100:00100000:1.0:1789635303.844224:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427288704 00000100:00100000:1.0:1789635303.844281:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789635303.844304:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427288704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789635303.844331:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789635303.845261:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427288704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 957us (1275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635303.845270:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:0.0:1789635303.846220:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04467bb800 x1876568427288704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635319 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635303.846243:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427288704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635304.356315:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789635304.356338:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427288832:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789635304.356417:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635304.356879:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427288832 00000100:00100000:2.0:1789635304.356888:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427288832 00000100:00100000:2.0:1789635304.356965:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1789635304.356970:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789635304.356978:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447adc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427288832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789635304.357112:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635304.357199:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447adc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427288832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 225us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635304.357206:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1789635304.357567:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04477ab100 x1876568427288832/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635320 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635304.357588:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427288832:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789635304.376865:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635304.376907:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635304.376946:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635304.377029:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411483392 00000100:00100000:3.0:1789635304.377039:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411483392 00000100:00100000:3.0:1789635304.377107:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411483264 00000100:00100000:3.0:1789635304.377111:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411483264 00000100:00100000:3.0:1789635304.377134:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 135 00000100:00100000:3.0:1789635304.377145:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411483392:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635304.377229:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411483392:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 86us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635304.377236:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 135 00000100:00100000:3.0:1789635304.377253:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 136 00000100:00100000:3.0:1789635304.377259:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2399:x1876568411483264:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635304.377284:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2399:x1876568411483264:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 24us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635304.377289:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 136 00000100:00100000:1.0:1789635304.377421:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411483136 00000100:00100000:1.0:1789635304.377426:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411483136 00000100:00100000:1.0:1789635304.377469:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 291 00000100:00100000:1.0:1789635304.377476:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:2399:x1876568411483136:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789635304.377504:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:2399:x1876568411483136:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 28us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635304.377510:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 291 00000100:00080000:0.0:1789635304.377731:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789635304.377735:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789635304.614421:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635305.636074:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635305.894959:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789635305.894980:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427288960:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789635305.895044:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635305.895067:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427288960 00000100:00100000:3.0:1789635305.895077:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427288960 00000100:00100000:3.0:1789635305.895129:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789635305.895140:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427288960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789635305.895174:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789635305.895191:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427289088:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789635305.895230:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427288960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635305.895235:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635305.895295:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427289088 00000100:00100000:0.0:1789635305.895300:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427289088 00000100:00100000:1.0:1789635305.895376:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427288960:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789635305.896879:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789635305.897101:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789635305.897114:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427289088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789635305.897144:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789635305.897254:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427289088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 144us (2021us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635305.897261:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789635305.897314:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427289088:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789635306.659959:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635307.689192:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635307.939834:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427289216:0@lo:400:kworker.0 00000100:00100000:0.0:1789635307.939922:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635307.940002:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044796a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427289472:0@lo:400:kworker.0 00000100:00100000:0.0:1789635307.940010:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876568427289728:0@lo:400:kworker.0 00000100:00100000:2.0:1789635307.940184:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447969180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876568427289344:0@lo:400:kworker.0 00000100:00100000:0.0:1789635307.940642:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635307.940668:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427290240:0@lo:400:kworker.0 00000100:00100000:0.0:1789635307.940692:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635307.940710:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427290752:0@lo:400:kworker.0 00000100:00100000:0.0:1789635307.940727:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635307.940758:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427289728 00000100:00100000:0.0:1789635307.940766:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427289728 00000100:00100000:0.0:1789635307.940808:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789635307.940816:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876568427289728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635307.940866:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876568427289728:12345-0@lo:400:kworker.0 Request processed in 51us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635307.940873:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789635307.940912:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876568427289728:0@lo:400:kworker.0 00000100:00100000:0.0:1789635307.940949:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427289600:0@lo:400:kworker.0 00000100:00100000:0.0:1789635307.940974:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635307.940993:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427290112:0@lo:400:kworker.0 00000100:00100000:0.0:1789635307.941014:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635307.941030:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427290624:0@lo:400:kworker.0 00000100:00100000:0.0:1789635307.941048:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635307.941066:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789635307.941072:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427291008:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789635307.941092:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635307.941128:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427291008 00000100:00100000:0.0:1789635307.941132:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427291008 00000100:00100000:0.0:1789635307.941177:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789635307.941191:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427291008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789635307.941215:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635307.941251:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427291008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635307.941257:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1789635307.941272:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789635307.941290:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447975500 x1876568427291008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635307.941304:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427291008:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789635307.941351:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427290240 00000100:00100000:0.0:1789635307.941355:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427290240 00000100:00100000:0.0:1789635307.941379:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427290752 00000100:00100000:0.0:1789635307.941382:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427290752 00000100:00100000:0.0:1789635307.941395:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427290112 00000100:00100000:0.0:1789635307.941398:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427290112 00000100:00100000:0.0:1789635307.941409:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427290624 00000100:00100000:0.0:1789635307.941411:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427290624 00000100:00100000:0.0:1789635307.941421:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789635307.941427:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427290240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635307.941463:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427290240:12345-0@lo:400:kworker.0 Request processed in 36us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635307.941469:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789635307.941479:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789635307.941484:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427290752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635307.941509:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427290752:12345-0@lo:400:kworker.0 Request processed in 25us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635307.941514:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789635307.941531:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789635307.941538:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427290112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635307.941567:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427290112:12345-0@lo:400:kworker.0 Request processed in 30us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635307.941572:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789635307.941581:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789635307.941587:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427290624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635307.941639:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427290624:12345-0@lo:400:kworker.0 Request processed in 52us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635307.941645:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789635307.941664:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427289216 00000100:00100000:0.0:1789635307.941667:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427289216 00000100:00100000:0.0:1789635307.941689:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1789635307.941695:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b811450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3642:x1876568427289216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635307.941726:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b811450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3642:x1876568427289216:12345-0@lo:400:kworker.0 Request processed in 31us (1808us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635307.941732:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00080000:0.0:1789635307.941755:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789635307.941758:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789635307.941771:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04459dfb80 x1876568427290112/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635307.941781:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427290112:0@lo:400:kworker.0 00010000:00080000:0.0:1789635307.941789:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447918000 x1876568427290624/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635307.941796:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427290624:0@lo:400:kworker.0 00010000:00080000:0.0:1789635307.941829:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447919c00 x1876568427290240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635307.941838:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427290240:0@lo:400:kworker.0 00010000:00080000:0.0:1789635307.941848:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447a86300 x1876568427290752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635307.941855:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427290752:0@lo:400:kworker.0 00000100:00100000:0.0:1789635307.941863:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427289216:0@lo:400:kworker.0 00000100:00100000:0.0:1789635307.941908:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427289600 00000100:00100000:0.0:1789635307.941912:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427289600 00000100:00100000:0.0:1789635307.941935:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789635307.941941:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427289600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635307.941976:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427289600:12345-0@lo:400:kworker.0 Request processed in 35us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635307.941982:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789635307.942004:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427289600:0@lo:400:kworker.0 00000100:00100000:3.0:1789635307.945368:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635307.945447:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1876568427289984:0@lo:400:kworker.0 00000100:00100000:3.0:1789635307.945743:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635307.945846:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044791ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1876568427290496:0@lo:400:kworker.0 00000100:00100000:3.0:1789635307.945873:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635307.945952:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427289984 00000100:00100000:3.0:1789635307.945962:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427289984 00000100:00100000:3.0:1789635307.946032:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427290496 00000100:00100000:3.0:1789635307.946036:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427290496 00000100:00100000:3.0:1789635307.946202:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789635307.946214:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876568427289984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635307.946288:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876568427289984:12345-0@lo:400:kworker.0 Request processed in 74us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635307.946296:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789635307.946316:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789635307.946323:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876568427290496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635307.946366:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876568427290496:12345-0@lo:400:kworker.0 Request processed in 44us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635307.946373:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:3.0:1789635307.946394:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789635307.946431:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04459de680 x1876568427289984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635307.946447:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1876568427289984:0@lo:400:kworker.0 00010000:00080000:3.0:1789635307.946830:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d044791ad80 x1876568427290496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635307.946865:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044791ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1876568427290496:0@lo:400:kworker.0 00000100:00100000:2.0:1789635307.947742:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635307.947796:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427289344 00000100:00100000:2.0:1789635307.947804:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427289344 00000100:00100000:2.0:1789635307.947859:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789635307.947868:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876568427289344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635307.948373:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876568427289344:12345-0@lo:400:kworker.0 Request processed in 505us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635307.948382:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789635307.948414:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447969180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876568427289344:0@lo:400:kworker.0 00000100:00100000:3.0:1789635307.948432:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1876568427289856:0@lo:400:kworker.0 00000100:00100000:3.0:1789635307.948903:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635307.948954:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1876568427290368:0@lo:400:kworker.0 00000100:00100000:3.0:1789635307.948980:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635307.949012:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427289856 00000100:00100000:3.0:1789635307.949020:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427289856 00000100:00100000:3.0:1789635307.949070:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427290368 00000100:00100000:3.0:1789635307.949074:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427290368 00000100:00100000:3.0:1789635307.949097:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789635307.949443:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427289472 00000100:00100000:0.0:1789635307.949452:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427289472 00000100:00100000:0.0:1789635307.949496:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789635307.949505:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427289472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635307.949891:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876568427289856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635307.950029:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876568427289856:12345-0@lo:400:kworker.0 Request processed in 147us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635307.950062:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789635307.950076:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876568427290368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635307.950140:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876568427290368:12345-0@lo:400:kworker.0 Request processed in 68us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635307.950147:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:2.0:1789635307.950234:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635307.950274:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1876568427290368:0@lo:400:kworker.0 00000100:00100000:2.0:1789635307.950289:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427290880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789635307.950333:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635307.950377:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427290880 00000100:00100000:2.0:1789635307.950384:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427290880 00000100:00100000:2.0:1789635307.950436:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789635307.950442:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427290880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789635307.950475:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635307.950509:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427290880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635307.950515:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:2.0:1789635307.950549:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447a85180 x1876568427290880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635307.951009:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427290880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789635307.951070:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1876568427289856:0@lo:400:kworker.0 00000100:00100000:3.0:1789635307.951358:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789635307.955361:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427289472:12345-0@lo:400:kworker.0 Request processed in 5847us (9995us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635307.955376:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789635307.959641:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044796a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427289472:0@lo:400:kworker.0 00010000:00010000:0.0:1789635308.708895:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635308.966752:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0446c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427291136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635308.966845:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635308.967084:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427291136 00000100:00100000:2.0:1789635308.967092:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427291136 00000100:00100000:2.0:1789635308.967243:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789635308.967255:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447659880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427291136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789635308.967286:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635308.967348:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447659880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427291136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635308.967355:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:3.0:1789635308.967417:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0446c3fb80 x1876568427291136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635324 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635308.967435:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0446c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427291136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635309.480823:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427291264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789635309.480896:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635309.480985:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427291264 00000100:00100000:1.0:1789635309.480994:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427291264 00000100:00100000:1.0:1789635309.481066:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789635309.481078:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447658e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427291264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789635309.481102:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789635309.481165:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447658e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427291264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635309.481172:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1789635309.481228:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04477aa300 x1876568427291264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635325 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635309.481247:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427291264:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789635309.481560:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789635309.500708:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635309.500751:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635309.500780:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411483520 00000100:00100000:2.0:1789635309.500780:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635309.500789:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411483520 00000100:00100000:2.0:1789635309.500809:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411483776 00000100:00100000:2.0:1789635309.500812:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411483776 00000100:00100000:3.0:1789635309.500838:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 293 00000100:00100000:2.0:1789635309.500844:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411483648 00000100:00100000:2.0:1789635309.500846:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411483648 00000100:00100000:3.0:1789635309.500848:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b811050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:2397:x1876568411483520:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635309.500863:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 143 00000100:00100000:2.0:1789635309.500869:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2397:x1876568411483776:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635309.500929:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b811050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:2397:x1876568411483520:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 82us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635309.500938:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 293 00000100:00100000:0.0:1789635309.500997:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 144 00000100:00100000:0.0:1789635309.501006:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2397:x1876568411483648:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635309.506315:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2397:x1876568411483776:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 5434us (5551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635309.506340:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 143 00000100:00080000:2.0:1789635309.506396:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789635309.506401:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789635309.506919:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2397:x1876568411483648:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 5912us (6135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635309.506928:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 144 00010000:00010000:1.0:1789635309.732762:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635310.759170:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635311.011849:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427291392:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789635311.011871:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789635311.011885:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427291520:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789635311.011918:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635311.011945:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427291392 00000100:00100000:2.0:1789635311.011952:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427291392 00000100:00100000:2.0:1789635311.011995:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789635311.012005:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427291392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789635311.012039:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789635311.012101:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427291392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635311.012108:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789635311.012136:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635311.012160:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427291520 00000100:00100000:2.0:1789635311.012164:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427291520 00000100:00100000:3.0:1789635311.012174:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427291392:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789635311.012184:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789635311.012189:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427291520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789635311.012207:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789635311.012253:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427291520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635311.012259:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789635311.012291:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427291520:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789635311.780526:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635312.803780:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635313.060924:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427292032:0@lo:400:kworker.0 00000100:00100000:3.0:1789635313.060987:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635313.061030:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427292544:0@lo:400:kworker.0 00000100:00100000:3.0:1789635313.061050:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635313.061064:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e015f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427293056:0@lo:400:kworker.0 00000100:00100000:3.0:1789635313.061080:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635313.061099:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1789635313.061105:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0446c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427291648:0@lo:400:kworker.0 00000100:00100000:3.0:1789635313.061128:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635313.061149:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e017b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427292160:0@lo:400:kworker.0 00000100:00100000:3.0:1789635313.061171:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635313.061188:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e016d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427292672:0@lo:400:kworker.0 00000100:00100000:3.0:1789635313.061207:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635313.061226:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e017800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427293184:0@lo:400:kworker.0 00000100:00100000:3.0:1789635313.061248:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635313.061293:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0446c3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427291904:0@lo:400:kworker.0 00000100:00100000:3.0:1789635313.061328:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635313.061347:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e016a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427292416:0@lo:400:kworker.0 00000100:00100000:3.0:1789635313.061370:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635313.061386:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e016680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1876568427292928:0@lo:400:kworker.0 00000100:00100000:3.0:1789635313.061410:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635313.061429:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789635313.061435:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0446c3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876568427291776:0@lo:400:kworker.0 00000100:00100000:3.0:1789635313.061458:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635313.061477:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1876568427292288:0@lo:400:kworker.0 00000100:00100000:3.0:1789635313.061496:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635313.061509:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e015500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1876568427292800:0@lo:400:kworker.0 00000100:00100000:3.0:1789635313.061526:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635313.061549:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427292032 00000100:00100000:3.0:1789635313.061557:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427292032 00000100:00100000:3.0:1789635313.061624:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427291904 00000100:00100000:3.0:1789635313.061628:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427291904 00000100:00100000:3.0:1789635313.061651:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789635313.061659:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e015880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427292032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635313.061724:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e015880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427292032:12345-0@lo:400:kworker.0 Request processed in 66us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635313.061732:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789635313.061751:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789635313.061759:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427291904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635313.061795:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427291904:12345-0@lo:400:kworker.0 Request processed in 37us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635313.061811:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789635313.061831:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427291648 00000100:00100000:3.0:1789635313.061835:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427291648 00000100:00100000:3.0:1789635313.061857:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1789635313.061863:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3640:x1876568427291648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635313.061892:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3640:x1876568427291648:12345-0@lo:400:kworker.0 Request processed in 29us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635313.061897:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1789635313.061924:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427292160 00000100:00100000:3.0:1789635313.061928:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427292160 00000100:00100000:3.0:1789635313.061945:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427292416 00000100:00100000:3.0:1789635313.061948:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427292416 00000100:00100000:3.0:1789635313.061970:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427292928 00000100:00100000:3.0:1789635313.061973:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427292928 00000100:00100000:3.0:1789635313.061986:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427291776 00000100:00100000:3.0:1789635313.061989:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427291776 00000100:00100000:3.0:1789635313.062000:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427292288 00000100:00100000:3.0:1789635313.062003:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427292288 00000100:00100000:3.0:1789635313.062014:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427292800 00000100:00100000:3.0:1789635313.062017:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427292800 00000100:00100000:3.0:1789635313.062029:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789635313.062036:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427292160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635313.062068:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427292160:12345-0@lo:400:kworker.0 Request processed in 32us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635313.062074:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789635313.062087:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789635313.062094:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b59ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876568427292416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635313.062121:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b59ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876568427292416:12345-0@lo:400:kworker.0 Request processed in 28us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635313.062133:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789635313.062145:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789635313.062151:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b59b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876568427292928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635313.062179:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b59b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876568427292928:12345-0@lo:400:kworker.0 Request processed in 29us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635313.062185:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789635313.062198:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789635313.062205:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876568427291776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635313.062235:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876568427291776:12345-0@lo:400:kworker.0 Request processed in 32us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635313.062241:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789635313.062254:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789635313.062260:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876568427292288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635313.062288:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876568427292288:12345-0@lo:400:kworker.0 Request processed in 29us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635313.062293:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789635313.062316:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789635313.062322:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b59a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876568427292800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635313.062354:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b59a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876568427292800:12345-0@lo:400:kworker.0 Request processed in 32us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635313.062360:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:3.0:1789635313.062424:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789635313.062429:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789635313.062454:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0446c3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876568427291776:0@lo:400:kworker.0 00000100:00100000:3.0:1789635313.062477:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1876568427292288:0@lo:400:kworker.0 00000100:00100000:3.0:1789635313.062486:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e015500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1876568427292800:0@lo:400:kworker.0 00000100:00100000:3.0:1789635313.062497:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0446c3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427291904:0@lo:400:kworker.0 00010000:00080000:3.0:1789635313.062509:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d056e016a00 x1876568427292416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635313.062519:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e016a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427292416:0@lo:400:kworker.0 00010000:00080000:3.0:1789635313.062528:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d056e016680 x1876568427292928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635313.062536:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e016680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1876568427292928:0@lo:400:kworker.0 00000100:00100000:3.0:1789635313.062558:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789635313.062565:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d057b599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427293312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789635313.062591:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635313.062661:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427293312 00000100:00100000:3.0:1789635313.062666:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427293312 00000100:00100000:3.0:1789635313.062697:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789635313.062705:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427293312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789635313.062728:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635313.062765:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427293312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635313.062771:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1789635313.062785:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789635313.062802:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d057b599c00 x1876568427293312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635313.062829:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d057b599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427293312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789635313.064357:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427292544 00000100:00100000:0.0:1789635313.064366:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427292544 00000100:00100000:0.0:1789635313.064403:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427293056 00000100:00100000:1.0:1789635313.064404:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0446c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427291648:0@lo:400:kworker.0 00000100:00100000:0.0:1789635313.064408:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427293056 00000100:00100000:1.0:1789635313.064426:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e017b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427292160:0@lo:400:kworker.0 00000100:00100000:0.0:1789635313.064428:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427292672 00000100:00100000:0.0:1789635313.064433:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427292672 00000100:00100000:1.0:1789635313.064446:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427292032:0@lo:400:kworker.0 00000100:00100000:0.0:1789635313.064448:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427293184 00000100:00100000:0.0:1789635313.064453:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427293184 00000100:00100000:0.0:1789635313.064471:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789635313.064478:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e017100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427292544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635313.064535:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e017100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427292544:12345-0@lo:400:kworker.0 Request processed in 58us (3484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635313.064539:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789635313.064549:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789635313.064553:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427293056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635313.064570:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427293056:12345-0@lo:400:kworker.0 Request processed in 18us (3490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635313.064582:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789635313.064590:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789635313.064606:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427292672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635313.064629:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427292672:12345-0@lo:400:kworker.0 Request processed in 35us (3422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635313.064634:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789635313.064657:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789635313.064663:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b59b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427293184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635313.064690:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b59b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427293184:12345-0@lo:400:kworker.0 Request processed in 27us (3442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635313.064696:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1789635313.064780:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789635313.064784:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789635313.064793:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427293440:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789635313.064822:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635313.064877:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427293440 00010000:00080000:1.0:1789635313.064878:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d056e016d80 x1876568427292672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635313.064883:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427293440 00000100:00100000:1.0:1789635313.064902:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e016d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427292672:0@lo:400:kworker.0 00000100:00100000:0.0:1789635313.064909:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789635313.064918:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427293440:12345-0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1789635313.064920:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d056e017800 x1876568427293184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635313.064932:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e017800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427293184:0@lo:400:kworker.0 00002000:00000024:0.0:1789635313.064933:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:1.0:1789635313.064959:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d056e014380 x1876568427292544/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635313.064969:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427292544:0@lo:400:kworker.0 00000100:00100000:0.0:1789635313.064975:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427293440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635313.064983:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:1.0:1789635313.064984:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d056e015f80 x1876568427293056/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635313.064995:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e015f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427293056:0@lo:400:kworker.0 00010000:00080000:0.0:1789635313.065020:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447659c00 x1876568427293440/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635313.065046:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427293440:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789635313.829854:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635314.083846:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789635314.083869:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d057b599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427293568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635314.083962:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635314.084026:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427293568 00000100:00100000:3.0:1789635314.084034:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427293568 00000100:00100000:3.0:1789635314.084085:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789635314.084095:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575f76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427293568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789635314.084124:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635314.084174:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575f76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427293568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635314.084181:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:2.0:1789635314.084206:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d057b599c00 x1876568427293568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635330 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635314.084235:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d057b599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427293568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635314.597117:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427293696:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789635314.597185:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635314.597297:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427293696 00000100:00100000:1.0:1789635314.597305:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427293696 00000100:00100000:1.0:1789635314.597360:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789635314.597371:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b59a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427293696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789635314.597393:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789635314.597440:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b59a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427293696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635314.597447:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:3.0:1789635314.597610:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04477a8e00 x1876568427293696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635330 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635314.597629:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427293696:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789635314.617887:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635314.617930:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635314.617968:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635314.618097:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411484032 00000100:00100000:3.0:1789635314.618107:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411484032 00000100:00100000:3.0:1789635314.618169:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411484160 00000100:00100000:3.0:1789635314.618173:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411484160 00000100:00100000:3.0:1789635314.618199:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 151 00000100:00100000:3.0:1789635314.618209:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2399:x1876568411484032:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635314.618364:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2399:x1876568411484032:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 156us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635314.618380:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 151 00000100:00100000:3.0:1789635314.618399:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 152 00000100:00100000:3.0:1789635314.618405:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411484160:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635314.618431:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411484160:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 27us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635314.618436:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 152 00000100:00080000:0.0:1789635314.618844:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789635314.618848:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635314.618964:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411483904 00000100:00100000:2.0:1789635314.618971:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411483904 00000100:00100000:2.0:1789635314.619108:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 295 00000100:00100000:2.0:1789635314.619117:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:2399:x1876568411483904:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635314.619159:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:2399:x1876568411483904:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 44us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635314.619166:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 295 00010000:00010000:0.0:1789635314.853776:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789635315.368975:0:11994:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 04:55:14 (1789635314) === 00000100:00100000:0.0:1789635315.823671:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635315.823746:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411484288 00000100:00100000:3.0:1789635315.823756:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411484288 00000100:00100000:3.0:1789635315.823812:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 296 00000100:00100000:3.0:1789635315.823830:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:8721:x1876568411484288:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789635315.823848:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635315.823864:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d054139c200/0xb0c3a59caa40eff3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73eee expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635315.823891:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d054139c200/0xb0c3a59caa40eff3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73eee expref: 11 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635315.823900:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d054139c200/0xb0c3a59caa40eff3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73eee expref: 11 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635315.823908:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d054139c200, rc 0) 00000100:00100000:3.0:1789635315.823956:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+11:8721:x1876568411484288:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 136us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635315.823962:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 296 00000100:00100000:0.0:1789635315.832364:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635315.832579:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411484416 00000100:00100000:2.0:1789635315.832589:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411484416 00000100:00100000:2.0:1789635315.832756:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 297 00000100:00100000:2.0:1789635315.832766:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+11:8721:x1876568411484416:12345-192.168.203.20@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789635315.835757:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+11:8721:x1876568411484416:12345-192.168.203.20@tcp:501:mount.lustre.0 Request processed in 2983us (3392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635315.835770:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 297 00000100:00100000:2.0:1789635315.845310:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635315.845515:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411484544 00000100:00100000:0.0:1789635315.845525:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411484544 00000100:00100000:0.0:1789635315.845575:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 298 00000100:00100000:0.0:1789635315.845586:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+11:8721:x1876568411484544:12345-192.168.203.20@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789635315.845761:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+11:8721:x1876568411484544:12345-192.168.203.20@tcp:503:mount.lustre.0 Request processed in 176us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635315.845768:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 298 00000100:00100000:1.0:1789635315.865153:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635315.865529:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411484672 00000100:00100000:3.0:1789635315.865543:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411484672 00000100:00100000:3.0:1789635315.865790:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 299 00000100:00100000:3.0:1789635315.865804:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+11:8725:x1876568411484672:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789635315.866006:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+11:8725:x1876568411484672:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 204us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635315.866014:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 299 00010000:00010000:3.0:1789635315.877080:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635315.890809:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635315.892736:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411484800 00000100:00100000:2.0:1789635315.892755:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411484800 00000100:00100000:2.0:1789635315.892849:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 300 00000100:00100000:2.0:1789635315.892861:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+11:8725:x1876568411484800:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789635315.893083:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+11:8725:x1876568411484800:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 223us (2287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635315.893092:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 300 00000100:00100000:2.0:1789635315.900982:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635315.901541:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411484928 00000100:00100000:3.0:1789635315.901554:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411484928 00000100:00100000:3.0:1789635315.901644:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 301 00000100:00100000:3.0:1789635315.901656:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+11:8725:x1876568411484928:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789635315.901857:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+11:8725:x1876568411484928:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 203us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635315.901865:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 301 00000100:00100000:1.0:1789635315.905063:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635315.905171:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411485056 00000100:00100000:0.0:1789635315.905194:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411485056 00000100:00100000:0.0:1789635315.905260:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 302 00000100:00100000:0.0:1789635315.905283:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+11:8721:x1876568411485056:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789635315.905305:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635315.905330:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056f6e8000/0xb0c3a59caa40effa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73f1f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635315.905485:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056f6e8000/0xb0c3a59caa40effa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f1f expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635315.905521:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056f6e8000/0xb0c3a59caa40effa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f1f expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635315.905532:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056f6e8000, rc 0) 00000100:00100000:0.0:1789635315.905770:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+12:8721:x1876568411485056:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 490us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635315.905778:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 302 00000100:00100000:0.0:1789635315.914824:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635315.915518:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411485184 00000100:00100000:2.0:1789635315.915532:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411485184 00000100:00100000:2.0:1789635315.915654:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 303 00000100:00100000:2.0:1789635315.915667:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+12:8721:x1876568411485184:12345-192.168.203.20@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789635315.915702:0:6509:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789635315.915733:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789635315.915737:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789635315.915741:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789635315.915744:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789635315.915747:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1789635315.921156:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+12:8721:x1876568411485184:12345-192.168.203.20@tcp:256:mount.lustre.0 Request processed in 5476us (6331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635315.921186:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 303 00000100:00100000:1.0:1789635315.925323:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635315.925455:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411485312 00000100:00100000:3.0:1789635315.925464:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411485312 00000100:00100000:0.0:1789635315.925846:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 304 00000100:00100000:0.0:1789635315.925859:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+12:8721:x1876568411485312:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789635315.925876:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635315.925893:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056f6e8800/0xb0c3a59caa40f001 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73f26 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635315.925922:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056f6e8800/0xb0c3a59caa40f001 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f26 expref: 13 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635315.925934:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056f6e8800/0xb0c3a59caa40f001 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f26 expref: 13 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635315.925943:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056f6e8800, rc 0) 00000100:00100000:0.0:1789635315.926006:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:8721:x1876568411485312:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 151us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635315.926012:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 304 00000100:00100000:1.0:1789635315.928429:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635315.928524:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411485440 00000100:00100000:3.0:1789635315.928536:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411485440 00000100:00100000:3.0:1789635315.928635:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 305 00000100:00100000:3.0:1789635315.928647:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:8721:x1876568411485440:12345-192.168.203.20@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789635315.929015:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:8721:x1876568411485440:12345-192.168.203.20@tcp:501:mount.lustre.0 Request processed in 368us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635315.929025:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 305 00000100:00100000:2.0:1789635315.943138:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635315.946745:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411485568 00000100:00100000:3.0:1789635315.946768:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411485568 00000100:00100000:3.0:1789635315.946882:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 306 00000100:00100000:3.0:1789635315.946896:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:8721:x1876568411485568:12345-192.168.203.20@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789635315.947110:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:8721:x1876568411485568:12345-192.168.203.20@tcp:503:mount.lustre.0 Request processed in 217us (3986us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635315.947119:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 306 00000100:00100000:1.0:1789635315.958526:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635315.958656:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411485696 00000100:00100000:0.0:1789635315.958670:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411485696 00000100:00100000:0.0:1789635315.958762:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 307 00000100:00100000:0.0:1789635315.958774:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:8730:x1876568411485696:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789635315.958981:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:8730:x1876568411485696:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 208us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635315.958989:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 307 00000100:00100000:1.0:1789635315.970832:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635315.971039:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411485824 00000100:00100000:2.0:1789635315.971052:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411485824 00000100:00100000:2.0:1789635315.971125:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 308 00000100:00100000:2.0:1789635315.971137:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:8730:x1876568411485824:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789635315.971372:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:8730:x1876568411485824:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 236us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635315.971381:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 308 00000100:00100000:2.0:1789635315.979066:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635315.979122:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635315.979250:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411486720 00000100:00100000:0.0:1789635315.979263:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411486720 00000100:00100000:0.0:1789635315.979364:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411486592 00000100:00100000:0.0:1789635315.979368:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411486592 00000100:00100000:0.0:1789635315.979743:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 153 00000100:00100000:0.0:1789635315.979757:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2397:x1876568411486720:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635315.979867:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2397:x1876568411486720:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 114us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635315.979875:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 153 00000100:00100000:0.0:1789635315.979896:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 154 00000100:00100000:0.0:1789635315.979903:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2397:x1876568411486592:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635315.979927:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2397:x1876568411486592:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 25us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635315.979933:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 154 00000100:00100000:2.0:1789635315.988955:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635315.989022:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635315.989099:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411485952 00000100:00100000:1.0:1789635315.989111:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411485952 00000100:00100000:1.0:1789635315.989190:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411486208 00000100:00100000:1.0:1789635315.989194:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411486208 00000100:00100000:1.0:1789635315.989217:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:1.0:1789635315.989241:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2395:x1876568411485952:12345-192.168.203.20@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789635315.989288:0:6515:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 407040af-7178-437e-ab3a-40e7ebc2aa86@192.168.203.20@tcp t0 exp 0000000000000000 cur 334 last 0 00000020:00000080:1.0:1789635315.989345:0:6515:0:(genops.c:1384:class_connect()) connect: client 407040af-7178-437e-ab3a-40e7ebc2aa86, cookie 0xb0c3a59caa40f008 00000004:00100000:1.0:1789635315.989381:0:6515:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789635315.989554:0:6515:0:(import.c:65:import_set_state_nolock()) ffff8d0446d9a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789635315.989574:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:0.0:1789635315.989583:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2395:x1876568411486208:12345-192.168.203.20@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789635315.989623:0:6516:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 407040af-7178-437e-ab3a-40e7ebc2aa86@192.168.203.20@tcp t0 exp 0000000000000000 cur 334 last 0 00000020:00000080:0.0:1789635315.989660:0:6516:0:(genops.c:1384:class_connect()) connect: client 407040af-7178-437e-ab3a-40e7ebc2aa86, cookie 0xb0c3a59caa40f00f 00000004:00100000:0.0:1789635315.989677:0:6516:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789635315.989684:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:407040af-7178-437e-ab3a-40e7ebc2aa86+6:2395:x1876568411485952:12345-192.168.203.20@tcp:38:mount.lustre.0 Request processed in 442us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635315.989695:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00080000:0.0:1789635315.989764:0:6516:0:(import.c:65:import_set_state_nolock()) ffff8d0447653000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789635315.989794:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:407040af-7178-437e-ab3a-40e7ebc2aa86+6:2395:x1876568411486208:12345-192.168.203.20@tcp:38:mount.lustre.0 Request processed in 210us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635315.989878:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:1.0:1789635315.993219:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635315.994151:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411486464 00000100:00100000:3.0:1789635315.994167:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411486464 00000100:00100000:3.0:1789635315.994295:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:3.0:1789635315.994308:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:407040af-7178-437e-ab3a-40e7ebc2aa86+6:8721:x1876568411486464:12345-192.168.203.20@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789635315.994360:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00080000:0.0:1789635315.994382:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635315.994484:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:407040af-7178-437e-ab3a-40e7ebc2aa86+6:8721:x1876568411486464:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 179us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635315.994493:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:1.0:1789635315.999069:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635315.999156:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411486080 00000100:00100000:0.0:1789635315.999169:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411486080 00000100:00100000:1.0:1789635315.999196:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635315.999349:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411486848 00000100:00100000:0.0:1789635315.999353:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411486848 00000100:00100000:2.0:1789635316.000047:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:2.0:1789635316.000066:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:407040af-7178-437e-ab3a-40e7ebc2aa86+7:0:x1876568411486080:12345-192.168.203.20@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789635316.000115:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789635316.000210:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:407040af-7178-437e-ab3a-40e7ebc2aa86+7:0:x1876568411486080:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 150us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635316.000968:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:2.0:1789635316.001021:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:0.0:1789635316.008101:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:407040af-7178-437e-ab3a-40e7ebc2aa86+6:8721:x1876568411486848:12345-192.168.203.20@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789635316.009648:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:407040af-7178-437e-ab3a-40e7ebc2aa86+6:8721:x1876568411486848:12345-192.168.203.20@tcp:40:mount.lustre.0 Request processed in 1661us (10441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635316.009662:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:1.0:1789635316.011817:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635316.012017:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411486336 00000100:00100000:3.0:1789635316.012033:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411486336 00000100:00100000:3.0:1789635316.012116:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:3.0:1789635316.012130:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:407040af-7178-437e-ab3a-40e7ebc2aa86+6:0:x1876568411486336:12345-192.168.203.20@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789635316.012181:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789635316.012320:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:407040af-7178-437e-ab3a-40e7ebc2aa86+6:0:x1876568411486336:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 192us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635316.012336:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00080000:0.0:1789635316.013117:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789635316.030423:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635316.030477:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635316.030517:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635316.030690:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411486976 00000100:00100000:0.0:1789635316.030703:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411486976 00000100:00100000:0.0:1789635316.030753:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411487104 00000100:00100000:0.0:1789635316.030756:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411487104 00000100:00100000:0.0:1789635316.030780:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:0.0:1789635316.030791:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2395:x1876568411486976:12345-192.168.203.20@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789635316.030846:0:8432:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 407040af-7178-437e-ab3a-40e7ebc2aa86@192.168.203.20@tcp t0 exp 0000000000000000 cur 334 last 0 00000020:00000080:0.0:1789635316.030893:0:8432:0:(genops.c:1384:class_connect()) connect: client 407040af-7178-437e-ab3a-40e7ebc2aa86, cookie 0xb0c3a59caa40f016 00002000:00100000:0.0:1789635316.030909:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 407040af-7178-437e-ab3a-40e7ebc2aa86/ffff8d0447653800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789635316.030933:0:8432:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789635316.031033:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789635316.031081:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8d0447654000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789635316.031165:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:407040af-7178-437e-ab3a-40e7ebc2aa86+6:2395:x1876568411486976:12345-192.168.203.20@tcp:8:mount.lustre.0 Request processed in 373us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635316.031203:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:0.0:1789635316.031226:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:0.0:1789635316.031231:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2395:x1876568411487104:12345-192.168.203.20@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789635316.031251:0:8432:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 407040af-7178-437e-ab3a-40e7ebc2aa86@192.168.203.20@tcp t0 exp 0000000000000000 cur 334 last 0 00000020:00000080:0.0:1789635316.031286:0:8432:0:(genops.c:1384:class_connect()) connect: client 407040af-7178-437e-ab3a-40e7ebc2aa86, cookie 0xb0c3a59caa40f01d 00002000:00100000:0.0:1789635316.031293:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 407040af-7178-437e-ab3a-40e7ebc2aa86/ffff8d0447656000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789635316.031306:0:8432:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789635316.031348:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789635316.031364:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8d0447657800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789635316.031400:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:407040af-7178-437e-ab3a-40e7ebc2aa86+6:2395:x1876568411487104:12345-192.168.203.20@tcp:8:mount.lustre.0 Request processed in 167us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635316.031408:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:1.0:1789635316.031642:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411487232 00000100:00100000:1.0:1789635316.031648:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411487232 00000100:00100000:1.0:1789635316.031690:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:1.0:1789635316.031698:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:407040af-7178-437e-ab3a-40e7ebc2aa86+6:8721:x1876568411487232:12345-192.168.203.20@tcp:900:mount.lustre.0 00000100:00100000:1.0:1789635316.031739:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:407040af-7178-437e-ab3a-40e7ebc2aa86+6:8721:x1876568411487232:12345-192.168.203.20@tcp:900:mount.lustre.0 Request processed in 42us (1331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635316.031745:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:1.0:1789635316.038750:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635316.038875:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411487360 00000100:00100000:0.0:1789635316.038888:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411487360 00000100:00100000:0.0:1789635316.038962:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:0.0:1789635316.038974:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:407040af-7178-437e-ab3a-40e7ebc2aa86+6:8721:x1876568411487360:12345-192.168.203.20@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789635316.039094:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789635316.039217:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:407040af-7178-437e-ab3a-40e7ebc2aa86+6:8721:x1876568411487360:12345-192.168.203.20@tcp:33:mount.lustre.0 Request processed in 245us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635316.039225:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:3.0:1789635316.133142:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789635316.133172:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427293824:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789635316.133291:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635316.134738:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427293952:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789635316.134810:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635316.134929:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427293824 00000100:00100000:1.0:1789635316.134940:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427293824 00000100:00100000:1.0:1789635316.135002:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427293952 00000100:00100000:1.0:1789635316.135005:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427293952 00000100:00100000:1.0:1789635316.135024:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789635316.135035:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427293824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789635316.135088:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789635316.135145:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427293824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (1855us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635316.135153:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789635316.135173:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789635316.135179:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427293952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789635316.135191:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789635316.135217:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427293952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 38us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635316.135223:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789635316.135551:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427293952:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789635316.135569:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427293824:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789635316.900046:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635317.925668:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635318.179972:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447659500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427294080:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789635318.180039:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635318.180166:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427294080 00000100:00100000:0.0:1789635318.180174:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427294080 00000100:00100000:0.0:1789635318.180244:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1789635318.180351:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789635318.180382:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427294080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789635318.180423:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635318.180478:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427294080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 225us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635318.180486:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:2.0:1789635318.180566:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447659500 x1876568427294080/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635318.180585:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447659500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427294080:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789635318.180891:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044765aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876568427294336:0@lo:400:kworker.0 00000100:00100000:0.0:1789635318.180919:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635318.180935:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447659500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1876568427294848:0@lo:400:kworker.0 00000100:00100000:0.0:1789635318.180951:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635318.180969:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447658e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1876568427295360:0@lo:400:kworker.0 00000100:00100000:0.0:1789635318.180986:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635318.181008:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789635318.181014:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044765a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427294464:0@lo:400:kworker.0 00000100:00100000:0.0:1789635318.181037:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635318.181054:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044765ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427294976:0@lo:400:kworker.0 00000100:00100000:0.0:1789635318.181073:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635318.181088:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1876568427295488:0@lo:400:kworker.0 00000100:00100000:0.0:1789635318.181105:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635318.181126:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427294336 00000100:00100000:0.0:1789635318.181130:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427294336 00000100:00100000:0.0:1789635318.181151:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427294848 00000100:00100000:0.0:1789635318.181154:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427294848 00000100:00100000:0.0:1789635318.181170:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427295360 00000100:00100000:0.0:1789635318.181173:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427295360 00000100:00100000:0.0:1789635318.181185:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427294976 00000100:00100000:0.0:1789635318.181188:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427294976 00000100:00100000:3.0:1789635318.181328:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427294208:0@lo:400:kworker.0 00000100:00100000:3.0:1789635318.181361:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635318.181385:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876568427294720:0@lo:400:kworker.0 00000100:00100000:3.0:1789635318.181404:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635318.181412:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427295232:0@lo:400:kworker.0 00000100:00100000:3.0:1789635318.181429:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635318.181445:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789635318.181450:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427294592:0@lo:400:kworker.0 00000100:00100000:3.0:1789635318.181467:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635318.181480:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044765b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427295104:0@lo:400:kworker.0 00000100:00100000:3.0:1789635318.181496:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635318.181509:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427295616:0@lo:400:kworker.0 00000100:00100000:3.0:1789635318.181537:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635318.181562:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427295488 00000100:00100000:3.0:1789635318.181565:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427295488 00000100:00100000:2.0:1789635318.181636:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427294720 00000100:00100000:2.0:1789635318.181639:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427294720 00000100:00100000:2.0:1789635318.181660:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789635318.181667:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876568427294336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635318.181709:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876568427294336:12345-0@lo:400:kworker.0 Request processed in 43us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635318.181715:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789635318.181728:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789635318.181733:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876568427294848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635318.181760:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876568427294848:12345-0@lo:400:kworker.0 Request processed in 27us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635318.181766:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789635318.181776:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789635318.181782:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876568427295360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635318.181817:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876568427295360:12345-0@lo:400:kworker.0 Request processed in 35us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635318.181823:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789635318.181834:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789635318.181840:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876568427294720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635318.181864:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876568427294720:12345-0@lo:400:kworker.0 Request processed in 25us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635318.181870:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789635318.181942:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789635318.181948:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044791b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427294976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635318.181996:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044791b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427294976:12345-0@lo:400:kworker.0 Request processed in 48us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635318.182002:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789635318.182025:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427294464 00000100:00100000:0.0:1789635318.182029:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427294464 00000100:00100000:0.0:1789635318.182049:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427294592 00000100:00100000:0.0:1789635318.182051:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427294592 00000100:00100000:0.0:1789635318.182077:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789635318.182083:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427294464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635318.182113:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427294464:12345-0@lo:400:kworker.0 Request processed in 31us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635318.182119:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789635318.182128:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789635318.182134:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427294592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635318.182158:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427294592:12345-0@lo:400:kworker.0 Request processed in 24us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635318.182163:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789635318.182440:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427295232 00000100:00100000:1.0:1789635318.182444:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427295232 00000100:00100000:3.0:1789635318.186418:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789635318.186431:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044791aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876568427295488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635318.186746:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044791aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876568427295488:12345-0@lo:400:kworker.0 Request processed in 93us (5414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635318.186769:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:2.0:1789635318.186922:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789635318.186928:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635318.186979:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044765a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427294464:0@lo:400:kworker.0 00010000:00080000:2.0:1789635318.186995:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d044765ad80 x1876568427294976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635318.187005:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044765ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427294976:0@lo:400:kworker.0 00010000:00080000:2.0:1789635318.187015:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447658a80 x1876568427295488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635318.187022:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1876568427295488:0@lo:400:kworker.0 00000100:00100000:2.0:1789635318.187032:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044765aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876568427294336:0@lo:400:kworker.0 00000100:00100000:2.0:1789635318.187042:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447659500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1876568427294848:0@lo:400:kworker.0 00000100:00100000:2.0:1789635318.187051:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447658e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1876568427295360:0@lo:400:kworker.0 00000100:00100000:2.0:1789635318.187183:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789635318.187195:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427295744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789635318.187233:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635318.188690:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427294208 00000100:00100000:2.0:1789635318.188698:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427294208 00000100:00100000:2.0:1789635318.188773:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1789635318.188795:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3641:x1876568427294208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635318.188914:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3641:x1876568427294208:12345-0@lo:400:kworker.0 Request processed in 108us (7537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635318.188921:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1789635318.188975:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427295104 00000100:00100000:2.0:1789635318.188980:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427295104 00000100:00100000:2.0:1789635318.189011:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427295616 00000100:00100000:2.0:1789635318.189014:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427295616 00000100:00100000:2.0:1789635318.189029:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789635318.189035:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427295104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635318.189127:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427295104:12345-0@lo:400:kworker.0 Request processed in 91us (7629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635318.189148:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789635318.189171:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789635318.189178:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427295616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635318.189234:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427295616:12345-0@lo:400:kworker.0 Request processed in 56us (7695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635318.189251:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789635318.189330:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427294592:0@lo:400:kworker.0 00010000:00080000:2.0:1789635318.189361:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d044765b800 x1876568427295104/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635318.189382:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044765b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427295104:0@lo:400:kworker.0 00010000:00080000:2.0:1789635318.189407:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04467b9f80 x1876568427295616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635318.189435:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427295616:0@lo:400:kworker.0 00000100:00100000:2.0:1789635318.189459:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427294208:0@lo:400:kworker.0 00000100:00100000:2.0:1789635318.189471:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876568427294720:0@lo:400:kworker.0 00000100:00080000:2.0:1789635318.189498:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789635318.189501:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789635318.190302:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427295744 00000100:00100000:3.0:1789635318.190308:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427295744 00000100:00100000:3.0:1789635318.190346:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789635318.190355:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427295744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789635318.190372:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635318.190417:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427295744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (3182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635318.190423:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:3.0:1789635318.190453:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05759d2680 x1876568427295744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635318.190469:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427295744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635318.191265:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789635318.191275:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427295232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635318.191328:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427295232:12345-0@lo:400:kworker.0 Request processed in 55us (9897us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635318.191335:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1789635318.191336:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789635318.191415:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447659880 x1876568427295232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635318.191446:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427295232:0@lo:400:kworker.0 00010000:00010000:3.0:1789635318.947918:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635319.204130:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427295872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789635319.204195:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635319.204363:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427295872 00000100:00100000:2.0:1789635319.204371:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427295872 00000100:00100000:2.0:1789635319.204451:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789635319.204461:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427295872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789635319.204504:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635319.204547:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427295872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635319.204554:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:2.0:1789635319.204783:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04477ab480 x1876568427295872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635335 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635319.204801:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427295872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635319.715929:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427296000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789635319.715992:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635319.716425:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427296000 00000100:00100000:0.0:1789635319.716433:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427296000 00000100:00100000:0.0:1789635319.716538:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789635319.716548:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427296000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789635319.716571:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635319.716648:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427296000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635319.716655:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:3.0:1789635319.717024:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04477aa300 x1876568427296000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635335 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635319.717043:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427296000:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789635319.974097:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635320.996196:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635321.252726:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447918380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427296128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789635321.252826:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635321.252929:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427296128 00000100:00100000:0.0:1789635321.252940:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427296128 00000100:00100000:0.0:1789635321.253023:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789635321.253034:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427296128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789635321.253077:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789635321.253130:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427296128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635321.253138:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789635321.253192:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447918380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427296128:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789635321.253527:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427296256:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789635321.253565:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635321.253736:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427296256 00000100:00100000:2.0:1789635321.253742:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427296256 00000100:00100000:2.0:1789635321.253780:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789635321.253788:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427296256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789635321.253820:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789635321.253860:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427296256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635321.253867:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789635321.256926:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427296256:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1789635321.262533:0:7446:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 407040af-7178-437e-ab3a-40e7ebc2aa86 00000001:00100000:1.0:1789635321.266039:0:6493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 407040af-7178-437e-ab3a-40e7ebc2aa86 00000100:00100000:1.0:1789635321.275263:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635321.275311:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635321.275343:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635321.275387:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635321.275405:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635321.275447:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411487488 00000100:00100000:3.0:1789635321.275460:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411487488 00000100:00100000:3.0:1789635321.275527:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 310 00000100:00100000:3.0:1789635321.275546:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054645ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2396:x1876568411487488:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635321.275661:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054645ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2396:x1876568411487488:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 117us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635321.275669:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 310 00000100:00100000:1.0:1789635321.280251:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635321.282701:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411487616 00000100:00100000:2.0:1789635321.282724:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411487616 00000100:00100000:2.0:1789635321.283042:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411488128 00000100:00100000:2.0:1789635321.283048:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411488128 00000100:00100000:2.0:1789635321.283142:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00100000:2.0:1789635321.283156:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:407040af-7178-437e-ab3a-40e7ebc2aa86+6:2396:x1876568411488128:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635321.283618:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:407040af-7178-437e-ab3a-40e7ebc2aa86+6:2396:x1876568411488128:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 441us (3367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635321.283630:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00080000:2.0:1789635321.283661:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789635321.283737:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635321.284631:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411488256 00000100:00100000:2.0:1789635321.284642:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411488256 00000100:00100000:2.0:1789635321.284705:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 64 00000100:00100000:2.0:1789635321.284716:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:407040af-7178-437e-ab3a-40e7ebc2aa86+6:2396:x1876568411488256:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635321.284780:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:407040af-7178-437e-ab3a-40e7ebc2aa86+6:2396:x1876568411488256:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 68us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635321.284788:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 64 00000100:00080000:2.0:1789635321.284904:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789635321.284963:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635321.284998:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411487744 00000100:00100000:2.0:1789635321.285003:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411487744 00000100:00100000:2.0:1789635321.285026:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411487872 00000100:00100000:2.0:1789635321.285047:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411487872 00000100:00100000:2.0:1789635321.285067:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411488000 00000100:00100000:2.0:1789635321.285069:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411488000 00000100:00100000:2.0:1789635321.285084:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 161 00000100:00100000:2.0:1789635321.285092:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2396:x1876568411487616:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635321.285126:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2396:x1876568411487616:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 35us (9815us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635321.285132:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 161 00000100:00100000:2.0:1789635321.285143:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 162 00000100:00100000:2.0:1789635321.285149:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2396:x1876568411487744:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635321.290857:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2396:x1876568411487744:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 25us (9830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635321.290895:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 162 00000100:00100000:2.0:1789635321.290953:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 163 00000100:00100000:2.0:1789635321.290972:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2396:x1876568411487872:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635321.291077:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2396:x1876568411487872:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 115us (15689us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635321.291084:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 163 00000100:00100000:2.0:1789635321.291096:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 164 00000100:00100000:2.0:1789635321.291105:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2396:x1876568411488000:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635321.291133:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2396:x1876568411488000:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 31us (15727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635321.291139:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 164 00000100:00080000:2.0:1789635321.291168:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789635321.292760:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:0.0:1789635321.477282:0:12188:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1789635322.020297:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789635322.287800:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 407040af-7178-437e-ab3a-40e7ebc2aa86 00000001:00100000:0.0:1789635322.288104:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 407040af-7178-437e-ab3a-40e7ebc2aa86 00010000:00010000:2.0:1789635323.049667:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635323.299903:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447918380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427296384:0@lo:400:kworker.0 00000100:00100000:0.0:1789635323.299968:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635323.300010:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876568427296896:0@lo:400:kworker.0 00000100:00100000:0.0:1789635323.300033:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635323.300049:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427297408:0@lo:400:kworker.0 00000100:00100000:0.0:1789635323.300068:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635323.300084:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575adb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427297920:0@lo:400:kworker.0 00000100:00100000:0.0:1789635323.300100:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635323.300122:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789635323.300127:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044791ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876568427296512:0@lo:400:kworker.0 00000100:00100000:0.0:1789635323.300144:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635323.300159:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1876568427297024:0@lo:400:kworker.0 00000100:00100000:0.0:1789635323.300211:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635323.300238:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1876568427297536:0@lo:400:kworker.0 00000100:00100000:0.0:1789635323.300257:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635323.300284:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427296640:0@lo:400:kworker.0 00000100:00100000:0.0:1789635323.300306:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635323.300421:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1876568427297152:0@lo:400:kworker.0 00000100:00100000:0.0:1789635323.300443:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635323.300462:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1876568427297664:0@lo:400:kworker.0 00000100:00100000:0.0:1789635323.300480:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635323.300492:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789635323.300497:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427296768:0@lo:400:kworker.0 00000100:00100000:0.0:1789635323.300516:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635323.300532:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427297280:0@lo:400:kworker.0 00000100:00100000:0.0:1789635323.300549:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635323.300564:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427297792:0@lo:400:kworker.0 00000100:00100000:0.0:1789635323.300579:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635323.300641:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427296896 00000100:00100000:1.0:1789635323.300649:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427296896 00000100:00100000:1.0:1789635323.300695:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427296512 00000100:00100000:1.0:1789635323.300698:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427296512 00000100:00100000:1.0:1789635323.300710:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427297024 00000100:00100000:1.0:1789635323.300712:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427297024 00000100:00100000:1.0:1789635323.300735:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427297536 00000100:00100000:0.0:1789635323.300735:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427296640 00000100:00100000:1.0:1789635323.300737:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427297536 00000100:00100000:0.0:1789635323.300738:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427296640 00000100:00100000:1.0:1789635323.300750:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427297152 00000100:00100000:1.0:1789635323.300752:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427297152 00000100:00100000:0.0:1789635323.300760:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427296768 00000100:00100000:0.0:1789635323.300762:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427296768 00000100:00100000:1.0:1789635323.300764:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427297664 00000100:00100000:1.0:1789635323.300765:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427297664 00000100:00100000:0.0:1789635323.300776:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789635323.300777:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789635323.300784:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876568427296896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635323.300784:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05446f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427296640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635323.300874:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05446f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427296640:12345-0@lo:400:kworker.0 Request processed in 46us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635323.300882:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789635323.300905:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789635323.300910:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05446f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427296768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635323.300938:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05446f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427296768:12345-0@lo:400:kworker.0 Request processed in 28us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635323.300943:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789635323.309064:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876568427296896:12345-0@lo:400:kworker.0 Request processed in 8271us (9020us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635323.309078:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789635323.309114:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789635323.309129:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575adb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876568427296512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635323.309199:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575adb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876568427296512:12345-0@lo:400:kworker.0 Request processed in 77us (9052us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635323.309205:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789635323.309231:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789635323.309239:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05446f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876568427297024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635323.309269:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05446f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876568427297024:12345-0@lo:400:kworker.0 Request processed in 32us (9057us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635323.309721:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789635323.309738:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789635323.309745:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05446f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876568427297536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635323.309776:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05446f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876568427297536:12345-0@lo:400:kworker.0 Request processed in 33us (9519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635323.309782:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789635323.309795:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789635323.309801:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05446f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876568427297152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635323.309830:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05446f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876568427297152:12345-0@lo:400:kworker.0 Request processed in 29us (9385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635323.309835:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789635323.309845:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789635323.309851:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05446f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876568427297664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635323.309879:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05446f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876568427297664:12345-0@lo:400:kworker.0 Request processed in 28us (9398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635323.309885:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789635323.309914:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427297408 00000100:00100000:1.0:1789635323.309921:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427297408 00000100:00100000:1.0:1789635323.309950:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427297920 00000100:00100000:1.0:1789635323.309953:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427297920 00000100:00100000:1.0:1789635323.309966:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427297280 00000100:00100000:1.0:1789635323.309969:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427297280 00000100:00100000:1.0:1789635323.309979:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427297792 00000100:00100000:1.0:1789635323.309981:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427297792 00000100:00100000:1.0:1789635323.309994:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789635323.309999:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427297408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635323.310036:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427297408:12345-0@lo:400:kworker.0 Request processed in 37us (9966us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635323.310042:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789635323.310053:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789635323.310059:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ada300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427297920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635323.310084:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ada300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427297920:12345-0@lo:400:kworker.0 Request processed in 26us (9983us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635323.310090:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789635323.310099:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789635323.310105:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05446f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427297280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635323.310129:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05446f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427297280:12345-0@lo:400:kworker.0 Request processed in 25us (9578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635323.310134:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789635323.310144:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789635323.310150:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05446f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427297792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635323.310178:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05446f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427297792:12345-0@lo:400:kworker.0 Request processed in 29us (9598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635323.310184:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789635323.310212:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427296384 00000100:00100000:1.0:1789635323.310225:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427296384 00000100:00100000:1.0:1789635323.310580:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1789635323.310588:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546459850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3642:x1876568427296384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635323.310641:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546459850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3642:x1876568427296384:12345-0@lo:400:kworker.0 Request processed in 55us (10674us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635323.310647:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1789635323.315741:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427298048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789635323.315808:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635323.315864:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427298048 00000100:00100000:2.0:1789635323.315871:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427298048 00000100:00100000:0.0:1789635323.315876:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044791ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876568427296512:0@lo:400:kworker.0 00000100:00100000:0.0:1789635323.315889:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1876568427297024:0@lo:400:kworker.0 00000100:00100000:0.0:1789635323.315899:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1876568427297536:0@lo:400:kworker.0 00000100:00100000:0.0:1789635323.315909:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447918380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427296384:0@lo:400:kworker.0 00000100:00100000:2.0:1789635323.315913:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789635323.315919:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876568427296896:0@lo:400:kworker.0 00000100:00100000:2.0:1789635323.315921:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447659f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427298048:12345-0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789635323.315931:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0575ad9c00 x1876568427297408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635323.315941:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427297408:0@lo:400:kworker.0 00002000:00000024:2.0:1789635323.315947:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:0.0:1789635323.315949:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0575adb800 x1876568427297920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635323.315956:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575adb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427297920:0@lo:400:kworker.0 00000100:00100000:2.0:1789635323.315982:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447659f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427298048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635323.315989:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:2.0:1789635323.316014:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447659880 x1876568427298048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635323.316027:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427298048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789635323.316031:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789635323.316038:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05446f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427298176:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789635323.316063:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635323.316105:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427296768:0@lo:400:kworker.0 00010000:00080000:0.0:1789635323.316117:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04459dfb80 x1876568427297280/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635323.316145:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427297280:0@lo:400:kworker.0 00010000:00080000:0.0:1789635323.316157:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0575ad8380 x1876568427297792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635323.316164:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427297792:0@lo:400:kworker.0 00000100:00100000:0.0:1789635323.316174:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427296640:0@lo:400:kworker.0 00010000:00080000:0.0:1789635323.316184:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04459dca80 x1876568427297152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635323.318462:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1876568427297152:0@lo:400:kworker.0 00010000:00080000:0.0:1789635323.318499:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0575ad8000 x1876568427297664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635323.318509:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1876568427297664:0@lo:400:kworker.0 00000100:00080000:0.0:1789635323.318575:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789635323.318581:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789635323.318583:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789635323.318586:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635323.318624:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427298176 00000100:00100000:0.0:1789635323.318631:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427298176 00000100:00100000:0.0:1789635323.319791:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789635323.319802:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05446f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427298176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789635323.319827:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635323.319895:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05446f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427298176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (3831us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635323.319902:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:0.0:1789635323.319954:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05446f6d80 x1876568427298176/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635323.319971:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05446f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427298176:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789635324.068026:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635324.323889:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789635324.323911:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427298304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635324.323986:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635324.324116:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427298304 00000100:00100000:2.0:1789635324.324124:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427298304 00000100:00100000:2.0:1789635324.324175:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789635324.324185:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427298304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789635324.324221:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635324.324265:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427298304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635324.324281:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:3.0:1789635324.324470:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447659880 x1876568427298304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635340 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635324.324486:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427298304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789635324.839821:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427298432:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789635324.839886:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635324.839949:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427298432 00000100:00100000:2.0:1789635324.839957:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427298432 00000100:00100000:2.0:1789635324.840009:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789635324.840019:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427298432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789635324.840039:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635324.840080:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427298432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635324.840087:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:2.0:1789635324.840127:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447658380 x1876568427298432/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635340 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635324.840145:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427298432:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789635325.094390:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635326.117210:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635326.372225:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789635326.372246:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427298560:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789635326.372327:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635326.375341:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427298560 00000100:00100000:1.0:1789635326.375355:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427298560 00000100:00100000:1.0:1789635326.375411:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789635326.375478:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427298560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789635326.375518:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789635326.375617:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427298560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 197us (3289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635326.375624:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789635326.375674:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427298560:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789635326.376553:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789635326.376567:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427298688:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789635326.376630:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635326.376709:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427298688 00000100:00100000:2.0:1789635326.376727:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427298688 00000100:00100000:2.0:1789635326.376764:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789635326.376772:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05446f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427298688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789635326.376794:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789635326.376867:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05446f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427298688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635326.376873:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789635326.377012:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427298688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789635326.401911:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635326.402000:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635326.410361:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635326.410403:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635326.410422:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635326.410465:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411489024 00000100:00100000:2.0:1789635326.410474:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411489024 00000100:00100000:2.0:1789635326.410529:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 69 00000100:00100000:2.0:1789635326.410538:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447828a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411489024:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635326.410620:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447828a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411489024:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 83us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635326.410640:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 69 00000100:00100000:2.0:1789635326.410662:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411488384 00000100:00100000:2.0:1789635326.410665:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411488384 00000100:00100000:2.0:1789635326.410692:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 312 00000100:00100000:2.0:1789635326.410699:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054645b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2398:x1876568411488384:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635326.410728:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054645b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2398:x1876568411488384:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 30us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635326.410735:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 312 00000100:00100000:1.0:1789635326.413615:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411488512 00000100:00100000:1.0:1789635326.413629:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411488512 00000100:00080000:1.0:1789635326.413970:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789635326.417921:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411488768 00000100:00100000:0.0:1789635326.417936:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411488768 00000100:00100000:0.0:1789635326.418023:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411488640 00000100:00100000:0.0:1789635326.418027:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411488640 00000100:00100000:0.0:1789635326.418064:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 171 00000100:00100000:0.0:1789635326.418075:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411488768:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635326.418152:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411488768:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 80us (16152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635326.418160:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 171 00000100:00100000:0.0:1789635326.418177:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 172 00000100:00100000:0.0:1789635326.418202:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411488640:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635326.418227:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411488640:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 44us (7804us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635326.418233:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 172 00000100:00100000:3.0:1789635326.418265:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635326.418274:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411488896 00000100:00100000:0.0:1789635326.418278:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411488896 00000100:00100000:0.0:1789635326.418294:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 173 00000100:00100000:0.0:1789635326.418300:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2398:x1876568411488512:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635326.418324:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2398:x1876568411488512:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 24us (16422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635326.418342:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 173 00000100:00100000:0.0:1789635326.418356:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 174 00000100:00100000:0.0:1789635326.418362:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411488896:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635326.418386:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411488896:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 25us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635326.418392:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 174 00000100:00100000:3.0:1789635326.419756:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00080000:2.0:1789635326.420803:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789635326.420809:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635326.421336:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411489152 00000100:00100000:0.0:1789635326.421346:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411489152 00000100:00100000:0.0:1789635326.421420:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 70 00000100:00080000:2.0:1789635326.421503:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789635326.421540:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447829c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411489152:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635326.421667:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447829c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411489152:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 130us (1916us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635326.421676:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 70 00010000:00010000:0.0:1789635327.142467:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635328.163906:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635328.419851:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789635328.419873:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447659500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427298944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789635328.419935:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635328.419959:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427298944 00000100:00100000:3.0:1789635328.419967:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427298944 00000100:00100000:3.0:1789635328.420018:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789635328.420037:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427298944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789635328.420064:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635328.420109:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427298944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635328.420129:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789635328.420243:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789635328.420254:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427298816:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789635328.420283:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635328.420325:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427298816 00000100:00100000:0.0:1789635328.420329:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427298816 00000100:00100000:0.0:1789635328.420352:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789635328.420357:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427298816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789635328.420367:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635328.420399:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427298816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635328.420406:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:0.0:1789635328.420461:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0575ad8000 x1876568427298816/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635328.420480:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427298816:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789635328.421030:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789635328.421057:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447659500 x1876568427298944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635328.421072:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447659500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427298944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789635328.421125:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427299072:0@lo:400:kworker.0 00000100:00100000:3.0:1789635328.421168:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635328.421904:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427299200:0@lo:400:kworker.0 00000100:00100000:3.0:1789635328.421970:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635328.421999:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427299200 00000100:00100000:3.0:1789635328.422005:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427299200 00000100:00100000:3.0:1789635328.422038:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789635328.422044:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427299200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635328.422086:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427299200:12345-0@lo:400:kworker.0 Request processed in 42us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635328.422093:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789635328.422241:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427299072 00000100:00100000:1.0:1789635328.422246:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427299072 00000100:00100000:1.0:1789635328.422277:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1789635328.422284:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546458850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3643:x1876568427299072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635328.422336:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546458850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3643:x1876568427299072:12345-0@lo:400:kworker.0 Request processed in 52us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635328.422343:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1789635328.423589:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427299200:0@lo:400:kworker.0 00000100:00100000:3.0:1789635328.423691:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427299072:0@lo:400:kworker.0 00000100:00100000:3.0:1789635328.423734:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427299328:0@lo:400:kworker.0 00000100:00100000:3.0:1789635328.423804:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635328.423866:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427299328 00000100:00100000:3.0:1789635328.423872:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427299328 00000100:00100000:3.0:1789635328.423906:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789635328.423913:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427299328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635328.423956:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427299328:12345-0@lo:400:kworker.0 Request processed in 43us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635328.423963:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789635328.423993:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427299328:0@lo:400:kworker.0 00000100:00100000:3.0:1789635328.424026:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427299456:0@lo:400:kworker.0 00000100:00100000:3.0:1789635328.424050:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635328.424077:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427299456 00000100:00100000:3.0:1789635328.424080:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427299456 00000100:00100000:3.0:1789635328.424102:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789635328.424109:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427299456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635328.424237:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427299456:12345-0@lo:400:kworker.0 Request processed in 128us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635328.424244:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789635328.424270:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427299456:0@lo:400:kworker.0 00000100:00100000:3.0:1789635328.424304:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876568427299584:0@lo:400:kworker.0 00000100:00100000:3.0:1789635328.424342:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635328.424389:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427299712:0@lo:400:kworker.0 00000100:00100000:3.0:1789635328.424411:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635328.424473:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1876568427299840:0@lo:400:kworker.0 00000100:00100000:3.0:1789635328.424496:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635328.424545:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427299968:0@lo:400:kworker.0 00000100:00100000:3.0:1789635328.424577:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635328.424723:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427299968 00000100:00100000:3.0:1789635328.424727:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427299968 00000100:00100000:3.0:1789635328.424762:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789635328.424769:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447adc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427299968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635328.424803:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447adc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427299968:12345-0@lo:400:kworker.0 Request processed in 34us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635328.424809:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1789635328.424823:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789635328.424839:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447addc00 x1876568427299968/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635328.424850:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427299968:0@lo:400:kworker.0 00000100:00100000:3.0:1789635328.424882:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427300096:0@lo:400:kworker.0 00000100:00100000:3.0:1789635328.424904:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635328.424927:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427300096 00000100:00100000:3.0:1789635328.424930:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427300096 00000100:00100000:3.0:1789635328.424953:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789635328.424958:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e015f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427300096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635328.424986:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e015f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427300096:12345-0@lo:400:kworker.0 Request processed in 28us (82us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635328.424992:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1789635328.425006:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789635328.425020:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447addc00 x1876568427300096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635328.425028:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427300096:0@lo:400:kworker.0 00000100:00100000:3.0:1789635328.425054:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427300224:0@lo:400:kworker.0 00000100:00100000:3.0:1789635328.425083:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635328.425108:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427299584 00000100:00100000:3.0:1789635328.425112:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427299584 00000100:00100000:3.0:1789635328.425132:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427299712 00000100:00100000:3.0:1789635328.425135:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427299712 00000100:00100000:3.0:1789635328.425280:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427299840 00000100:00100000:3.0:1789635328.425284:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427299840 00000100:00100000:3.0:1789635328.425295:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427300224 00000100:00100000:3.0:1789635328.425297:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427300224 00000100:00100000:3.0:1789635328.425309:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789635328.425315:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876568427299584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635328.425350:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876568427299584:12345-0@lo:400:kworker.0 Request processed in 35us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635328.425355:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789635328.425366:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789635328.425372:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427299712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635328.425401:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427299712:12345-0@lo:400:kworker.0 Request processed in 30us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635328.425407:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789635328.425418:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789635328.425424:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876568427299840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635328.425450:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876568427299840:12345-0@lo:400:kworker.0 Request processed in 27us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635328.425455:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789635328.425465:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789635328.425471:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e017800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427300224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635328.425493:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e017800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427300224:12345-0@lo:400:kworker.0 Request processed in 23us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635328.425503:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:3.0:1789635328.425520:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789635328.425523:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789635328.425538:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447adf480 x1876568427299840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635328.425547:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1876568427299840:0@lo:400:kworker.0 00000100:00100000:3.0:1789635328.425566:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876568427299584:0@lo:400:kworker.0 00000100:00100000:3.0:1789635328.425582:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427300224:0@lo:400:kworker.0 00000100:00100000:3.0:1789635328.425590:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427299712:0@lo:400:kworker.0 00000100:00100000:3.0:1789635328.425803:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1876568427300352:0@lo:400:kworker.0 00000100:00100000:3.0:1789635328.425839:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635328.425862:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427300352 00000100:00100000:3.0:1789635328.425866:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427300352 00000100:00100000:3.0:1789635328.425889:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789635328.425895:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e016d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876568427300352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635328.425925:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e016d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876568427300352:12345-0@lo:400:kworker.0 Request processed in 30us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635328.425930:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:3.0:1789635328.425944:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789635328.425959:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d056e014380 x1876568427300352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635328.425968:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1876568427300352:0@lo:400:kworker.0 00010000:00010000:3.0:1789635329.187829:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635329.448404:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427300480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635329.448472:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635329.451204:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427300480 00000100:00100000:0.0:1789635329.451217:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427300480 00000100:00100000:0.0:1789635329.451341:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789635329.451353:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e014380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427300480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789635329.451385:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635329.451472:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e014380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427300480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (2999us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635329.451479:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:1.0:1789635329.451558:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447658a80 x1876568427300480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635345 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635329.451578:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427300480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789635329.955841:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044765ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427300608:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789635329.955909:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635329.957084:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427300608 00000100:00100000:3.0:1789635329.957093:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427300608 00000100:00100000:3.0:1789635329.957192:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789635329.957202:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427300608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789635329.957225:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635329.957280:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427300608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (1370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635329.958108:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:1.0:1789635329.958188:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d044765ad80 x1876568427300608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635345 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635329.958231:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044765ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427300608:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789635330.219230:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789635330.930556:0:12503:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789635330.930808:0:12503:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789635331.235960:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635331.491962:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044765a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427300736:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789635331.492054:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635331.492576:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427300736 00000100:00100000:2.0:1789635331.492587:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427300736 00000100:00100000:3.0:1789635331.492921:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789635331.492934:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e017b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427300736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789635331.492978:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789635331.495326:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e017b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427300736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2388us (3265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635331.495339:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789635331.496483:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044765a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427300736:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789635331.507111:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789635331.507133:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044765a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427300864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789635331.507217:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635331.507346:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427300864 00000100:00100000:1.0:1789635331.507361:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427300864 00000100:00100000:1.0:1789635331.507432:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789635331.507444:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e016680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427300864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789635331.507491:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789635331.507712:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e016680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427300864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 267us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635331.507723:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789635331.507815:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044765a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427300864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789635331.529103:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635331.529168:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635331.529197:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635331.529221:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635331.529240:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635331.529260:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635331.529288:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411489280 00000100:00100000:3.0:1789635331.529298:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411489280 00000100:00100000:3.0:1789635331.529340:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 314 00000100:00100000:3.0:1789635331.529349:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054645bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2397:x1876568411489280:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635331.529414:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054645bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2397:x1876568411489280:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 66us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635331.529422:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 314 00000100:00100000:3.0:1789635331.529452:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411490048 00000100:00100000:3.0:1789635331.529456:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411490048 00000100:00100000:3.0:1789635331.529510:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 73 00000100:00100000:3.0:1789635331.529518:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2397:x1876568411490048:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635331.529546:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2397:x1876568411490048:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 29us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635331.529553:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 73 00000100:00080000:3.0:1789635331.529687:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789635331.529745:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411489408 00000100:00100000:0.0:1789635331.529750:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411489408 00000100:00100000:0.0:1789635331.529788:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411489664 00000100:00100000:0.0:1789635331.529791:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411489664 00000100:00100000:0.0:1789635331.529802:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411489536 00000100:00100000:0.0:1789635331.529804:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411489536 00000100:00100000:0.0:1789635331.529813:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411489792 00000100:00100000:0.0:1789635331.529815:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411489792 00000100:00100000:0.0:1789635331.529830:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 181 00000100:00100000:0.0:1789635331.529837:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2396:x1876568411489408:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635331.529871:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2396:x1876568411489408:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 35us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635331.529878:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 181 00000100:00100000:0.0:1789635331.529890:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 182 00000100:00100000:0.0:1789635331.529896:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e015500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2396:x1876568411489664:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635331.529930:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e015500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2396:x1876568411489664:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 34us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635331.529936:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 182 00000100:00100000:0.0:1789635331.529947:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 183 00000100:00100000:0.0:1789635331.529953:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e016300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2397:x1876568411489536:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635331.529974:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e016300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2397:x1876568411489536:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 21us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635331.529980:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 183 00000100:00100000:0.0:1789635331.529992:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 184 00000100:00100000:0.0:1789635331.529997:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2397:x1876568411489792:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635331.530017:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2397:x1876568411489792:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 20us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635331.530023:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 184 00000100:00080000:3.0:1789635331.531638:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789635331.531643:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635331.536133:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635331.536205:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411489920 00000100:00100000:0.0:1789635331.536224:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411489920 00000100:00100000:0.0:1789635331.536295:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 74 00000100:00100000:0.0:1789635331.536306:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2396:x1876568411489920:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635331.536369:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2396:x1876568411489920:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 66us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635331.536376:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 74 00000100:00080000:3.0:1789635331.536485:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789635332.261330:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789635333.094355:0:12601:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789635333.094575:0:12601:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789635333.287161:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635333.544383:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044765a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427300992:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789635333.544474:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635333.544753:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427300992 00000100:00100000:1.0:1789635333.544761:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427300992 00000100:00100000:1.0:1789635333.544820:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789635333.544831:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427300992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789635333.544872:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789635333.544916:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427300992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635333.544923:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:1.0:1789635333.544961:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d044765a300 x1876568427300992/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635333.544981:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044765a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427300992:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1789635333.548810:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789635333.550678:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427301248:0@lo:400:kworker.0 00000100:00100000:3.0:1789635333.550755:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635333.550802:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789635333.550809:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044765ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427301376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789635333.550835:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635333.550868:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427301248 00000100:00100000:3.0:1789635333.550875:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427301248 00000100:00100000:3.0:1789635333.550916:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789635333.550925:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427301248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635333.550972:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427301248:12345-0@lo:400:kworker.0 Request processed in 48us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635333.550979:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789635333.551000:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427301376 00000100:00100000:3.0:1789635333.551004:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427301376 00000100:00100000:3.0:1789635333.551037:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789635333.551044:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427301376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789635333.551060:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635333.551091:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427301376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635333.551097:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:3.0:1789635333.551133:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d044765ad80 x1876568427301376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635333.551166:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044765ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427301376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789635333.551178:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427301248:0@lo:400:kworker.0 00000100:00080000:3.0:1789635333.551205:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789635333.551234:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427301120:0@lo:400:kworker.0 00000100:00100000:3.0:1789635333.551273:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635333.551307:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427301120 00000100:00100000:3.0:1789635333.551311:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427301120 00000100:00100000:3.0:1789635333.551332:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1789635333.551339:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546459450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3643:x1876568427301120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635333.551369:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546459450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3643:x1876568427301120:12345-0@lo:400:kworker.0 Request processed in 31us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635333.551375:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1789635333.551460:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427301120:0@lo:400:kworker.0 00000100:00100000:3.0:1789635333.554497:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789635333.555269:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427301632:0@lo:400:kworker.0 00000100:00100000:2.0:1789635333.555333:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635333.555371:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789635333.555377:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427301504:0@lo:400:kworker.0 00000100:00100000:2.0:1789635333.555400:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635333.555442:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427301632 00000100:00100000:2.0:1789635333.555450:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427301632 00000100:00100000:2.0:1789635333.555490:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427301504 00000100:00100000:2.0:1789635333.555501:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427301504 00000100:00100000:2.0:1789635333.555518:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789635333.555524:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427301632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635333.555577:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427301632:12345-0@lo:400:kworker.0 Request processed in 52us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635333.555584:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789635333.558440:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789635333.558465:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427301504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635333.560268:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427301504:12345-0@lo:400:kworker.0 Request processed in 1804us (4862us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635333.560280:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789635333.560343:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427301504:0@lo:400:kworker.0 00000100:00100000:2.0:1789635333.560355:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427301632:0@lo:400:kworker.0 00000100:00100000:2.0:1789635333.560932:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427302272:0@lo:400:kworker.0 00000100:00100000:2.0:1789635333.561007:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635333.561049:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789635333.561079:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427301888:0@lo:400:kworker.0 00000100:00100000:2.0:1789635333.561105:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635333.561842:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427302400:0@lo:400:kworker.0 00000100:00100000:2.0:1789635333.561871:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635333.561903:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427301888 00000100:00100000:2.0:1789635333.561909:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427301888 00000100:00100000:2.0:1789635333.561951:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427302400 00000100:00100000:2.0:1789635333.561953:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427302400 00000100:00100000:2.0:1789635333.561976:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789635333.561983:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427301888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635333.562034:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427301888:12345-0@lo:400:kworker.0 Request processed in 51us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635333.562041:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789635333.562053:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789635333.562059:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427302400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635333.562081:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427302400:12345-0@lo:400:kworker.0 Request processed in 23us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635333.562086:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789635333.562116:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427301888:0@lo:400:kworker.0 00000100:00100000:2.0:1789635333.562124:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427302400:0@lo:400:kworker.0 00000100:00100000:2.0:1789635333.562169:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427302144:0@lo:400:kworker.0 00000100:00100000:2.0:1789635333.562194:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635333.562213:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789635333.562220:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427302016:0@lo:400:kworker.0 00000100:00100000:2.0:1789635333.562240:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635333.562256:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1876568427302528:0@lo:400:kworker.0 00000100:00100000:2.0:1789635333.562276:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635333.562296:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427302016 00000100:00100000:2.0:1789635333.562299:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427302016 00000100:00100000:2.0:1789635333.562316:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427302528 00000100:00100000:2.0:1789635333.562318:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427302528 00000100:00100000:2.0:1789635333.562331:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789635333.562336:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876568427302016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635333.562363:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876568427302016:12345-0@lo:400:kworker.0 Request processed in 27us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635333.562379:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789635333.562390:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789635333.562396:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044146b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876568427302528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635333.562423:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044146b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876568427302528:12345-0@lo:400:kworker.0 Request processed in 27us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635333.562428:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00010000:00080000:2.0:1789635333.562455:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04459eaa00 x1876568427302016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635333.562466:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427302016:0@lo:400:kworker.0 00010000:00080000:2.0:1789635333.562475:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05759cbb80 x1876568427302528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635333.562483:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1876568427302528:0@lo:400:kworker.0 00000100:00080000:1.0:1789635333.562749:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789635333.562759:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635333.562770:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427302272 00000100:00100000:1.0:1789635333.562774:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427302272 00000100:00100000:1.0:1789635333.562895:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427302144 00000100:00100000:1.0:1789635333.562899:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427302144 00000100:00100000:1.0:1789635333.562919:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789635333.562925:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447658380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427302272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635333.562965:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447658380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427302272:12345-0@lo:400:kworker.0 Request processed in 40us (1971us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635333.562971:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789635333.562983:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789635333.562989:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427302144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635333.563017:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427302144:12345-0@lo:400:kworker.0 Request processed in 28us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635333.563023:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:1.0:1789635333.563050:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05759c8380 x1876568427302272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635333.563062:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427302272:0@lo:400:kworker.0 00010000:00080000:1.0:1789635333.563079:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05759cb800 x1876568427302144/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635333.563088:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427302144:0@lo:400:kworker.0 00000100:00080000:2.0:1789635333.563965:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789635333.569397:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876568427301760:0@lo:400:kworker.0 00000100:00100000:3.0:1789635333.569465:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635333.569687:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427301760 00000100:00100000:2.0:1789635333.569695:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427301760 00000100:00100000:3.0:1789635333.569875:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789635333.569886:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876568427301760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635333.570155:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876568427301760:12345-0@lo:400:kworker.0 Request processed in 271us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635333.570163:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789635333.570222:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876568427301760:0@lo:400:kworker.0 00010000:00010000:3.0:1789635334.324420:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635334.563819:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789635334.568722:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0441469f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427302656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635334.568916:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635334.568989:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427302656 00000100:00100000:3.0:1789635334.568997:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427302656 00000100:00100000:3.0:1789635334.569041:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789635334.569049:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427302656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789635334.569079:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635334.569142:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427302656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635334.569150:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:3.0:1789635334.569194:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0441469f80 x1876568427302656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635334.569210:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0441469f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427302656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635335.093041:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789635335.093094:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427302784:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789635335.093226:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635335.093519:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427302784 00000100:00100000:1.0:1789635335.093532:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427302784 00000100:00100000:1.0:1789635335.093672:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789635335.093686:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427302784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789635335.093720:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789635335.093805:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427302784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635335.093814:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:1.0:1789635335.093877:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0575ad8000 x1876568427302784/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635351 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635335.093902:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427302784:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789635335.094984:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789635335.344095:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635336.355900:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635336.621782:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044146aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427302912:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789635336.621891:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635336.621988:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427302912 00000100:00100000:2.0:1789635336.622000:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427302912 00000100:00100000:2.0:1789635336.622058:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789635336.622069:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0441468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427302912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789635336.622127:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789635336.622188:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0441468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427302912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635336.622219:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789635336.622277:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044146aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427302912:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789635336.623391:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044146aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427303040:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789635336.623455:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635336.624387:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427303040 00000100:00100000:2.0:1789635336.624399:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427303040 00000100:00100000:2.0:1789635336.624466:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789635336.624477:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427303040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789635336.624515:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789635336.624619:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427303040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 144us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635336.624626:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789635336.624679:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044146aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427303040:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789635336.646630:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635336.646687:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635336.646715:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635336.646738:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635336.646759:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635336.646782:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635336.646895:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635336.646940:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411490432 00000100:00100000:2.0:1789635336.646953:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411490432 00000100:00100000:2.0:1789635336.647026:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411490688 00000100:00100000:2.0:1789635336.647029:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411490688 00000100:00100000:2.0:1789635336.647046:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411490304 00000100:00100000:2.0:1789635336.647049:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411490304 00000100:00100000:2.0:1789635336.647063:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411490560 00000100:00100000:2.0:1789635336.647065:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411490560 00000100:00100000:2.0:1789635336.647082:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 191 00000100:00100000:2.0:1789635336.647106:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044146aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411490432:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635336.647231:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044146aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411490432:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 127us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635336.647239:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 191 00000100:00100000:2.0:1789635336.647260:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 192 00000100:00100000:2.0:1789635336.647267:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0441469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411490688:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635336.647293:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0441469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411490688:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 27us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635336.647300:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 192 00000100:00100000:2.0:1789635336.647313:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 193 00000100:00100000:2.0:1789635336.647319:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0441468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2398:x1876568411490304:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635336.647345:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0441468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2398:x1876568411490304:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 26us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635336.647351:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 193 00000100:00100000:2.0:1789635336.647362:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 194 00000100:00100000:2.0:1789635336.647368:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0441468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411490560:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635336.647392:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0441468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411490560:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 24us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635336.647398:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 194 00000100:00100000:2.0:1789635336.647430:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411490816 00000100:00100000:2.0:1789635336.647434:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411490816 00000100:00100000:2.0:1789635336.647462:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411490944 00000100:00100000:2.0:1789635336.647465:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411490944 00000100:00100000:2.0:1789635336.647490:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:2.0:1789635336.647504:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044146a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2395:x1876568411490816:12345-192.168.203.20@tcp:9:kworker.0 00000020:00000080:2.0:1789635336.647530:0:10116:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40f016 00000100:00080000:2.0:1789635336.647542:0:10116:0:(import.c:65:import_set_state_nolock()) ffff8d0447654000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789635336.647627:0:10116:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1789635336.650193:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044146a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:407040af-7178-437e-ab3a-40e7ebc2aa86+2:2395:x1876568411490816:12345-192.168.203.20@tcp:9:kworker.0 Request processed in 2677us (3398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635336.650207:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:2.0:1789635336.650238:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:2.0:1789635336.650252:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0441469f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2395:x1876568411490944:12345-192.168.203.20@tcp:9:kworker.0 00000020:00000080:2.0:1789635336.650281:0:10116:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40f01d 00000100:00080000:2.0:1789635336.650293:0:10116:0:(import.c:65:import_set_state_nolock()) ffff8d0447657800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789635336.650352:0:10116:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1789635336.650458:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0441469f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:407040af-7178-437e-ab3a-40e7ebc2aa86+2:2395:x1876568411490944:12345-192.168.203.20@tcp:9:kworker.0 Request processed in 211us (3562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635336.650464:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00080000:2.0:1789635336.650494:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789635336.650498:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789635336.650502:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789635336.650505:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789635336.652141:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635336.652152:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635336.656496:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411490176 00000100:00100000:3.0:1789635336.656517:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411490176 00000100:00100000:0.0:1789635336.658187:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 316 00000100:00100000:0.0:1789635336.658212:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546459050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2398:x1876568411490176:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635336.658471:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546459050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2398:x1876568411490176:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 264us (11875us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635336.658493:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 316 00000020:00000004:1.0:1789635336.726579:0:12700:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789635336.731698:0:12700:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789635337.380356:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635338.408443:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635338.661296:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789635338.661317:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427303168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789635338.661382:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635338.661442:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427303168 00000100:00100000:2.0:1789635338.661449:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427303168 00000100:00100000:2.0:1789635338.661495:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789635338.661511:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427303168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789635338.661542:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635338.661583:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427303168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635338.661590:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1789635338.661628:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789635338.661657:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04459e8000 x1876568427303168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635338.661675:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427303168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635338.665029:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427303296:0@lo:400:kworker.0 00000100:00100000:1.0:1789635338.665089:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635338.665404:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427303808:0@lo:400:kworker.0 00000100:00100000:1.0:1789635338.665432:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635338.665457:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427304320:0@lo:400:kworker.0 00000100:00100000:1.0:1789635338.665480:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635338.665497:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447969f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427304832:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789635338.665517:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635338.665538:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789635338.665544:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427303424:0@lo:400:kworker.0 00000100:00100000:1.0:1789635338.665562:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635338.665577:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427303936:0@lo:400:kworker.0 00000100:00100000:1.0:1789635338.665616:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635338.665633:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427304448:0@lo:400:kworker.0 00000100:00100000:1.0:1789635338.665651:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635338.665690:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427303296 00000100:00100000:1.0:1789635338.665697:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427303296 00000100:00100000:1.0:1789635338.665877:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1789635338.665886:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054645b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3640:x1876568427303296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635338.665932:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054645b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3640:x1876568427303296:12345-0@lo:400:kworker.0 Request processed in 46us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635338.665938:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1789635338.665966:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427304320 00000100:00100000:1.0:1789635338.665970:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427304320 00000100:00100000:1.0:1789635338.666337:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789635338.666347:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447969180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427304320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635338.666381:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447969180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427304320:12345-0@lo:400:kworker.0 Request processed in 37us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635338.666387:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789635338.666406:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427304832 00000100:00100000:1.0:1789635338.666410:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427304832 00000100:00100000:1.0:1789635338.666435:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789635338.666441:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427304832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789635338.666457:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789635338.666484:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427304832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635338.666491:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789635338.666507:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427303808 00000100:00100000:1.0:1789635338.666510:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427303808 00000100:00100000:1.0:1789635338.666530:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427303424 00000100:00100000:1.0:1789635338.666533:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427303424 00000100:00100000:1.0:1789635338.666543:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427303936 00000100:00100000:1.0:1789635338.666545:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427303936 00000100:00100000:1.0:1789635338.666567:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427304448 00000100:00100000:1.0:1789635338.666570:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427304448 00000100:00100000:1.0:1789635338.666584:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789635338.666589:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044796a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427303808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635338.666636:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044796a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427303808:12345-0@lo:400:kworker.0 Request processed in 47us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635338.666643:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789635338.666655:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789635338.666660:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427303424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635338.666685:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427303424:12345-0@lo:400:kworker.0 Request processed in 25us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635338.666691:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789635338.666713:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789635338.666720:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427303936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635338.666746:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427303936:12345-0@lo:400:kworker.0 Request processed in 27us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635338.666946:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789635338.666961:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789635338.666967:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427304448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635338.666998:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427304448:12345-0@lo:400:kworker.0 Request processed in 32us (1347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635338.667018:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789635338.667055:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427303680:0@lo:400:kworker.0 00000100:00100000:1.0:1789635338.667083:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635338.667206:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427304192:0@lo:400:kworker.0 00000100:00100000:1.0:1789635338.667237:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635338.667266:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427304704:0@lo:400:kworker.0 00000100:00100000:1.0:1789635338.667284:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635338.667302:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789635338.667308:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427303552:0@lo:400:kworker.0 00000100:00100000:1.0:1789635338.667328:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789635338.669553:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789635338.669560:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789635338.669563:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789635338.669626:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427303424:0@lo:400:kworker.0 00000100:00100000:3.0:1789635338.669639:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427303936:0@lo:400:kworker.0 00000100:00100000:3.0:1789635338.669649:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427304448:0@lo:400:kworker.0 00000100:00100000:3.0:1789635338.669658:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427303296:0@lo:400:kworker.0 00000100:00100000:3.0:1789635338.669667:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427303808:0@lo:400:kworker.0 00010000:00080000:3.0:1789635338.669680:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05759c9500 x1876568427304320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635338.669723:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427304320:0@lo:400:kworker.0 00010000:00080000:3.0:1789635338.669736:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447969f80 x1876568427304832/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635338.669759:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447969f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427304832:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789635338.673653:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427304192 00000100:00100000:0.0:1789635338.673666:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427304192 00000100:00100000:0.0:1789635338.673732:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427304704 00000100:00100000:0.0:1789635338.673735:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427304704 00000100:00100000:0.0:1789635338.675918:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789635338.675933:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427304192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635338.676080:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427304192:12345-0@lo:400:kworker.0 Request processed in 152us (8841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635338.676088:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789635338.676117:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789635338.676125:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427304704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635338.676152:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427304704:12345-0@lo:400:kworker.0 Request processed in 30us (8868us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635338.676158:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1789635338.676178:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789635338.683324:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427303680 00000100:00100000:2.0:1789635338.683337:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427303680 00000100:00100000:2.0:1789635338.683990:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427304064:0@lo:400:kworker.0 00000100:00100000:2.0:1789635338.684065:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635338.684175:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427304064 00000100:00100000:2.0:1789635338.684180:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427304064 00000100:00100000:2.0:1789635338.684235:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789635338.684256:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876568427304064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635338.684305:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876568427304064:12345-0@lo:400:kworker.0 Request processed in 62us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635338.684311:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00010000:00080000:2.0:1789635338.684351:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05759ca680 x1876568427304064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635338.684365:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427304064:0@lo:400:kworker.0 00000100:00100000:2.0:1789635338.684372:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1876568427304576:0@lo:400:kworker.0 00000100:00100000:2.0:1789635338.684409:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635338.684438:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427304576 00000100:00100000:2.0:1789635338.684442:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427304576 00000100:00100000:2.0:1789635338.684466:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789635338.684472:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447af2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876568427304576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635338.684500:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447af2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876568427304576:12345-0@lo:400:kworker.0 Request processed in 28us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635338.684506:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00010000:00080000:2.0:1789635338.684530:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05759c8a80 x1876568427304576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635338.684540:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1876568427304576:0@lo:400:kworker.0 00010000:00080000:2.0:1789635338.684554:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05759cb480 x1876568427304192/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635338.684562:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427304192:0@lo:400:kworker.0 00010000:00080000:2.0:1789635338.684573:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447969880 x1876568427304704/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635338.684581:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427304704:0@lo:400:kworker.0 00000100:00100000:3.0:1789635338.687944:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427303552 00000100:00100000:3.0:1789635338.687957:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427303552 00000100:00100000:3.0:1789635338.687978:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789635338.687999:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427303680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635338.688167:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427303680:12345-0@lo:400:kworker.0 Request processed in 180us (21082us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635338.688175:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789635338.688191:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789635338.688197:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427303552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635338.688238:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427303552:12345-0@lo:400:kworker.0 Request processed in 41us (20909us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635338.688252:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789635338.688376:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427303552:0@lo:400:kworker.0 00000100:00100000:2.0:1789635338.688388:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427303680:0@lo:400:kworker.0 00000100:00080000:2.0:1789635338.688707:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789635339.427944:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635339.684487:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447af2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427304960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635339.684577:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635339.684691:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427304960 00000100:00100000:0.0:1789635339.684701:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427304960 00000100:00100000:0.0:1789635339.684771:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789635339.684780:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427304960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789635339.684815:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635339.685835:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427304960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1050us (1252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635339.685848:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:3.0:1789635339.686034:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447af2d80 x1876568427304960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635355 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635339.686059:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447af2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427304960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635340.201510:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789635340.201548:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575adb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427305088:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789635340.201667:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635340.201733:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427305088 00000100:00100000:0.0:1789635340.201743:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427305088 00000100:00100000:0.0:1789635340.201808:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789635340.201819:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427305088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789635340.201849:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635340.201896:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427305088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635340.201903:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1789635340.201927:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789635340.201963:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0575adb800 x1876568427305088/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635340.201983:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575adb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427305088:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789635340.458517:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789635340.794447:0:12798:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789635340.794813:0:12798:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789635341.482295:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635341.735125:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789635341.735166:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447af0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427305216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789635341.735182:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789635341.735196:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0446c3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427305344:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789635341.735283:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635341.735367:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427305344 00000100:00100000:3.0:1789635341.735376:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427305344 00000100:00100000:3.0:1789635341.735438:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789635341.735449:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427305344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789635341.735495:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789635341.735547:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427305344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635341.735553:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789635341.735638:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0446c3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427305344:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789635341.735774:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635341.735827:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427305216 00000100:00100000:2.0:1789635341.735832:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427305216 00000100:00100000:2.0:1789635341.735861:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789635341.735869:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447af3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427305216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789635341.735893:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789635341.735930:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447af3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427305216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635341.735937:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789635341.736091:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447af0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427305216:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789635341.769171:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635341.769244:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635341.769272:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635341.769293:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635341.769314:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635341.769349:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411491200 00000100:00100000:2.0:1789635341.769361:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411491200 00000100:00100000:2.0:1789635341.769433:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411491328 00000100:00100000:2.0:1789635341.769436:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411491328 00000100:00100000:2.0:1789635341.769454:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411491584 00000100:00100000:2.0:1789635341.769457:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411491584 00000100:00100000:2.0:1789635341.769472:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411491456 00000100:00100000:2.0:1789635341.769474:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411491456 00000100:00100000:2.0:1789635341.769491:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 201 00000100:00100000:2.0:1789635341.769503:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447af0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2397:x1876568411491200:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635341.769887:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447af0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2397:x1876568411491200:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 383us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635341.769895:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 201 00000100:00100000:2.0:1789635341.769926:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 202 00000100:00100000:2.0:1789635341.769950:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447af1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2396:x1876568411491328:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635341.769999:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447af1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2396:x1876568411491328:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 50us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635341.770006:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 202 00000100:00100000:2.0:1789635341.770017:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 203 00000100:00100000:2.0:1789635341.770032:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447af2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2396:x1876568411491584:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635341.770054:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447af2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2396:x1876568411491584:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 32us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635341.770061:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 203 00000100:00100000:2.0:1789635341.770071:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 204 00000100:00100000:2.0:1789635341.770087:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447af0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2397:x1876568411491456:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635341.770108:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447af0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2397:x1876568411491456:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 23us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635341.770113:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 204 00000100:00100000:2.0:1789635341.770281:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411491072 00000100:00100000:2.0:1789635341.770287:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411491072 00000100:00100000:2.0:1789635341.770333:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 318 00000100:00100000:2.0:1789635341.770341:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054645a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2396:x1876568411491072:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635341.770373:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054645a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2396:x1876568411491072:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 33us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635341.770380:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 318 00000100:00080000:2.0:1789635341.770429:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789635341.770433:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:1.0:1789635342.246776:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 407040af-7178-437e-ab3a-40e7ebc2aa86 00000020:00000080:1.0:1789635342.246802:0:8425:0:(genops.c:885:class_export_put()) final put ffff8d0447653800/407040af-7178-437e-ab3a-40e7ebc2aa86 00000020:00000080:2.0:1789635342.248739:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0447653800/407040af-7178-437e-ab3a-40e7ebc2aa86 for lustre-OST0000 00000020:00000080:2.0:1789635342.251011:0:492:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d0447654000 for lustre-OST0000 00000001:00100000:1.0:1789635342.257462:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 407040af-7178-437e-ab3a-40e7ebc2aa86 00000020:00000080:1.0:1789635342.257475:0:9509:0:(genops.c:885:class_export_put()) final put ffff8d0447656000/407040af-7178-437e-ab3a-40e7ebc2aa86 00000020:00000080:3.0:1789635342.257751:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0447656000/407040af-7178-437e-ab3a-40e7ebc2aa86 for lustre-OST0001 00000020:00000080:3.0:1789635342.257824:0:492:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d0447657800 for lustre-OST0001 00010000:00010000:3.0:1789635342.509051:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635343.524498:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789635343.606910:0:12895:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789635343.607166:0:12895:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789635343.779864:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427305472:0@lo:400:kworker.0 00000100:00100000:2.0:1789635343.779933:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635343.780002:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876568427305984:0@lo:400:kworker.0 00000100:00100000:2.0:1789635343.780028:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635343.780046:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427305856:0@lo:400:kworker.0 00000100:00100000:2.0:1789635343.780054:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427306496:0@lo:400:kworker.0 00000100:00100000:2.0:1789635343.780084:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635343.780085:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635343.780102:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427307008:0@lo:400:kworker.0 00000100:00100000:0.0:1789635343.780102:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044844a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427306368:0@lo:400:kworker.0 00000100:00100000:0.0:1789635343.780121:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635343.780137:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876568427305600:0@lo:400:kworker.0 00000100:00100000:1.0:1789635343.780169:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427305984 00000100:00100000:1.0:1789635343.780177:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427305984 00000100:00100000:1.0:1789635343.789430:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789635343.789453:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447af2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876568427305984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635343.795259:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427305728:0@lo:400:kworker.0 00000100:00100000:2.0:1789635343.795347:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635343.795387:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427306240:0@lo:400:kworker.0 00000100:00100000:2.0:1789635343.795423:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635343.795441:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448449180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1876568427306752:0@lo:400:kworker.0 00000100:00100000:2.0:1789635343.795461:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635343.795483:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789635343.795490:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447969f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427307136:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789635343.795513:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635343.795557:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427305472 00000100:00100000:2.0:1789635343.795565:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427305472 00000100:00100000:2.0:1789635343.795625:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1789635343.795635:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054645a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3641:x1876568427305472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635343.795698:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054645a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3641:x1876568427305472:12345-0@lo:400:kworker.0 Request processed in 65us (15764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635343.795706:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1789635343.795773:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427305856 00000100:00100000:2.0:1789635343.795778:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427305856 00000100:00100000:2.0:1789635343.795799:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427305728 00000100:00100000:2.0:1789635343.795802:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427305728 00000100:00100000:2.0:1789635343.795824:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789635343.795830:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575adb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427305856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635343.795865:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575adb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427305856:12345-0@lo:400:kworker.0 Request processed in 35us (15779us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635343.795871:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789635343.795882:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789635343.795888:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447af1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427305728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635343.795917:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447af1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427305728:12345-0@lo:400:kworker.0 Request processed in 29us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635343.795923:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789635343.795940:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427306240 00000100:00100000:2.0:1789635343.795944:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427306240 00000100:00100000:2.0:1789635343.795972:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427306752 00000100:00100000:2.0:1789635343.795975:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427306752 00000100:00100000:2.0:1789635343.795994:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789635343.796001:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447af0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876568427306240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635343.796031:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447af0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876568427306240:12345-0@lo:400:kworker.0 Request processed in 32us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635343.796037:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789635343.796048:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789635343.796075:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447af3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876568427306752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635343.796104:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447af3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876568427306752:12345-0@lo:400:kworker.0 Request processed in 32us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635343.796110:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789635343.796146:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447af0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427307264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789635343.796169:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635343.796204:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427305728:0@lo:400:kworker.0 00010000:00080000:2.0:1789635343.796219:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447a3c700 x1876568427306240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635343.796229:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427306240:0@lo:400:kworker.0 00010000:00080000:2.0:1789635343.796238:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0448449180 x1876568427306752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635343.796247:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448449180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1876568427306752:0@lo:400:kworker.0 00000100:00080000:2.0:1789635343.796278:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789635343.796292:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427307136 00000100:00100000:2.0:1789635343.796296:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427307136 00000100:00100000:2.0:1789635343.796324:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427307264 00000100:00100000:2.0:1789635343.796327:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427307264 00000100:00100000:2.0:1789635343.796342:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789635343.796348:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447af3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427307136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789635343.796370:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635343.796405:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447af3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427307136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635343.796411:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789635343.796423:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789635343.796435:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427307264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789635343.796446:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635343.796470:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427307264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635343.796476:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:2.0:1789635343.796489:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789635343.796506:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447af0e00 x1876568427307264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635343.796520:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447af0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427307264:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1789635343.796530:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447969f80 x1876568427307136/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635343.796538:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447969f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427307136:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789635343.796572:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635343.796589:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427305600 00000100:00100000:2.0:1789635343.796593:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427305600 00000100:00100000:2.0:1789635343.796632:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789635343.796637:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447af0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876568427305600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635343.796663:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447af0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876568427305600:12345-0@lo:400:kworker.0 Request processed in 26us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635343.796669:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789635343.796692:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876568427305600:0@lo:400:kworker.0 00000100:00100000:2.0:1789635343.796700:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1876568427306112:0@lo:400:kworker.0 00000100:00100000:2.0:1789635343.796720:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635343.796739:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427306112 00000100:00100000:2.0:1789635343.796742:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427306112 00000100:00100000:2.0:1789635343.796772:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789635343.796777:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876568427306112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635343.796806:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876568427306112:12345-0@lo:400:kworker.0 Request processed in 29us (85us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635343.796812:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00080000:2.0:1789635343.796826:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635343.796843:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1876568427306112:0@lo:400:kworker.0 00000100:00100000:2.0:1789635343.796849:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044844a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1876568427306624:0@lo:400:kworker.0 00000100:00100000:2.0:1789635343.796870:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635343.796887:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427306624 00000100:00100000:2.0:1789635343.796889:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427306624 00000100:00100000:2.0:1789635343.796913:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789635343.796919:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876568427306624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635343.796944:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876568427306624:12345-0@lo:400:kworker.0 Request processed in 26us (74us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635343.796950:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:2.0:1789635343.796961:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635343.796974:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044844a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1876568427306624:0@lo:400:kworker.0 00000100:00100000:3.0:1789635343.798776:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635343.798839:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427305472:0@lo:400:kworker.0 00000100:00100000:3.0:1789635343.798897:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427306496 00000100:00100000:3.0:1789635343.798904:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427306496 00000100:00100000:3.0:1789635343.798951:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427306368 00000100:00100000:3.0:1789635343.798970:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427306368 00000100:00100000:3.0:1789635343.798985:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427307008 00000100:00100000:3.0:1789635343.798988:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427307008 00000100:00100000:3.0:1789635343.799000:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789635343.799008:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447af1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427306496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635343.799072:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447af1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427306496:12345-0@lo:400:kworker.0 Request processed in 65us (18987us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635343.799078:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789635343.799093:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789635343.799108:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427306368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635343.799419:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427306368:12345-0@lo:400:kworker.0 Request processed in 311us (19296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635343.799425:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789635343.799437:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789635343.799443:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447969f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427307008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635343.799471:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447969f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427307008:12345-0@lo:400:kworker.0 Request processed in 29us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635343.799476:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1789635343.799492:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789635343.799515:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0448448380 x1876568427306496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635343.799526:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427306496:0@lo:400:kworker.0 00010000:00080000:3.0:1789635343.799536:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0448448700 x1876568427307008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635343.799544:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427307008:0@lo:400:kworker.0 00010000:00080000:0.0:1789635343.799590:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d044844a300 x1876568427306368/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635343.799625:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044844a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427306368:0@lo:400:kworker.0 00000100:00100000:0.0:1789635343.799648:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427306880:0@lo:400:kworker.0 00000100:00100000:0.0:1789635343.799680:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635343.799714:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427305856:0@lo:400:kworker.0 00000100:00100000:3.0:1789635343.800496:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427306880 00000100:00100000:3.0:1789635343.800502:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427306880 00000100:00100000:3.0:1789635343.800532:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789635343.800540:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427306880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635343.800583:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427306880:12345-0@lo:400:kworker.0 Request processed in 44us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635343.800589:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1789635343.802358:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0448449500 x1876568427306880/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635343.802373:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427306880:0@lo:400:kworker.0 00000100:00100000:0.0:1789635343.802442:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447af2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876568427305984:12345-0@lo:400:kworker.0 Request processed in 13000us (22412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635343.802451:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789635343.805288:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876568427305984:0@lo:400:kworker.0 00010000:00010000:3.0:1789635344.558130:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635344.804253:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789635344.804284:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0446c3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427307392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635344.804348:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635344.804393:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427307392 00000100:00100000:3.0:1789635344.804401:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427307392 00000100:00100000:3.0:1789635344.804458:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789635344.804467:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427307392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789635344.804495:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635344.804618:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427307392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635344.804626:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:3.0:1789635344.804667:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0446c3f100 x1876568427307392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635344.804684:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0446c3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427307392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789635345.316857:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789635345.316879:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427307520:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789635345.316943:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635345.317361:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427307520 00000100:00100000:0.0:1789635345.317370:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427307520 00000100:00080000:3.0:1789635345.317575:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789635345.317640:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789635345.317661:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044844bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427307520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789635345.317683:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635345.317737:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044844bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427307520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635345.317745:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:1.0:1789635345.317808:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04459dca80 x1876568427307520/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635345.317826:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427307520:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789635345.571863:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635346.596398:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635346.852155:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427307648:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789635346.852222:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635346.852278:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789635346.852285:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427307776:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789635346.852305:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635346.852402:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427307648 00000100:00100000:2.0:1789635346.852410:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427307648 00000100:00100000:2.0:1789635346.852457:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427307776 00000100:00100000:2.0:1789635346.852461:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427307776 00000100:00100000:2.0:1789635346.852476:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789635346.852484:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427307648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789635346.852513:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789635346.852583:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427307648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635346.852590:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789635346.852623:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789635346.852629:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427307776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789635346.852645:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789635346.852672:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427307776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 44us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635346.852677:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789635346.852957:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427307776:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789635346.852971:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427307648:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789635346.887983:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635346.888029:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635346.888067:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635346.888120:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635346.888152:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635346.888269:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411491840 00000100:00100000:0.0:1789635346.888279:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411491840 00000100:00100000:0.0:1789635346.888343:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411491968 00000100:00100000:0.0:1789635346.888347:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411491968 00000100:00100000:0.0:1789635346.888359:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411492096 00000100:00100000:0.0:1789635346.888361:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411492096 00000100:00100000:0.0:1789635346.888382:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411492224 00000100:00100000:0.0:1789635346.888385:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411492224 00000100:00100000:0.0:1789635346.888410:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 211 00000100:00100000:0.0:1789635346.888419:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044844b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2398:x1876568411491840:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635346.888497:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044844b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2398:x1876568411491840:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 78us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635346.888513:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 211 00000100:00100000:0.0:1789635346.888530:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 212 00000100:00100000:0.0:1789635346.888537:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411491968:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635346.888562:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411491968:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 25us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635346.888567:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 212 00000100:00100000:0.0:1789635346.888578:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 213 00000100:00100000:0.0:1789635346.888584:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411492096:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635346.888635:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411492096:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 51us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635346.888642:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 213 00000100:00100000:0.0:1789635346.888653:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 214 00000100:00100000:0.0:1789635346.888660:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2399:x1876568411492224:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635346.888682:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2399:x1876568411492224:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 23us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635346.888688:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 214 00000100:00100000:3.0:1789635346.889424:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411491712 00000100:00100000:3.0:1789635346.889430:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411491712 00000100:00100000:3.0:1789635346.889904:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 320 00000100:00100000:3.0:1789635346.889917:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0565a0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2399:x1876568411491712:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635346.889965:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0565a0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2399:x1876568411491712:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 52us (1935us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635346.889971:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 320 00000100:00080000:1.0:1789635346.890289:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789635346.890294:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789635347.622722:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789635348.390070:0:13040:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789635348.647370:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635348.900081:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044844ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427308288:0@lo:400:kworker.0 00000100:00100000:1.0:1789635348.900182:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635348.900247:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427308800:0@lo:400:kworker.0 00000100:00100000:1.0:1789635348.900285:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635348.900303:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044844a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427309312:0@lo:400:kworker.0 00000100:00100000:1.0:1789635348.900323:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635348.900345:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789635348.900350:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044844aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427308160:0@lo:400:kworker.0 00000100:00100000:1.0:1789635348.900371:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635348.900385:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448449c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427308672:0@lo:400:kworker.0 00000100:00100000:1.0:1789635348.900406:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635348.900423:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1876568427309184:0@lo:400:kworker.0 00000100:00100000:1.0:1789635348.900441:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635348.900777:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427308672 00000100:00100000:1.0:1789635348.900786:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427308672 00000100:00100000:1.0:1789635348.900830:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427309184 00000100:00100000:1.0:1789635348.900833:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427309184 00000100:00100000:1.0:1789635348.900854:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789635348.900861:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876568427308672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635348.900908:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876568427308672:12345-0@lo:400:kworker.0 Request processed in 47us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635348.900915:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789635348.901066:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448449f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876568427308032:0@lo:400:kworker.0 00000100:00100000:3.0:1789635348.901108:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635348.901125:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044844b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1876568427308544:0@lo:400:kworker.0 00000100:00100000:3.0:1789635348.901145:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635348.901155:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1876568427309056:0@lo:400:kworker.0 00000100:00100000:3.0:1789635348.901171:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635348.901184:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1789635348.901189:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044844b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427307904:0@lo:400:kworker.0 00000100:00100000:3.0:1789635348.901214:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635348.901236:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876568427308416:0@lo:400:kworker.0 00000100:00100000:3.0:1789635348.901256:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635348.901279:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044844a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427308928:0@lo:400:kworker.0 00000100:00100000:3.0:1789635348.901299:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635348.901317:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448449180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427309440:0@lo:400:kworker.0 00000100:00100000:3.0:1789635348.901337:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635348.901359:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427308800 00000100:00100000:3.0:1789635348.901363:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427308800 00000100:00100000:3.0:1789635348.901387:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427309312 00000100:00100000:3.0:1789635348.901389:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427309312 00000100:00100000:3.0:1789635348.901401:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427308928 00000100:00100000:3.0:1789635348.901403:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427308928 00000100:00100000:3.0:1789635348.901413:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427309440 00000100:00100000:3.0:1789635348.901415:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427309440 00000100:00100000:3.0:1789635348.901426:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789635348.901431:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541324700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427308800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635348.901475:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541324700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427308800:12345-0@lo:400:kworker.0 Request processed in 43us (1189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635348.901488:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789635348.901505:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789635348.901511:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427309312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635348.901539:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427309312:12345-0@lo:400:kworker.0 Request processed in 29us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635348.901545:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789635348.901555:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789635348.901561:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427308928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635348.901827:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427308928:12345-0@lo:400:kworker.0 Request processed in 266us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635348.901834:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789635348.901846:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789635348.901851:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427309440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635348.901878:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427309440:12345-0@lo:400:kworker.0 Request processed in 27us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635348.901883:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:3.0:1789635348.901916:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d044844a300 x1876568427308928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635348.901941:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044844a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427308928:0@lo:400:kworker.0 00010000:00080000:3.0:1789635348.901953:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0448449180 x1876568427309440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635348.901960:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448449180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427309440:0@lo:400:kworker.0 00000100:00080000:3.0:1789635348.901998:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789635348.902007:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789635348.902010:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789635348.902171:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0448449c00 x1876568427308672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635348.902181:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448449c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427308672:0@lo:400:kworker.0 00010000:00080000:0.0:1789635348.902203:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0448449500 x1876568427308800/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635348.902210:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427308800:0@lo:400:kworker.0 00010000:00080000:0.0:1789635348.902218:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d044844a680 x1876568427309312/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635348.902225:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044844a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427309312:0@lo:400:kworker.0 00000100:00100000:1.0:1789635348.902424:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427308032 00000100:00100000:1.0:1789635348.902429:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427308032 00000100:00100000:3.0:1789635348.902686:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427308544 00000100:00100000:3.0:1789635348.902691:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427308544 00000100:00100000:3.0:1789635348.902714:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427309056 00000100:00100000:3.0:1789635348.902717:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427309056 00000100:00100000:3.0:1789635348.902731:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427308416 00000100:00100000:3.0:1789635348.902733:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427308416 00000100:00100000:3.0:1789635348.902746:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789635348.902753:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876568427309184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635348.902799:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876568427309184:12345-0@lo:400:kworker.0 Request processed in 47us (2357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635348.902805:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789635348.902817:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789635348.902823:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876568427308544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635348.902854:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876568427308544:12345-0@lo:400:kworker.0 Request processed in 31us (1707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635348.902859:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789635348.902870:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789635348.902876:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876568427309056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635348.902901:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876568427309056:12345-0@lo:400:kworker.0 Request processed in 25us (1728us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635348.902905:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789635348.902915:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789635348.903016:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789635348.903034:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876568427308032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635348.903067:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876568427308032:12345-0@lo:400:kworker.0 Request processed in 36us (1969us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635348.903072:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:0.0:1789635348.903183:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789635348.903205:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0448448380 x1876568427309184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635348.903215:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1876568427309184:0@lo:400:kworker.0 00000100:00100000:0.0:1789635348.903251:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448449f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876568427308032:0@lo:400:kworker.0 00000100:00100000:0.0:1789635348.903261:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044844b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1876568427308544:0@lo:400:kworker.0 00000100:00100000:0.0:1789635348.903285:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1876568427309056:0@lo:400:kworker.0 00000100:00100000:2.0:1789635348.903486:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427308288 00000100:00100000:2.0:1789635348.903491:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427308288 00000100:00100000:2.0:1789635348.903520:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427308160 00000100:00100000:2.0:1789635348.903524:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427308160 00000100:00100000:2.0:1789635348.903538:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789635348.903545:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427308288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635348.903794:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427308288:12345-0@lo:400:kworker.0 Request processed in 248us (3611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635348.903802:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789635348.903817:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789635348.903824:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427308160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635348.903858:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427308160:12345-0@lo:400:kworker.0 Request processed in 34us (3486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635348.903863:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789635348.903893:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427307904 00000100:00100000:2.0:1789635348.903897:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427307904 00000100:00100000:2.0:1789635348.904008:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1789635348.904040:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0565a08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3641:x1876568427307904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635348.904081:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0565a08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3641:x1876568427307904:12345-0@lo:400:kworker.0 Request processed in 44us (2866us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635348.904087:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1789635348.904141:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044844b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427307904:0@lo:400:kworker.0 00000100:00100000:2.0:1789635348.904167:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044844aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427308160:0@lo:400:kworker.0 00000100:00100000:2.0:1789635348.904177:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044844ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427308288:0@lo:400:kworker.0 00000100:00100000:3.0:1789635348.904367:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876568427308416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635348.904412:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876568427308416:12345-0@lo:400:kworker.0 Request processed in 1492us (3155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635348.904427:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789635348.904577:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789635348.904589:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427309568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789635348.904656:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635348.904848:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427309568 00000100:00100000:3.0:1789635348.904854:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427309568 00000100:00100000:3.0:1789635348.904894:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789635348.904901:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427309568:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635348.905070:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541325880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427309696:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789635348.905114:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635348.905145:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427309696 00000100:00100000:1.0:1789635348.905149:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427309696 00000100:00100000:1.0:1789635348.905167:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789635348.905172:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427309696:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789635348.905384:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876568427308416:0@lo:400:kworker.0 00002000:00000024:3.0:1789635348.905700:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635348.905750:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427309568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 849us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635348.905756:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:2.0:1789635348.906076:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04459de680 x1876568427309568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635348.906094:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427309568:0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789635348.911820:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789635348.912095:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427309696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6918us (6991us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635348.912117:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:2.0:1789635348.919214:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0541325880 x1876568427309696/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635348.919244:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541325880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427309696:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789635349.670907:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635349.923833:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789635349.923865:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427309824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789635349.924083:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635349.938314:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427309824 00000100:00100000:3.0:1789635349.938336:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427309824 00000100:00100000:3.0:1789635349.938433:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789635349.938446:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541325f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427309824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789635349.938489:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635349.938618:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541325f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427309824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 174us (14535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635349.938626:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:1.0:1789635349.939679:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05759cb800 x1876568427309824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635349.939712:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427309824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635350.438402:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427309952:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789635350.438499:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635350.438582:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427309952 00000100:00100000:0.0:1789635350.438592:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427309952 00000100:00100000:0.0:1789635350.438680:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789635350.438692:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427309952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789635350.438733:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635350.438787:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427309952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635350.438795:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:0.0:1789635350.438821:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789635350.438859:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04459de680 x1876568427309952/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635366 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635350.438880:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427309952:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789635350.698653:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635351.717428:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635351.974877:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789635351.974909:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427310080:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789635351.974914:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789635351.974925:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427310208:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789635351.990528:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635351.990751:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427310208 00000100:00100000:0.0:1789635351.990765:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427310208 00000100:00100000:0.0:1789635351.990839:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789635351.990850:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447af2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427310208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789635351.990901:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789635351.990970:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447af2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427310208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635351.990977:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789635351.991353:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427310208:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789635352.002255:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635352.002493:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427310080 00000100:00100000:0.0:1789635352.002506:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427310080 00000100:00100000:0.0:1789635352.002579:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789635352.002590:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427310080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789635352.002656:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789635352.002745:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427310080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 157us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635352.002752:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789635352.002811:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427310080:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789635352.002963:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635352.002989:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635352.003031:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635352.003065:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635352.003089:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635352.003110:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411492480 00000100:00100000:2.0:1789635352.003115:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411492480 00000100:00100000:2.0:1789635352.003155:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411492608 00000100:00100000:2.0:1789635352.003158:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411492608 00000100:00100000:2.0:1789635352.003172:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411492736 00000100:00100000:2.0:1789635352.003175:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411492736 00000100:00100000:2.0:1789635352.003190:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411492864 00000100:00100000:2.0:1789635352.003193:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411492864 00000100:00100000:2.0:1789635352.003228:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 221 00000100:00100000:2.0:1789635352.003236:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447af1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2399:x1876568411492480:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635352.003304:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447af1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2399:x1876568411492480:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 69us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635352.003311:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 221 00000100:00100000:2.0:1789635352.003327:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 222 00000100:00100000:2.0:1789635352.003334:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411492608:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635352.003359:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411492608:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 26us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635352.003366:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 222 00000100:00100000:2.0:1789635352.003377:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 223 00000100:00100000:2.0:1789635352.003383:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2399:x1876568411492736:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635352.003405:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2399:x1876568411492736:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 23us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635352.003411:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 223 00000100:00100000:2.0:1789635352.003422:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 224 00000100:00100000:2.0:1789635352.003435:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411492864:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635352.003476:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411492864:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 41us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635352.003483:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 224 00000100:00080000:2.0:1789635352.003513:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789635352.003518:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635352.004183:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411492352 00000100:00100000:0.0:1789635352.004200:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411492352 00000100:00100000:0.0:1789635352.004244:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 322 00000100:00100000:0.0:1789635352.004252:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0565a0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2398:x1876568411492352:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635352.004307:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0565a0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2398:x1876568411492352:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 56us (1316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635352.004315:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 322 00010000:00010000:1.0:1789635352.742813:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789635352.788795:0:13187:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcc75816c0 20000000:00000080:2.0:1789635352.788812:0:13187:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d044841a000 uarg=0000000000000000 20000000:01000000:2.0:1789635352.788853:0:13187:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789635352.788860:0:13187:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789635352.788864:0:13187:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789635352.789459:0:13188:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1789635352.789660:0:13187:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789635352.800899:0:13187:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789635352.801058:0:13187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d056e152c00/0xb0c3a59caa40f024 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.801097:0:13187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d056e1a2c00/0xb0c3a59caa40efbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40efb4 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.801106:0:13187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d056e1a3000/0xb0c3a59caa40efc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40efc2 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.801113:0:13187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40efd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40efd0 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.801120:0:13187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d056e1a3600/0xb0c3a59caa40efe5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40efde expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.801130:0:13187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d054139c400/0xb0c3a59caa40efec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ee7 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.801136:0:13187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d056f6e8800/0xb0c3a59caa40f001 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f26 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.801143:0:13187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d056e152c00/0xb0c3a59caa40f024 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.801185:0:13187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d056f6e8800/0xb0c3a59caa40f001 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f26 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.801199:0:13187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d056f6e8800/0xb0c3a59caa40f001 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f26 expref: 12 pid: 6508 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635352.801213:0:13187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541326a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1876568427310336:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789635352.801321:0:13187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d054139c400/0xb0c3a59caa40efec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ee7 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.801335:0:13187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d054139c400/0xb0c3a59caa40efec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ee7 expref: 12 pid: 6509 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635352.801345:0:13187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541326d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1876568427310464:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789635352.801376:0:13187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d056e1a3600/0xb0c3a59caa40efe5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40efde expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.801384:0:13187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d056e1a3600/0xb0c3a59caa40efe5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40efde expref: 23 pid: 6506 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635352.801393:0:13187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541324a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1876568427310592:0@lo:104: 00000100:00100000:1.0:1789635352.801430:0:13187:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789635352.801476:0:13187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40efd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40efd0 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.801484:0:13187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40efd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40efd0 expref: 23 pid: 6509 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635352.801493:0:13187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541325c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1876568427310720:0@lo:104: 00000100:00100000:1.0:1789635352.801514:0:13187:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789635352.801534:0:13187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d056e1a3000/0xb0c3a59caa40efc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40efc2 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.801542:0:13187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d056e1a3000/0xb0c3a59caa40efc9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40efc2 expref: 23 pid: 6506 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635352.801550:0:13187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541324380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1876568427310848:0@lo:104: 00000100:00100000:1.0:1789635352.801569:0:13187:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789635352.801622:0:13187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d056e1a2c00/0xb0c3a59caa40efbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40efb4 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.801629:0:13187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d056e1a2c00/0xb0c3a59caa40efbb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40efb4 expref: 23 pid: 6508 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635352.801638:0:13187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541325180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1876568427310976:0@lo:104: 00000100:00100000:1.0:1789635352.801659:0:13187:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635352.801676:0:13187:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d056e1e4000 going to sleep for 11 seconds 00000100:00100000:0.0:1789635352.801917:0:10394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427310592 00000100:00100000:0.0:1789635352.801932:0:10394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427310592 00000100:00100000:0.0:1789635352.802000:0:10394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427310720 00000100:00100000:0.0:1789635352.802004:0:10394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427310720 00000100:00100000:0.0:1789635352.802017:0:10394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427310848 00000100:00100000:0.0:1789635352.802020:0:10394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427310848 00000100:00100000:0.0:1789635352.802030:0:10394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427310976 00000100:00100000:0.0:1789635352.802032:0:10394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427310976 00000100:00100000:0.0:1789635352.803403:0:10394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789635352.804397:0:10394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541327100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+6:13187:x1876568427310592:12345-0@lo:104: 00010000:00010000:1.0:1789635352.804418:0:10394:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3e00/0xb0c3a59caa40efde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40efe5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.804510:0:10394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789635352.804517:0:10394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541327100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+6:13187:x1876568427310592:12345-0@lo:104: Request processed in 244us (3086us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635352.805511:0:13187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541324a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1876568427310592:0@lo:104: 00000100:00100000:3.0:1789635352.806075:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00010000:00010000:2.0:1789635352.806130:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635352.806139:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3e00/0xb0c3a59caa40efde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40efe5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635352.806148:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3e00 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:2.0:1789635352.806153:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3e00/0xb0c3a59caa40efde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40efe5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635352.806163:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3e00/0xb0c3a59caa40efde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40efe5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789635352.806170:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3e00/0xb0c3a59caa40efde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40efe5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635352.806175:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789635352.806220:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3e00/0xb0c3a59caa40efde lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40efe5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635352.806243:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789635352.806266:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3e00/0xb0c3a59caa40efde lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40efe5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635352.806273:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3e00/0xb0c3a59caa40efde lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40efe5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635352.806288:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635352.806290:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635352.806292:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635352.806308:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427311104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789635352.806761:0:10394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789635352.806793:0:10394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789635352.806805:0:10394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541326680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+5:13187:x1876568427310848:12345-0@lo:104: 00010000:00010000:1.0:1789635352.806816:0:10394:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40efc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40efc9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.806890:0:10394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789635352.806896:0:10394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541326680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+5:13187:x1876568427310848:12345-0@lo:104: Request processed in 97us (5326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635352.806902:0:10394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789635352.806916:0:10394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789635352.806923:0:10394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541325880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+4:13187:x1876568427310976:12345-0@lo:104: 00010000:00010000:1.0:1789635352.806939:0:10394:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d054139c600/0xb0c3a59caa40efb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40efbb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.806972:0:10394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789635352.806978:0:10394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541325880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+4:13187:x1876568427310976:12345-0@lo:104: Request processed in 56us (5318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635352.806985:0:10394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1789635352.807023:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789635352.807028:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40efc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40efc9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.807394:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152600 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:1.0:1789635352.807399:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40efc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40efc9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.807407:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40efc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40efc9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789635352.807414:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40efc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40efc9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635352.807419:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789635352.807461:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40efc2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40efc9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.807467:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789635352.807485:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40efc2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40efc9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.807491:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40efc2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40efc9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.807509:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635352.807513:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d054139c600/0xb0c3a59caa40efb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40efbb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.807518:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d054139c600 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:1.0:1789635352.807521:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d054139c600/0xb0c3a59caa40efb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40efbb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.807528:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d054139c600/0xb0c3a59caa40efb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40efbb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789635352.807534:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d054139c600/0xb0c3a59caa40efb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40efbb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635352.807540:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789635352.807556:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d054139c600/0xb0c3a59caa40efb4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40efbb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.807563:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789635352.807571:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d054139c600/0xb0c3a59caa40efb4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40efbb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.807578:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d054139c600/0xb0c3a59caa40efb4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40efbb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.807587:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635352.807590:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635352.807592:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635352.807635:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635352.807658:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427311232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789635352.807692:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635352.807729:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789635352.807734:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427311360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789635352.807753:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635352.807782:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427311232 00000100:00100000:1.0:1789635352.807789:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427311232 00010000:00010000:1.0:1789635352.807813:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d056e1a3000/0xb0c3a59caa40efc9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40efc2 expref: 24 pid: 6506 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635352.807899:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427311360 00000100:00100000:1.0:1789635352.807904:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427311360 00010000:00010000:1.0:1789635352.807916:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d056e1a2c00/0xb0c3a59caa40efbb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40efb4 expref: 25 pid: 6508 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635352.807935:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789635352.807942:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+25:3640:x1876568427311232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789635352.807952:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635352.807958:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d056e1a3000/0xb0c3a59caa40efc9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40efc2 expref: 25 pid: 6506 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.807967:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d056e1a3000/0xb0c3a59caa40efc9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40efc2 expref: 25 pid: 6506 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.807984:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635352.808024:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+25:3640:x1876568427311232:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635352.808030:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789635352.808075:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541326300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+3:13187:x1876568427310720:12345-0@lo:104: 00010000:00010000:3.0:1789635352.808085:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3a00/0xb0c3a59caa40efd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40efd7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635352.808134:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789635352.808140:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541326300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+3:13187:x1876568427310720:12345-0@lo:104: Request processed in 69us (6625us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635352.808146:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:3.0:1789635352.808166:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635352.808170:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3a00/0xb0c3a59caa40efd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40efd7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635352.808177:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3a00 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:3.0:1789635352.808181:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3a00/0xb0c3a59caa40efd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40efd7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635352.808187:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3a00/0xb0c3a59caa40efd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40efd7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789635352.808193:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3a00/0xb0c3a59caa40efd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40efd7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635352.808197:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 10000000:01000000:3.0:1789635352.808199:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1789635352.808204:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3640:x1876568427311360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789635352.808216:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635352.808217:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3a00/0xb0c3a59caa40efd0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40efd7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.808221:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d056e1a2c00/0xb0c3a59caa40efbb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40efb4 expref: 24 pid: 6508 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635352.808223:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789635352.808228:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d056e1a2c00/0xb0c3a59caa40efbb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40efb4 expref: 24 pid: 6508 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635352.808231:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3a00/0xb0c3a59caa40efd0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40efd7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635352.808237:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3a00/0xb0c3a59caa40efd0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40efd7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.808238:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635352.808259:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3640:x1876568427311360:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (505us total) trans 0 rc 0/0 00010000:00010000:3.0:1789635352.808260:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635352.808261:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635352.808263:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635352.808264:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789635352.808302:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427311360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789635352.808310:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427311232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789635352.808339:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635352.808373:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789635352.808379:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427311488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789635352.808401:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635352.808780:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427311104 00000100:00100000:3.0:1789635352.808785:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427311104 00010000:00010000:3.0:1789635352.808801:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d056e1a3600/0xb0c3a59caa40efe5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40efde expref: 24 pid: 6506 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635352.808819:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427311488 00000100:00100000:3.0:1789635352.808822:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427311488 00010000:00010000:3.0:1789635352.808831:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40efd7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40efd0 expref: 25 pid: 6509 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635352.808847:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789635352.808853:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+25:3643:x1876568427311104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789635352.808860:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635352.808863:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d056e1a3600/0xb0c3a59caa40efe5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40efde expref: 25 pid: 6506 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635352.808871:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d056e1a3600/0xb0c3a59caa40efe5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40efde expref: 25 pid: 6506 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635352.808882:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056e1a3600/0xb0c3a59caa40efe5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40efde expref: 25 pid: 6506 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635352.808891:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635352.808948:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789635352.808957:0:7457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3643:x1876568427311488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789635352.808965:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635352.808970:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40efd7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40efd0 expref: 24 pid: 6509 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635352.808978:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40efd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40efd0 expref: 24 pid: 6509 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635352.808998:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635352.812130:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635352.812233:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635352.812310:0:13187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541326a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1876568427310336:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789635352.812325:0:13187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541326d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1876568427310464:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789635352.812340:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40efd7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40efd0 expref: 24 pid: 6509 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635352.812361:0:13187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541325c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1876568427310720:0@lo:104: 00010000:00010000:0.0:1789635352.812373:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056e1a3000/0xb0c3a59caa40efc9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40efc2 expref: 23 pid: 6506 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635352.812403:0:13187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541324380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1876568427310848:0@lo:104: 00010000:00010000:0.0:1789635352.812649:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056e1a2c00/0xb0c3a59caa40efbb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40efb4 expref: 22 pid: 6508 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635352.812672:0:13187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541325180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1876568427310976:0@lo:104: 00010000:00010000:0.0:1789635352.812711:0:13187:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d056e152c00/0xb0c3a59caa40f024 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635352.813995:0:6499:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1789635352.814015:0:6499:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:3.0:1789635352.814240:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+21:3643:x1876568427311104:12345-0@lo:103:ldlm_bl.0 Request processed in 5377us (5890us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635352.814254:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789635352.814354:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411492992 00000100:00100000:1.0:1789635352.814365:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411492992 00010000:00010000:1.0:1789635352.814402:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d056f6e8800/0xb0c3a59caa40f001 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f26 expref: 13 pid: 6508 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635352.814423:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411493120 00000100:00100000:1.0:1789635352.814426:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411493120 00010000:00010000:1.0:1789635352.814436:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d054139c400/0xb0c3a59caa40efec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ee7 expref: 14 pid: 6509 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635352.814449:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 44 00000100:00100000:1.0:1789635352.814456:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447918000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd20b267-9db1-4540-8a6a-0af57c4f3581+14:2397:x1876568411492992:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635352.814468:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635352.814474:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d056f6e8800/0xb0c3a59caa40f001 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f26 expref: 14 pid: 6508 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.814490:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d056f6e8800/0xb0c3a59caa40f001 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f26 expref: 14 pid: 6508 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.814506:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056f6e8800/0xb0c3a59caa40f001 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f26 expref: 14 pid: 6508 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.814519:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635352.814538:0:7457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6356ed01-c755-4f9e-b839-20feb7c3f098+21:3643:x1876568427311488:12345-0@lo:103:ldlm_bl.0 Request processed in 5583us (6135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635352.814552:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789635352.814569:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 45 00000100:00100000:1.0:1789635352.814573:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447918000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2397:x1876568411492992:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 118us (2459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635352.814576:0:7457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b406850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2397:x1876568411493120:12345-192.168.203.20@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789635352.814579:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 44 00010000:00010000:2.0:1789635352.814584:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635352.814588:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d054139c400/0xb0c3a59caa40efec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ee7 expref: 12 pid: 6509 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635352.814611:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d054139c400/0xb0c3a59caa40efec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ee7 expref: 12 pid: 6509 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635352.814621:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d054139c400/0xb0c3a59caa40efec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ee7 expref: 12 pid: 6509 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635352.814631:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d056e152c00/0xb0c3a59caa40f024 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635352.814639:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e152c00/0xb0c3a59caa40f024 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635352.814653:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d056e152c00/0xb0c3a59caa40f024 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635352.814659:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d056e152c00/0xb0c3a59caa40f024 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635352.814665:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d056e152c00/0xb0c3a59caa40f024 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635352.814671:0:7457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d056e152c00/0xb0c3a59caa40f024 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635352.814681:0:7457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152c00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635352.814686:0:7457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d056e152c00/0xb0c3a59caa40f024 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635352.814694:0:7457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d056e152c00/0xb0c3a59caa40f024 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635352.814709:0:7457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d056e152c00/0xb0c3a59caa40f024 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635352.814720:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635352.814741:0:7457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b406850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd20b267-9db1-4540-8a6a-0af57c4f3581+11:2397:x1876568411493120:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 166us (2508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635352.814749:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 45 00000100:00100000:3.0:1789635352.815493:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427311488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789635352.815506:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427311104:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789635352.815724:0:13187:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d056e152c00/0xb0c3a59caa40f024 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.815733:0:13187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d056e152c00/0xb0c3a59caa40f024 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635352.815740:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056e152c00/0xb0c3a59caa40f024 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635353.764303:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789635354.019873:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789635354.019884:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0577690000 from 7 10000000:01000000:1.0:1789635354.019890:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000100:00100000:2.0:1789635354.019949:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427311616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789635354.020050:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635354.020120:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427311616 00000100:00100000:2.0:1789635354.020129:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427311616 00000100:00100000:2.0:1789635354.020193:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789635354.020216:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447918380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427311872:0@lo:400:kworker.0 00000100:00100000:0.0:1789635354.020255:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635354.020286:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427312384:0@lo:400:kworker.0 00000100:00100000:0.0:1789635354.020311:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635354.020329:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427312896:0@lo:400:kworker.0 00000100:00100000:0.0:1789635354.020352:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635354.020361:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427311616:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789635354.020370:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789635354.020375:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044791ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427312000:0@lo:400:kworker.0 00000100:00100000:0.0:1789635354.020395:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635354.020412:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427312512:0@lo:400:kworker.0 00000100:00100000:0.0:1789635354.020431:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635354.020446:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427313024:0@lo:400:kworker.0 00000100:00100000:0.0:1789635354.020465:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1789635354.020468:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635354.020494:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427312384 00000100:00100000:0.0:1789635354.020498:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427312384 00000100:00100000:2.0:1789635354.020513:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427311616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 312us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635354.020520:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789635354.020532:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427312000 00000100:00100000:0.0:1789635354.020535:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427312000 00000100:00080000:2.0:1789635354.020543:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789635354.020547:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427312512 00000100:00100000:0.0:1789635354.020549:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427312512 00000100:00100000:2.0:1789635354.020561:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427311872 00000100:00100000:2.0:1789635354.020563:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427311872 00000100:00100000:0.0:1789635354.020565:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427313024 00000100:00100000:0.0:1789635354.020567:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427313024 00000100:00100000:2.0:1789635354.020612:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1789635354.020614:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789635354.020619:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0565a09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+20:3640:x1876568427311872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635354.020620:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447bf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427312384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635354.020655:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0565a09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+20:3640:x1876568427311872:12345-0@lo:400:kworker.0 Request processed in 37us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635354.020662:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1789635354.020691:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789635354.020698:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427312000:12345-0@lo:400:kworker.0 00010000:00010000:1.0:1789635354.020799:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152c00/0xb0c3a59caa40f02b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635354.020825:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447bf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427312384:12345-0@lo:400:kworker.0 Request processed in 204us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635354.020832:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789635354.020845:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789635354.020852:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427312512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635354.020880:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427312512:12345-0@lo:400:kworker.0 Request processed in 29us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635354.020885:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789635354.020895:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789635354.020900:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447bfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427313024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635354.020921:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447bfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427313024:12345-0@lo:400:kworker.0 Request processed in 22us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635354.020937:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789635354.021016:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427312128:0@lo:400:kworker.0 00000100:00100000:0.0:1789635354.021044:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635354.021064:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427312640:0@lo:400:kworker.0 00000100:00100000:0.0:1789635354.021084:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635354.021098:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447bf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1876568427313152:0@lo:400:kworker.0 00000100:00100000:0.0:1789635354.021129:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635354.021146:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789635354.021152:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427312256:0@lo:400:kworker.0 00000100:00100000:0.0:1789635354.021171:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635354.021292:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541326a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427312768:0@lo:400:kworker.0 00000100:00100000:0.0:1789635354.021314:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635354.021331:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447bf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427313280:0@lo:400:kworker.0 00000100:00100000:0.0:1789635354.021352:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635354.021377:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427312128 00000100:00100000:0.0:1789635354.021381:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427312128 00000100:00100000:0.0:1789635354.021406:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427312256 00000100:00100000:0.0:1789635354.021409:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427312256 00000100:00100000:0.0:1789635354.021422:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789635354.021429:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427312128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635354.021468:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427312128:12345-0@lo:400:kworker.0 Request processed in 40us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635354.021474:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789635354.021486:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789635354.021492:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447bfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427312256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635354.021520:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447bfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427312256:12345-0@lo:400:kworker.0 Request processed in 28us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635354.021526:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789635354.021544:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427312896 00000100:00100000:0.0:1789635354.021547:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427312896 00000100:00100000:0.0:1789635354.021570:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427312768 00000100:00100000:0.0:1789635354.022053:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427312768 00000100:00100000:0.0:1789635354.022075:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427313280 00000100:00100000:0.0:1789635354.022086:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427313280 00000100:00100000:0.0:1789635354.022106:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789635354.022113:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447bfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427312896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635354.022151:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447bfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427312896:12345-0@lo:400:kworker.0 Request processed in 39us (1798us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635354.022157:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789635354.022169:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789635354.022174:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447bf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427312768:12345-0@lo:400:kworker.0 00010000:00010000:1.0:1789635354.022327:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056e152c00/0xb0c3a59caa40f02b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635354.022340:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056e152c00/0xb0c3a59caa40f02b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635354.022367:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427311744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789635354.022402:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635354.022431:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d056e1e4f00 going to sleep for 11 seconds 00010000:00080000:1.0:1789635354.022469:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447a3f480 x1876568427311616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635354.022491:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427311616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635354.022530:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427312640 00000100:00100000:1.0:1789635354.022535:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427312640 00000100:00100000:1.0:1789635354.022561:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427313152 00000100:00100000:1.0:1789635354.022564:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427313152 00000100:00100000:1.0:1789635354.022672:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789635354.022679:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447bfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427312640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635354.022714:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447bfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427312640:12345-0@lo:400:kworker.0 Request processed in 37us (1629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635354.022721:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789635354.022734:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789635354.022740:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876568427313152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635354.022765:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876568427313152:12345-0@lo:400:kworker.0 Request processed in 26us (1635us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635354.022771:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789635354.022817:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427312256:0@lo:400:kworker.0 00000100:00100000:1.0:1789635354.022829:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427312128:0@lo:400:kworker.0 00010000:00080000:1.0:1789635354.022840:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0541326d80 x1876568427312640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635354.022863:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427312640:0@lo:400:kworker.0 00010000:00080000:1.0:1789635354.022875:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447bf8e00 x1876568427313152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635354.022884:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447bf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1876568427313152:0@lo:400:kworker.0 00000100:00100000:1.0:1789635354.022934:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789635354.022942:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447bfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427313280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635354.023139:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447bf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427312768:12345-0@lo:400:kworker.0 Request processed in 965us (1824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635354.023147:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789635354.023478:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427312000:12345-0@lo:400:kworker.0 Request processed in 2779us (3079us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635354.023486:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789635354.023517:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427311744 00000100:00100000:2.0:1789635354.023521:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427311744 00000100:00100000:2.0:1789635354.023549:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1789635354.023555:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0565a09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+20:6512:x1876568427311744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635354.023564:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635354.023584:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056e1a3e00/0xb0c3a59caa40f032 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40f02b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635354.023626:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e1a3e00/0xb0c3a59caa40f032 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40f02b expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635354.023639:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056e1a3e00/0xb0c3a59caa40f032 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40f02b expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635354.023649:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a3e00, rc 0) 00000100:00100000:2.0:1789635354.023681:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0565a09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+21:6512:x1876568427311744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (1278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635354.023687:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00010000:00080000:0.0:1789635354.023707:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0541326a00 x1876568427312768/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635354.023720:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541326a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427312768:0@lo:400:kworker.0 00000100:00080000:2.0:1789635354.023729:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789635354.023734:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789635354.023737:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789635354.023739:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635354.023759:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427311744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635354.023774:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056e152c00/0xb0c3a59caa40f02b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40f032 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635354.023783:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056e152c00/0xb0c3a59caa40f02b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40f032 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635354.023857:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a3c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427313536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635354.023887:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635354.023917:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d04414553c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635354.024038:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427313408:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789635354.024067:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635354.024078:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427313536 00000100:00100000:0.0:1789635354.024082:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427313536 00000100:00100000:2.0:1789635354.024099:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044791ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427312000:0@lo:400:kworker.0 00000100:00100000:0.0:1789635354.024103:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1789635354.024108:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0565a0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+21:6512:x1876568427313536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635354.024112:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427312512:0@lo:400:kworker.0 00000100:00100000:2.0:1789635354.024124:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427313024:0@lo:400:kworker.0 00000100:00100000:2.0:1789635354.024132:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447918380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427311872:0@lo:400:kworker.0 00000100:00100000:2.0:1789635354.024143:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427312384:0@lo:400:kworker.0 00010000:00080000:2.0:1789635354.024153:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0541324a80 x1876568427312896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635354.024161:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427312896:0@lo:400:kworker.0 00000100:00100000:1.0:1789635354.024329:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447bfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427313280:12345-0@lo:400:kworker.0 Request processed in 1387us (2975us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635354.024338:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:1.0:1789635354.024364:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447bf8000 x1876568427313280/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635354.024373:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447bf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427313280:0@lo:400:kworker.0 00000100:00100000:0.0:1789635354.025547:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0565a0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+21:6512:x1876568427313536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1432us (1653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635354.025559:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1789635354.026529:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a3c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427313536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635354.026578:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427313408 00000100:00100000:2.0:1789635354.026587:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427313408 00000100:00100000:2.0:1789635354.026665:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789635354.026675:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427313408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789635354.026701:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635354.026761:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427313408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (2693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635354.026768:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:0.0:1789635354.027337:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05759c9180 x1876568427313408/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635354.027360:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427313408:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789635354.028255:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427313664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789635354.028346:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635354.028391:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446cbca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789635354.030319:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427313664 00000100:00100000:1.0:1789635354.030336:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427313664 00000100:00100000:1.0:1789635354.030415:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1789635354.030425:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+21:6512:x1876568427313664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789635354.030640:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+21:6512:x1876568427313664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 216us (2294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635354.030648:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1789635354.031401:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427313664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789635354.032451:0:13205:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789635354.032893:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789635354.032923:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789635354.032938:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152c00/0xb0c3a59caa40f02b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40f032 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635354.032968:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e152c00/0xb0c3a59caa40f02b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40f032 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635354.032989:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789635354.032992:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d056f7ce800 from 7 10000000:01000000:1.0:1789635354.032996:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789635354.033039:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40f039 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635354.033049:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40f039 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635354.033062:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40f039 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635354.033091:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427313792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789635354.033170:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635354.033228:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d056e1e4900 going to sleep for 11 seconds 00000100:00100000:0.0:1789635354.034089:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427313792 00000100:00100000:0.0:1789635354.034101:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427313792 00000100:00100000:0.0:1789635354.034160:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1789635354.034170:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+21:6512:x1876568427313792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789635354.034197:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635354.034215:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056f6e8400/0xb0c3a59caa40f040 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40f039 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635354.034245:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056f6e8400/0xb0c3a59caa40f040 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40f039 expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635354.034258:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056f6e8400/0xb0c3a59caa40f040 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40f039 expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635354.034268:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056f6e8400, rc 0) 00000100:00100000:0.0:1789635354.034335:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+22:6512:x1876568427313792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635354.034343:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1789635354.034446:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427313792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789635354.034466:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40f039 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40f040 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635354.034476:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40f039 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40f040 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635354.034556:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427313920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635354.034591:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635354.034646:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0565a289c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635354.034709:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427313920 00000100:00100000:0.0:1789635354.034714:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427313920 00000100:00100000:0.0:1789635354.034748:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1789635354.034755:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+22:6512:x1876568427313920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789635354.034877:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+22:6512:x1876568427313920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635354.034908:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1789635354.035349:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427313920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635354.035384:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427314048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789635354.035440:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635354.035467:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0565a289c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635354.035551:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427314048 00000100:00100000:1.0:1789635354.035557:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427314048 00000100:00100000:0.0:1789635354.035788:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1789635354.035797:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+22:6512:x1876568427314048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789635354.035902:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+22:6512:x1876568427314048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635354.035909:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1789635354.036157:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427314048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789635354.049750:0:13206:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789635354.052202:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789635354.052289:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789635354.052306:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40f039 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40f040 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635354.052320:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40f039 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40f040 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635354.052589:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789635354.052611:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0550107000 from 7 10000000:01000000:0.0:1789635354.052616:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789635354.052670:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9a00/0xb0c3a59caa40f047 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635354.052680:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9a00/0xb0c3a59caa40f047 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635354.052692:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9a00/0xb0c3a59caa40f047 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635354.052725:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447bf9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427314176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789635354.052811:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635354.052859:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446cbcb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789635354.056229:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427314176 00000100:00100000:1.0:1789635354.056276:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427314176 00000100:00100000:1.0:1789635354.056360:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1789635354.056373:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+22:6512:x1876568427314176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789635354.056395:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635354.056419:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056e152800/0xb0c3a59caa40f04e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40f047 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635354.056457:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e152800/0xb0c3a59caa40f04e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40f047 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635354.056473:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056e152800/0xb0c3a59caa40f04e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40f047 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635354.056484:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e152800, rc 0) 00000100:00100000:1.0:1789635354.056588:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+23:6512:x1876568427314176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 218us (3777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635354.056615:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1789635354.056789:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447bf9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427314176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789635354.056810:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9a00/0xb0c3a59caa40f047 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40f04e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635354.056821:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9a00/0xb0c3a59caa40f047 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40f04e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635354.056920:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447bf9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427314304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789635354.056955:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635354.056995:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446cbcb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789635354.057289:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427314304 00000100:00100000:1.0:1789635354.057296:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427314304 00000100:00100000:1.0:1789635354.057331:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1789635354.057339:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+23:6512:x1876568427314304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635354.057468:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+23:6512:x1876568427314304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635354.057476:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1789635354.057578:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447bf9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427314304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789635354.057630:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447bf9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427314432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789635354.057673:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635354.057692:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446cbcb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789635354.057702:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427314432 00000100:00100000:0.0:1789635354.057706:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427314432 00000100:00100000:0.0:1789635354.057726:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1789635354.057732:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+23:6512:x1876568427314432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789635354.057802:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+23:6512:x1876568427314432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635354.057821:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1789635354.057856:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447bf9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427314432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789635354.060005:0:13207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789635354.060187:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789635354.060366:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789635354.060380:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9a00/0xb0c3a59caa40f047 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40f04e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635354.060404:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9a00/0xb0c3a59caa40f047 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40f04e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635354.060418:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789635354.060421:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0558960000 from 7 10000000:01000000:1.0:1789635354.060424:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789635354.060464:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e153200/0xb0c3a59caa40f055 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635354.060472:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056e153200/0xb0c3a59caa40f055 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635354.060483:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056e153200/0xb0c3a59caa40f055 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635354.060508:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427314560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789635354.060578:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635354.060643:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d056e1e4900 going to sleep for 11 seconds 00000100:00100000:0.0:1789635354.068060:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427314560 00000100:00100000:0.0:1789635354.068082:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427314560 00000100:00100000:0.0:1789635354.068150:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1789635354.068161:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+23:6512:x1876568427314560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789635354.068183:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635354.068210:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40f05c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40f055 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635354.068263:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40f05c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40f055 expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635354.068276:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40f05c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40f055 expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635354.068287:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056f6e9000, rc 0) 00000100:00100000:0.0:1789635354.068391:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:6512:x1876568427314560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 231us (7812us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635354.068399:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1789635354.072455:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427314560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635354.072494:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056e153200/0xb0c3a59caa40f055 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40f05c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635354.072509:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056e153200/0xb0c3a59caa40f055 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40f05c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635354.072666:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a3c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427314688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635354.072748:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635354.072790:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0441455a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789635354.072901:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427314688 00000100:00100000:1.0:1789635354.072910:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427314688 00000100:00100000:1.0:1789635354.072965:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1789635354.072987:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:6512:x1876568427314688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635354.073149:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:6512:x1876568427314688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 173us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635354.073157:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1789635354.075768:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a3c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427314688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635354.075847:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a3c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427314816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789635354.075944:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635354.076137:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0441455a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789635354.076175:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427314816 00000100:00100000:1.0:1789635354.076184:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427314816 00000100:00100000:1.0:1789635354.076258:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1789635354.076284:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+24:6512:x1876568427314816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789635354.076412:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+24:6512:x1876568427314816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635354.076422:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1789635354.076663:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a3c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427314816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789635354.097172:0:13208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789635354.097390:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789635354.097436:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789635354.097451:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e153200/0xb0c3a59caa40f055 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40f05c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635354.097465:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e153200/0xb0c3a59caa40f055 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40f05c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635354.233119:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635354.233222:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411493248 00000100:00100000:0.0:1789635354.233232:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411493248 00000100:00100000:0.0:1789635354.233294:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 336 00000100:00100000:0.0:1789635354.233303:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+11:6165:x1876568411493248:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789635354.233320:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635354.233337:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056f6e8600/0xb0c3a59caa40f063 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73f57 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635354.233387:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056f6e8600/0xb0c3a59caa40f063 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f57 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635354.233397:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056f6e8600/0xb0c3a59caa40f063 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f57 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635354.233406:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056f6e8600, rc 0) 00000100:00100000:0.0:1789635354.233451:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+12:6165:x1876568411493248:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 Request processed in 149us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635354.233457:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 336 00000100:00100000:0.0:1789635354.235773:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635354.235847:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411493376 00000100:00100000:1.0:1789635354.235855:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411493376 00000100:00100000:1.0:1789635354.235905:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 337 00000100:00100000:1.0:1789635354.235915:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+12:6165:x1876568411493376:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635354.237260:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+12:6165:x1876568411493376:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 Request processed in 1342us (1490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635354.237271:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 337 00000100:00100000:0.0:1789635354.243357:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635354.243401:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411493504 00000100:00100000:1.0:1789635354.243412:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411493504 00000100:00100000:1.0:1789635354.243471:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 338 00000100:00100000:1.0:1789635354.243481:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+12:6165:x1876568411493504:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789635354.243616:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+12:6165:x1876568411493504:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 Request processed in 136us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635354.243624:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 338 00000100:00100000:2.0:1789635354.251782:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635354.251871:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411493632 00000100:00100000:1.0:1789635354.251884:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411493632 00000100:00100000:1.0:1789635354.251952:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 339 00000100:00100000:1.0:1789635354.251962:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+12:6165:x1876568411493632:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789635354.251991:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635354.252009:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056e152a00/0xb0c3a59caa40f06a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73f5e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635354.252062:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e152a00/0xb0c3a59caa40f06a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f5e expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635354.252073:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056e152a00/0xb0c3a59caa40f06a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f5e expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635354.252083:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e152a00, rc 0) 00000100:00100000:1.0:1789635354.252135:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:6165:x1876568411493632:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 Request processed in 175us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635354.252141:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 339 00000100:00100000:0.0:1789635354.257224:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635354.257362:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411493760 00000100:00100000:1.0:1789635354.257372:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411493760 00000100:00100000:1.0:1789635354.257428:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 340 00000100:00100000:1.0:1789635354.257438:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b817c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:6165:x1876568411493760:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635354.257573:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b817c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:6165:x1876568411493760:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 Request processed in 136us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635354.257580:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 340 00000100:00100000:3.0:1789635354.259787:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635354.259968:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411493888 00000100:00100000:2.0:1789635354.259989:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411493888 00000100:00100000:2.0:1789635354.260272:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 341 00000100:00100000:2.0:1789635354.260282:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:6165:x1876568411493888:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789635354.260404:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:6165:x1876568411493888:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 Request processed in 123us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635354.260411:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 341 00010000:00010000:1.0:1789635354.787819:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635355.045216:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789635355.045236:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427314944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635355.045297:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635355.045342:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427314944 00000100:00100000:3.0:1789635355.045349:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427314944 00000100:00100000:3.0:1789635355.045400:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789635355.045409:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427314944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789635355.045437:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635355.045484:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427314944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635355.045491:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:3.0:1789635355.045792:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05759c8380 x1876568427314944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635355.045812:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427314944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789635355.556043:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789635355.556065:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447bf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427315072:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789635355.556125:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635355.556174:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427315072 00000100:00100000:2.0:1789635355.556182:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427315072 00000100:00100000:2.0:1789635355.556226:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789635355.556234:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427315072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789635355.556256:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635355.556296:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427315072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635355.556303:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:2.0:1789635355.556343:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447bf9180 x1876568427315072/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635355.556361:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447bf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427315072:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789635355.816212:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789635356.167851:0:13387:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789635356.836874:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635357.091805:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427315200:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789635357.091873:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635357.092244:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789635357.092257:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447bf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427315328:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789635357.092284:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635357.092558:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427315200 00000100:00100000:1.0:1789635357.092566:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427315200 00000100:00100000:1.0:1789635357.092630:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427315328 00000100:00100000:1.0:1789635357.092633:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427315328 00000100:00100000:1.0:1789635357.092651:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789635357.092659:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427315200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789635357.092690:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789635357.092795:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789635357.092805:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447bf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427315328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789635357.092823:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789635357.092863:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447bf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427315328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635357.092876:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789635357.092932:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447bf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427315328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789635357.094747:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427315200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2082us (2866us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635357.094759:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789635357.094883:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427315200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789635357.122180:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635357.123380:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635357.123507:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411494016 00000100:00100000:1.0:1789635357.123517:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411494016 00000100:00100000:1.0:1789635357.123580:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 342 00000100:00100000:1.0:1789635357.123590:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2397:x1876568411494016:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789635357.123690:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2397:x1876568411494016:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 101us (1519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635357.123698:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 342 00000100:00100000:2.0:1789635357.124243:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635357.130492:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635357.130714:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411494272 00000100:00100000:0.0:1789635357.130723:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411494272 00000100:00100000:0.0:1789635357.130793:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411494528 00000100:00100000:0.0:1789635357.130797:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411494528 00000100:00100000:0.0:1789635357.130825:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 231 00000100:00100000:0.0:1789635357.130834:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2397:x1876568411494272:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635357.130899:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2397:x1876568411494272:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 67us (7524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635357.130906:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 231 00000100:00100000:0.0:1789635357.130920:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 232 00000100:00100000:0.0:1789635357.130932:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2397:x1876568411494528:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635357.130970:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2397:x1876568411494528:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 38us (6729us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635357.130976:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 232 00000100:00080000:3.0:1789635357.131001:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789635357.132774:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411494144 00000100:00100000:1.0:1789635357.132786:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411494144 00000100:00100000:2.0:1789635357.132815:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635357.132845:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411494400 00000100:00100000:1.0:1789635357.132849:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411494400 00000100:00100000:2.0:1789635357.132863:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 233 00000100:00100000:2.0:1789635357.132876:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2397:x1876568411494144:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789635357.132884:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 234 00000100:00100000:1.0:1789635357.132894:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054121b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2397:x1876568411494400:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635357.132938:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2397:x1876568411494144:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 64us (2465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635357.132939:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054121b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2397:x1876568411494400:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 45us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635357.132966:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 234 00000100:00100000:2.0:1789635357.132974:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 233 00000100:00080000:3.0:1789635357.133278:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789635357.859859:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635358.883976:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635359.140250:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427315456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789635359.140326:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635359.140362:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541219f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427315584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789635359.140403:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635359.141428:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789635359.141438:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427315712:0@lo:400:kworker.0 00000100:00100000:3.0:1789635359.141483:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635359.141540:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427315712 00000100:00100000:3.0:1789635359.141548:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427315712 00000100:00100000:3.0:1789635359.141589:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1789635359.141611:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3642:x1876568427315712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635359.141661:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3642:x1876568427315712:12345-0@lo:400:kworker.0 Request processed in 63us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635359.141681:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1789635359.141826:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427315840:0@lo:400:kworker.0 00000100:00100000:3.0:1789635359.141856:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635359.141875:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427316352:0@lo:400:kworker.0 00000100:00100000:3.0:1789635359.141894:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635359.141909:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427316864:0@lo:400:kworker.0 00000100:00100000:3.0:1789635359.141927:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635359.141958:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789635359.141964:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427315968:0@lo:400:kworker.0 00000100:00100000:3.0:1789635359.141986:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635359.142003:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1876568427316480:0@lo:400:kworker.0 00000100:00100000:3.0:1789635359.142023:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635359.142040:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1876568427316992:0@lo:400:kworker.0 00000100:00100000:1.0:1789635359.142055:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876568427316224:0@lo:400:kworker.0 00000100:00100000:3.0:1789635359.142062:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635359.142091:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427315840 00000100:00100000:3.0:1789635359.142097:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427315840 00000100:00100000:1.0:1789635359.142097:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635359.142116:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427316736:0@lo:400:kworker.0 00000100:00100000:3.0:1789635359.142123:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427316352 00000100:00100000:3.0:1789635359.142127:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427316352 00000100:00100000:1.0:1789635359.142145:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635359.142151:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427316864 00000100:00100000:3.0:1789635359.142155:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427316864 00000100:00100000:3.0:1789635359.142172:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427316480 00000100:00100000:1.0:1789635359.142174:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789635359.142175:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427316480 00000100:00100000:1.0:1789635359.142184:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427316096:0@lo:400:kworker.0 00000100:00100000:3.0:1789635359.142190:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427316992 00000100:00100000:3.0:1789635359.142205:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427316992 00000100:00100000:3.0:1789635359.142219:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427316224 00000100:00100000:3.0:1789635359.142222:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427316224 00000100:00100000:3.0:1789635359.142235:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789635359.142249:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427315840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635359.143311:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635359.143342:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427316608:0@lo:400:kworker.0 00000100:00100000:3.0:1789635359.143352:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427315840:12345-0@lo:400:kworker.0 Request processed in 1101us (1493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635359.143363:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789635359.143374:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635359.143393:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789635359.143404:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044844ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427316352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635359.143419:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789635359.143431:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044844aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427316864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635359.143451:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044844ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427316352:12345-0@lo:400:kworker.0 Request processed in 50us (1554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635359.143458:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789635359.143470:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789635359.143477:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876568427316480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635359.143656:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876568427316480:12345-0@lo:400:kworker.0 Request processed in 179us (1631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635359.143664:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044844aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427316864:12345-0@lo:400:kworker.0 Request processed in 235us (1734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635359.143665:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789635359.143676:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789635359.143682:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789635359.143689:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044844b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876568427316992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635359.143697:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789635359.143707:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876568427316224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635359.143720:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044844b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876568427316992:12345-0@lo:400:kworker.0 Request processed in 31us (1660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635359.143727:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00080000:3.0:1789635359.143749:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789635359.143755:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635359.143762:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876568427316224:12345-0@lo:400:kworker.0 Request processed in 56us (1664us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635359.143770:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00010000:00080000:3.0:1789635359.143785:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447ac3480 x1876568427316480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635359.143800:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1876568427316480:0@lo:400:kworker.0 00000100:00100000:1.0:1789635359.143800:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427316736 00000100:00100000:1.0:1789635359.143807:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427316736 00010000:00080000:3.0:1789635359.143816:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447ac0a80 x1876568427316992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635359.143837:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1876568427316992:0@lo:400:kworker.0 00000100:00100000:1.0:1789635359.143851:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427316608 00000100:00100000:3.0:1789635359.143852:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427315840:0@lo:400:kworker.0 00000100:00100000:1.0:1789635359.143856:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427316608 00000100:00100000:3.0:1789635359.143864:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427316352:0@lo:400:kworker.0 00000100:00100000:3.0:1789635359.143879:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427316864:0@lo:400:kworker.0 00000100:00100000:1.0:1789635359.143886:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789635359.143896:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427316736:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789635359.143911:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789635359.143929:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427315712:0@lo:400:kworker.0 00000100:00100000:1.0:1789635359.143935:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427316736:12345-0@lo:400:kworker.0 Request processed in 41us (1789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635359.143951:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789635359.143966:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789635359.144026:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427315968 00000100:00100000:3.0:1789635359.144031:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427315968 00000100:00100000:3.0:1789635359.144056:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427316096 00000100:00100000:3.0:1789635359.144058:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427316096 00000100:00100000:3.0:1789635359.144067:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789635359.144071:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044844b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427315968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635359.144100:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044844b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427315968:12345-0@lo:400:kworker.0 Request processed in 29us (2114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635359.144104:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789635359.144111:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789635359.144114:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427316096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635359.144129:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427316096:12345-0@lo:400:kworker.0 Request processed in 15us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635359.144133:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789635359.144152:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427315968:0@lo:400:kworker.0 00000100:00100000:3.0:1789635359.144179:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427316096:0@lo:400:kworker.0 00000100:00100000:3.0:1789635359.144197:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876568427316224:0@lo:400:kworker.0 00010000:00080000:3.0:1789635359.144204:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447ac2a00 x1876568427316736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635359.144209:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427316736:0@lo:400:kworker.0 00000100:00100000:1.0:1789635359.144249:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427316608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635359.144303:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427316608:12345-0@lo:400:kworker.0 Request processed in 331us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635359.144319:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:3.0:1789635359.144367:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447ac1f80 x1876568427316608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635359.144375:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427316608:0@lo:400:kworker.0 00000100:00100000:2.0:1789635359.147053:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427315584 00000100:00100000:0.0:1789635359.147053:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427315456 00000100:00100000:0.0:1789635359.147065:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427315456 00000100:00100000:2.0:1789635359.147125:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427315584 00000100:00080000:3.0:1789635359.147130:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789635359.147150:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789635359.147240:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789635359.147251:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427315456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789635359.147687:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635359.147876:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427315456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 625us (7547us total) trans 0 rc 0/0 00010000:00080000:3.0:1789635359.147906:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05759cb800 x1876568427315456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635359.147922:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427315456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789635359.153688:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789635359.153702:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789635359.153715:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427315584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789635359.153744:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635359.156522:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427315584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2815us (16113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635359.156536:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:3.0:1789635359.159001:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0541219f80 x1876568427315584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635359.159031:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541219f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427315584:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789635359.909236:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635360.165734:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789635360.165757:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448449f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427317120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789635360.165824:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635360.165874:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427317120 00000100:00100000:3.0:1789635360.165882:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427317120 00000100:00100000:3.0:1789635360.166011:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789635360.166020:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427317120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789635360.166049:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635360.166099:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427317120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635360.166115:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:1.0:1789635360.166383:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0448449f80 x1876568427317120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635360.166402:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448449f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427317120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635360.678354:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789635360.678379:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447bfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427317248:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789635360.678446:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635360.678712:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427317248 00000100:00100000:2.0:1789635360.678721:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427317248 00000100:00100000:2.0:1789635360.678774:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789635360.678785:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427317248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789635360.678805:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635360.678871:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427317248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635360.678877:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:0.0:1789635360.678970:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447bfb800 x1876568427317248/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635360.678990:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447bfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427317248:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789635360.931833:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635361.955798:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789635362.154182:0:13535:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 04:56:00 (1789635360) === 00000100:00100000:3.0:1789635362.212332:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d054121aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427317376:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789635362.212471:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635362.212591:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427317376 00000100:00100000:2.0:1789635362.212628:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427317376 00000100:00100000:2.0:1789635362.212681:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789635362.212691:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044844a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427317376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789635362.212726:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789635362.212774:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044844a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427317376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635362.212781:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789635362.212904:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d054121aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427317376:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789635362.215446:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447bfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427317504:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789635362.215581:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635362.217436:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427317504 00000100:00100000:2.0:1789635362.217447:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427317504 00000100:00100000:2.0:1789635362.217568:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789635362.217579:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448449500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427317504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789635362.217984:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789635362.218285:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448449500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427317504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 707us (2702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635362.218293:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789635362.218542:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447bfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427317504:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789635362.235488:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635362.235538:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635362.235572:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635362.235629:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635362.235657:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635362.235683:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411494912 00000100:00100000:0.0:1789635362.235693:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411494912 00000100:00100000:0.0:1789635362.235745:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411495168 00000100:00100000:0.0:1789635362.235759:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411495168 00000100:00100000:0.0:1789635362.235777:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411494784 00000100:00100000:0.0:1789635362.235780:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411494784 00000100:00100000:0.0:1789635362.235792:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411495040 00000100:00100000:0.0:1789635362.235795:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411495040 00000100:00100000:0.0:1789635362.235812:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 241 00000100:00100000:0.0:1789635362.235821:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447bfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411494912:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635362.235892:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447bfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411494912:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 71us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635362.235900:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 241 00000100:00100000:0.0:1789635362.235929:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 242 00000100:00100000:0.0:1789635362.235936:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447bf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2399:x1876568411495168:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635362.235963:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447bf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2399:x1876568411495168:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 27us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635362.235968:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 242 00000100:00100000:0.0:1789635362.235980:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 243 00000100:00100000:0.0:1789635362.235986:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447bf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2399:x1876568411494784:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635362.236024:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447bf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2399:x1876568411494784:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 38us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635362.236030:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 243 00000100:00100000:0.0:1789635362.236041:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 244 00000100:00100000:0.0:1789635362.236059:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447bf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2399:x1876568411495040:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635362.236084:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447bf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2399:x1876568411495040:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 37us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635362.236089:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 244 00000100:00100000:3.0:1789635362.237182:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411494656 00000100:00100000:3.0:1789635362.237191:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411494656 00000100:00100000:3.0:1789635362.237240:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 344 00000100:00100000:3.0:1789635362.237249:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2399:x1876568411494656:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635362.237305:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2399:x1876568411494656:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 58us (1826us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635362.237312:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 344 00000100:00080000:3.0:1789635362.237343:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789635362.237348:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789635362.369019:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635362.369083:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635362.369180:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411495296 00000100:00100000:3.0:1789635362.369191:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411495296 00000100:00100000:3.0:1789635362.369246:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:3.0:1789635362.369257:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2398:x1876568411495296:12345-192.168.203.20@tcp:41:mkdir.0 00000004:00000024:3.0:1789635362.369305:0:10094:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789635362.369386:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2398:x1876568411495296:12345-192.168.203.20@tcp:41:mkdir.0 Request processed in 131us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635362.369394:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:2.0:1789635362.376149:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411495424 00000100:00100000:2.0:1789635362.376162:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411495424 00000100:00100000:2.0:1789635362.376228:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:2.0:1789635362.376239:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04478ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:10494:x1876568411495424:12345-192.168.203.20@tcp:700:mkdir.0 00000100:00100000:2.0:1789635362.376329:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04478ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:10494:x1876568411495424:12345-192.168.203.20@tcp:700:mkdir.0 Request processed in 91us (7245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635362.376337:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:3.0:1789635362.382930:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635362.382973:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411495680 00000100:00100000:3.0:1789635362.382982:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411495680 00000100:00100000:3.0:1789635362.383035:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:3.0:1789635362.383047:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:10494:x1876568411495680:12345-192.168.203.20@tcp:36:mkdir.0 00010000:00010000:3.0:1789635362.383100:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635362.383421:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3200/0xb0c3a59caa40ef13 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ed2 expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.383440:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d044766d100) 00010000:00010000:3.0:1789635362.383454:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789635362.383521:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f071 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.383531:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f071 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.383538:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f071 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.384174:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d000/0xb0c3a59caa40f078 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.384487:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d000/0xb0c3a59caa40f078 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.384510:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d000/0xb0c3a59caa40f078 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.385158:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f07f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.385168:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f07f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.385175:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f07f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789635362.385191:0:9526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d6c7cac5 reply state 0000000012d5f941 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f07f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.385202:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f07f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.385209:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d044764ba00) 00010000:00010000:3.0:1789635362.385212:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789635362.385215:0:9526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789635362.385220:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789635362.385227:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f071 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.385233:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f071 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.385239:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f071 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.385246:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d054139d200 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635362.385256:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f071 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.385264:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f071 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.385274:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d044764b600) 00010000:00010000:3.0:1789635362.385277:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635362.385280:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f071 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.385286:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f071 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789635362.385302:0:9526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d6c7cac5 reply state 0000000012d5f941 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d000/0xb0c3a59caa40f078 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.385311:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d000/0xb0c3a59caa40f078 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.385316:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d044764b400) 00010000:00010000:3.0:1789635362.385318:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789635362.385320:0:9526:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789635362.385409:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:10494:x1876568411495680:12345-192.168.203.20@tcp:36:mkdir.0 Request processed in 2362us (2556us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789635362.385418:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:0.0:1789635362.401754:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635362.402956:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411495808 00000100:00100000:2.0:1789635362.402984:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411495808 00000100:00100000:2.0:1789635362.403330:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:2.0:1789635362.403342:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04478ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:10495:x1876568411495808:12345-192.168.203.20@tcp:101:chmod.0 00010000:00010000:2.0:1789635362.403365:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635362.403389:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f086 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73f65 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635362.403557:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f08d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635362.403572:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f08d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635362.403585:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f08d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635362.403659:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789635362.403663:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789635362.403699:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f08d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635362.403726:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f086 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f65 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635362.403744:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f08d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f65 expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635362.403752:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d056f407200) 00010000:00010000:2.0:1789635362.403756:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789635362.403759:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a2600, rc 0) 00000100:00100000:2.0:1789635362.403829:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04478ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:10495:x1876568411495808:12345-192.168.203.20@tcp:101:chmod.0 Request processed in 489us (2085us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635362.403837:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:2.0:1789635362.418325:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635362.419250:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411496064 00000100:00100000:0.0:1789635362.419261:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411496064 00000100:00100000:0.0:1789635362.419328:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:0.0:1789635362.419338:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054121ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:10495:x1876568411496064:12345-192.168.203.20@tcp:36:chmod.0 00010000:00010000:0.0:1789635362.419391:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635362.419416:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f08d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f65 expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.419437:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d056f407200) 00010000:00010000:0.0:1789635362.419449:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789635362.419473:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40f094 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.419485:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40f094 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.419495:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40f094 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789635362.419700:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bc5bd87f reply state 0000000082d40863 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40f094 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.419714:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40f094 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.419721:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0447667e00) 00010000:00010000:0.0:1789635362.419723:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789635362.419733:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789635362.419740:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789635362.419817:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054121ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+9:10495:x1876568411496064:12345-192.168.203.20@tcp:36:chmod.0 Request processed in 479us (1500us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789635362.419825:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:0.0:1789635362.486037:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635362.486163:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411496192 00000100:00100000:3.0:1789635362.486172:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411496192 00000100:00100000:3.0:1789635362.486230:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 26 00000100:00100000:3.0:1789635362.486239:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04478efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+9:10496:x1876568411496192:12345-192.168.203.20@tcp:101:chown.0 00010000:00010000:3.0:1789635362.486264:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635362.486295:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f09b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73f6c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.486359:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c400/0xb0c3a59caa40f0a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.486372:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c400/0xb0c3a59caa40f0a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.486382:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c400/0xb0c3a59caa40f0a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635362.486424:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789635362.486429:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789635362.486480:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c400/0xb0c3a59caa40f0a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.486516:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f09b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f6c expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.486542:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c400/0xb0c3a59caa40f0a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f6c expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.486550:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0447667e00) 00010000:00010000:3.0:1789635362.486552:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789635362.486556:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d054139c400, rc 0) 00000100:00100000:3.0:1789635362.486867:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04478efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+10:10496:x1876568411496192:12345-192.168.203.20@tcp:101:chown.0 Request processed in 628us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635362.486874:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 26 00000100:00100000:2.0:1789635362.498873:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635362.499371:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411496320 00000100:00100000:3.0:1789635362.499394:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411496320 00000100:00100000:3.0:1789635362.499457:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:3.0:1789635362.499786:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+10:10496:x1876568411496320:12345-192.168.203.20@tcp:101:chown.0 00010000:00010000:3.0:1789635362.499806:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635362.499827:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f0a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73f73 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.499900:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f0b0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.499923:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f0b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.499935:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f0b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.499947:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f0b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.499955:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f0b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.499961:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f0b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.500176:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139de00/0xb0c3a59caa40f0be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.500186:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139de00/0xb0c3a59caa40f0be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.500193:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139de00/0xb0c3a59caa40f0be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635362.500238:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789635362.500241:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789635362.500259:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139de00/0xb0c3a59caa40f0be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.500270:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f0b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.500277:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f0b0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.500284:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f0b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.500290:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d054139c600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635362.500305:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f0b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.500313:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f0b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.500329:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0447667e00) 00010000:00010000:3.0:1789635362.500333:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635362.500337:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f0b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.500343:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f0b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.500706:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f0b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.500726:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f0b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.500733:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f0b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.500739:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d054139c000 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635362.500742:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f0b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.500750:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f0b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.500760:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d044764b400) 00010000:00010000:3.0:1789635362.500762:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635362.500766:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f0b7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.500772:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f0b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.500800:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f0a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f73 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.500815:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139de00/0xb0c3a59caa40f0be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f73 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.500822:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d044764ba00) 00010000:00010000:3.0:1789635362.500824:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789635362.500832:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d054139de00, rc 0) 00000100:00100000:3.0:1789635362.500903:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+11:10496:x1876568411496320:12345-192.168.203.20@tcp:101:chown.0 Request processed in 1236us (2050us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635362.500918:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:2.0:1789635362.507196:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635362.507646:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411496448 00000100:00100000:0.0:1789635362.507657:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411496448 00000100:00100000:0.0:1789635362.507864:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:0.0:1789635362.507876:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054121b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+11:10496:x1876568411496448:12345-192.168.203.20@tcp:900:chown.0 00000100:00100000:0.0:1789635362.507978:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054121b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+11:10496:x1876568411496448:12345-192.168.203.20@tcp:900:chown.0 Request processed in 104us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635362.507986:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:0.0:1789635362.513184:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635362.514872:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411496704 00000100:00100000:3.0:1789635362.514884:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411496704 00000100:00100000:3.0:1789635362.514962:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:3.0:1789635362.514976:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04478ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+11:10496:x1876568411496704:12345-192.168.203.20@tcp:36:chown.0 00010000:00010000:3.0:1789635362.515038:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635362.515062:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139de00/0xb0c3a59caa40f0be lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f73 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.515081:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d044764ba00) 00010000:00010000:3.0:1789635362.515086:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789635362.515106:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f0c5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.515118:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f0c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.515128:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f0c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789635362.518127:0:6493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:1.0:1789635362.518236:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d000/0xb0c3a59caa40f078 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.518249:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d000/0xb0c3a59caa40f078 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.518256:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d000/0xb0c3a59caa40f078 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.518263:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d054139d000 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635362.518268:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d000/0xb0c3a59caa40f078 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.518276:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d000/0xb0c3a59caa40f078 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.518294:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d044764b400) 00010000:00010000:1.0:1789635362.518297:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635362.518302:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d000/0xb0c3a59caa40f078 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.518321:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d000/0xb0c3a59caa40f078 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.518356:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f07f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.518363:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f07f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.518369:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f07f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.518374:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d054139cc00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635362.518377:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f07f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.518383:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f07f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.518392:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d044764ba00) 00010000:00010000:1.0:1789635362.518395:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635362.518397:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f07f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.518403:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f07f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.518416:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40f094 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.518421:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40f094 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.518433:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40f094 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.518438:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1a800 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635362.518441:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40f094 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.518447:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40f094 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.518455:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0447667e00) 00010000:00010000:1.0:1789635362.518458:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789635362.518461:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40f094 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.518467:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40f094 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789635362.518823:0:9526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac8e49be reply state 000000007ba84493 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f0c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.518839:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f0c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.518923:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d044764ba00) 00010000:00010000:3.0:1789635362.518933:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789635362.518937:0:9526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789635362.518949:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1789635362.519935:0:9526:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1789635362.519959:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04478ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:10496:x1876568411496704:12345-192.168.203.20@tcp:36:chown.0 Request processed in 4983us (6780us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789635362.519968:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 28 00010000:00010000:1.0:1789635362.520112:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f0c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.520122:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f0c5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.520127:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f0c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.520132:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056f6e8800 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635362.520136:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f0c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.520154:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f0c5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.520167:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d044764ba00) 00010000:00010000:1.0:1789635362.520169:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789635362.520172:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f0c5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.520178:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f0c5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635362.566513:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635362.568973:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411496832 00000100:00100000:0.0:1789635362.568988:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411496832 00000100:00100000:0.0:1789635362.569074:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:0.0:1789635362.569086:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448449180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:10497:x1876568411496832:12345-192.168.203.20@tcp:101:touch.500 00010000:00010000:0.0:1789635362.569108:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635362.569127:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ae00/0xb0c3a59caa40f0cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73f7a expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789635362.572346:0:10094:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3170us 00010000:00010000:3.0:1789635362.597383:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f0d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.597404:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f0d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.597415:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f0d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.597444:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f0da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.597452:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f0da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.597468:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f0da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.597592:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d000/0xb0c3a59caa40f0e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.597626:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d000/0xb0c3a59caa40f0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.597634:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d000/0xb0c3a59caa40f0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635362.597673:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789635362.597683:0:10094:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789635362.597722:0:10094:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d000/0xb0c3a59caa40f0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.597735:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f0d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.597742:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f0d3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.597749:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f0d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.597755:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056f6e8800 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635362.597759:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f0d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.597767:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f0d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.597779:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0447667e00) 00010000:00010000:3.0:1789635362.597781:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635362.597786:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f0d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.597792:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f0d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.597804:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f0da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.597810:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f0da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.597827:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f0da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.597832:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d054139cc00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635362.597835:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f0da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.597841:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f0da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.597863:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d044764b600) 00010000:00010000:3.0:1789635362.597866:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635362.597869:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f0da lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.597875:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f0da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.597924:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ae00/0xb0c3a59caa40f0cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f7a expref: 8 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.597940:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d000/0xb0c3a59caa40f0e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f7a expref: 7 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.597947:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d044764be00) 00010000:00010000:3.0:1789635362.597949:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789635362.597951:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d054139d000, rc 0) 00000100:00100000:3.0:1789635362.598269:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448449180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:10497:x1876568411496832:12345-192.168.203.20@tcp:101:touch.500 Request processed in 29184us (31763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635362.598286:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:0.0:1789635362.604820:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635362.604859:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411497088 00000100:00100000:3.0:1789635362.604868:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411497088 00000100:00100000:3.0:1789635362.604969:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:3.0:1789635362.604980:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04478ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:10497:x1876568411497088:12345-192.168.203.20@tcp:101:touch.500 00010000:00010000:3.0:1789635362.605000:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635362.605018:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139de00/0xb0c3a59caa40f0e8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73f81 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.605123:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f0ef lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.605133:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f0ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.605152:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f0ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.605162:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f0f6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x4003f5df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.605167:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f0f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.605171:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f0f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789635362.605508:0:6516:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:3.0:1789635362.605658:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f0fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.605672:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f0fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.605679:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f0fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.605713:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f0ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.605720:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f0ef lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.605726:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f0ef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.605732:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d054139d200 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635362.605736:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f0ef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.605744:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f0ef lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.605755:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d044764be00) 00010000:00010000:3.0:1789635362.605758:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635362.605763:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f0ef lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.605769:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f0ef lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789635362.605782:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb4a56b2 reply state 0000000091595cb2 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f0f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.605799:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f0f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.605805:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4003f5df (ffff8d044764b500) 00010000:00010000:3.0:1789635362.605808:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789635362.605811:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789635362.605839:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139de00/0xb0c3a59caa40f0e8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f81 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.605853:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f0fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f81 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.605860:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d044764bd00) 00010000:00010000:3.0:1789635362.605862:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789635362.605864:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d054139c600, rc 0) 00000100:00100000:3.0:1789635362.605936:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04478ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+10:10497:x1876568411497088:12345-192.168.203.20@tcp:101:touch.500 Request processed in 958us (1122us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789635362.605975:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:2.0:1789635362.609769:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635362.609879:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411497344 00000100:00100000:0.0:1789635362.609888:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411497344 00000100:00100000:0.0:1789635362.609951:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 31 00000100:00100000:0.0:1789635362.609962:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+10:10497:x1876568411497344:12345-192.168.203.20@tcp:36:touch.500 00010000:00010000:0.0:1789635362.610032:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635362.610057:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f0fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f81 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.610075:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d044764bd00) 00010000:00010000:0.0:1789635362.610085:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789635362.610580:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a000/0xb0c3a59caa40f10b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.610623:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a000/0xb0c3a59caa40f10b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.610635:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a000/0xb0c3a59caa40f10b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789635362.610808:0:9526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006dd21c05 reply state 00000000e18fb989 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a000/0xb0c3a59caa40f10b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.610822:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a000/0xb0c3a59caa40f10b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.610829:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d0447667700) 00010000:00010000:0.0:1789635362.610833:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789635362.610836:0:9526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789635362.610937:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+11:10497:x1876568411497344:12345-192.168.203.20@tcp:36:touch.500 Request processed in 971us (1169us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789635362.610948:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 31 00000100:00100000:2.0:1789635362.614567:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635362.614982:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411497472 00000100:00100000:3.0:1789635362.614992:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411497472 00000100:00100000:3.0:1789635362.615050:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 32 00000100:00100000:3.0:1789635362.615061:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054121a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+11:10497:x1876568411497472:12345-192.168.203.20@tcp:101:touch.500 00010000:00010000:3.0:1789635362.615085:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635362.615102:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139de00/0xb0c3a59caa40f112 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73f88 expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.615167:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139de00/0xb0c3a59caa40f112 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f88 expref: 12 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.615196:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139de00/0xb0c3a59caa40f112 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f88 expref: 12 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.615215:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d0447667700) 00010000:00010000:3.0:1789635362.615219:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789635362.615222:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d054139de00, rc 0) 00000100:00100000:3.0:1789635362.615289:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054121a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+12:10497:x1876568411497472:12345-192.168.203.20@tcp:101:touch.500 Request processed in 229us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635362.615303:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 32 00000100:00100000:1.0:1789635362.619879:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635362.619942:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411497600 00000100:00100000:3.0:1789635362.619952:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411497600 00000100:00100000:3.0:1789635362.620001:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:3.0:1789635362.620009:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2395:x1876568411497600:12345-192.168.203.20@tcp:8:touch.500 00010000:00080000:3.0:1789635362.620043:0:8432:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 6e1c17f2-a595-4ed0-97c8-b9260d0850ab@192.168.203.20@tcp t0 exp 0000000000000000 cur 381 last 0 00000020:00000080:3.0:1789635362.620077:0:8432:0:(genops.c:1384:class_connect()) connect: client 6e1c17f2-a595-4ed0-97c8-b9260d0850ab, cookie 0xb0c3a59caa40f119 00002000:00100000:3.0:1789635362.620099:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6e1c17f2-a595-4ed0-97c8-b9260d0850ab/ffff8d04478c1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789635362.620117:0:8432:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789635362.620179:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789635362.620204:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8d04478c3000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789635362.620266:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2395:x1876568411497600:12345-192.168.203.20@tcp:8:touch.500 Request processed in 258us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635362.620274:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:2.0:1789635362.622827:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635362.622924:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411497728 00000100:00100000:1.0:1789635362.622933:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411497728 00000100:00080000:3.0:1789635362.623050:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789635362.623094:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:1.0:1789635362.623107:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:0:x1876568411497728:12345-192.168.203.20@tcp:2:touch.500 00000001:00080000:0.0:1789635362.635981:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:0.0:1789635362.635995:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e1c17f2-a595-4ed0-97c8-b9260d0850ab 00000100:00100000:1.0:1789635362.636195:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:0:x1876568411497728:12345-192.168.203.20@tcp:2:touch.500 Request processed in 13086us (13372us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789635362.636206:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:2.0:1789635362.644097:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635362.644256:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411497984 00000100:00100000:3.0:1789635362.644274:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411497984 00000100:00100000:3.0:1789635362.644528:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:3.0:1789635362.644539:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054121a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+12:10497:x1876568411497984:12345-192.168.203.20@tcp:35:touch.500 00000100:00100000:3.0:1789635362.644836:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054121a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+13:10497:x1876568411497984:12345-192.168.203.20@tcp:35:touch.500 Request processed in 299us (748us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789635362.644844:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:0.0:1789635362.674422:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635362.675254:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411498112 00000100:00100000:3.0:1789635362.675266:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411498112 00000100:00100000:3.0:1789635362.675335:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:3.0:1789635362.675347:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04478ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+13:10498:x1876568411498112:12345-192.168.203.20@tcp:101:rm.0 00010000:00010000:3.0:1789635362.675371:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635362.675390:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f120 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73f8f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.675453:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f127 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.675468:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f127 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.675479:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f127 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635362.675529:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789635362.675533:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789635362.675769:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f127 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.675796:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f120 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f8f expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.675824:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f127 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f8f expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.675833:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d044764be00) 00010000:00010000:3.0:1789635362.675836:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789635362.675839:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d054139cc00, rc 0) 00000100:00100000:3.0:1789635362.675895:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04478ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+14:10498:x1876568411498112:12345-192.168.203.20@tcp:101:rm.0 Request processed in 552us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635362.675902:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:0.0:1789635362.682058:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635362.682121:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411498368 00000100:00100000:2.0:1789635362.682131:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411498368 00000100:00100000:2.0:1789635362.682200:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 34 00000100:00100000:2.0:1789635362.682212:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04478ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+14:10498:x1876568411498368:12345-192.168.203.20@tcp:101:rm.0 00010000:00010000:2.0:1789635362.682235:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635362.682255:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40f12e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73f96 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635362.682352:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789635362.682715:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40f12e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f96 expref: 16 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635362.682731:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0447667e00) 00010000:00010000:2.0:1789635362.682740:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789635362.682746:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40f12e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f96 expref: 16 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635362.682759:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a3400, rc 0) 00000100:00100000:2.0:1789635362.682816:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04478ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+15:10498:x1876568411498368:12345-192.168.203.20@tcp:101:rm.0 Request processed in 607us (766us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1789635362.682824:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 34 00000100:00100000:2.0:1789635362.688258:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635362.688330:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411498496 00000100:00100000:0.0:1789635362.688340:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411498496 00000100:00100000:0.0:1789635362.688402:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:0.0:1789635362.688412:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+15:10498:x1876568411498496:12345-192.168.203.20@tcp:37:rm.0 00000100:00100000:2.0:1789635362.693435:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+15:10498:x1876568411498496:12345-192.168.203.20@tcp:37:rm.0 Request processed in 5014us (5176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635362.693450:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:2.0:1789635362.697655:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635362.697822:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411498752 00000100:00100000:3.0:1789635362.697832:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411498752 00000100:00100000:3.0:1789635362.697884:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:3.0:1789635362.697894:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae2a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+15:10498:x1876568411498752:12345-192.168.203.20@tcp:35:rm.0 00000100:00100000:3.0:1789635362.698185:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae2a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+16:10498:x1876568411498752:12345-192.168.203.20@tcp:35:rm.0 Request processed in 291us (538us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789635362.698193:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:3.0:1789635362.701433:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635362.701577:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411499008 00000100:00100000:0.0:1789635362.701586:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411499008 00000100:00100000:0.0:1789635362.701679:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 35 00000100:00100000:1.0:1789635362.701827:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044844a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+16:10498:x1876568411499008:12345-192.168.203.20@tcp:101:rm.0 00010000:00010000:1.0:1789635362.701853:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635362.701874:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40f13c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73f9d expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.702000:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152000/0xb0c3a59caa40f143 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.702034:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152000/0xb0c3a59caa40f143 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.702045:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152000/0xb0c3a59caa40f143 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635362.702058:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789635362.702159:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40f13c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f9d expref: 19 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.702178:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152000/0xb0c3a59caa40f143 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f9d expref: 18 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.702184:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d044764be00) 00010000:00010000:1.0:1789635362.702186:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789635362.702188:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e152000, rc 0) 00000100:00100000:1.0:1789635362.702257:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044844a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+18:10498:x1876568411499008:12345-192.168.203.20@tcp:101:rm.0 Request processed in 567us (833us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789635362.702264:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 35 00000100:00100000:0.0:1789635362.708496:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635362.711497:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411499136 00000100:00100000:3.0:1789635362.711512:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411499136 00000100:00100000:3.0:1789635362.711671:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 36 00000100:00100000:3.0:1789635362.711682:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04478ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+18:10498:x1876568411499136:12345-192.168.203.20@tcp:41:rm.0 00000004:00000024:3.0:1789635362.711739:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:3.0:1789635362.711820:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04478ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+18:10498:x1876568411499136:12345-192.168.203.20@tcp:41:rm.0 Request processed in 140us (3333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635362.711843:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 36 00000100:00100000:2.0:1789635362.716655:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635362.719036:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411499264 00000100:00100000:0.0:1789635362.719050:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411499264 00000100:00100000:0.0:1789635362.719154:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 37 00000100:00100000:0.0:1789635362.719166:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+18:10498:x1876568411499264:12345-192.168.203.20@tcp:101:rm.0 00010000:00010000:0.0:1789635362.719187:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635362.719207:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b800/0xb0c3a59caa40f151 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73fa4 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.719279:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f158 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.719294:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f158 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.719304:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f158 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.719314:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f15f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x4003f5df bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.719321:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f15f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.719340:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f15f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.719436:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1be00/0xb0c3a59caa40f166 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.719445:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1be00/0xb0c3a59caa40f166 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.719451:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1be00/0xb0c3a59caa40f166 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635362.719483:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789635362.719487:0:9526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789635362.719506:0:9526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1be00/0xb0c3a59caa40f166 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.719518:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1be00/0xb0c3a59caa40f166 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.719526:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f158 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.719532:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f158 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.719538:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f158 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.719544:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1b400 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635362.719548:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f158 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.719561:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f158 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.719572:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d044764be00) 00010000:00010000:0.0:1789635362.719575:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635362.719580:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f158 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.719586:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f158 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.719634:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f15f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.719641:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f15f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.719648:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f15f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.719653:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1b600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635362.719656:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f15f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.719661:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f15f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.719669:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4003f5df (ffff8d044764b500) 00010000:00010000:0.0:1789635362.719672:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635362.719675:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f15f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.719691:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f15f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.719719:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b800/0xb0c3a59caa40f151 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fa4 expref: 20 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.719731:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1be00/0xb0c3a59caa40f166 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fa4 expref: 19 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635362.719738:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d0447667700) 00010000:00010000:0.0:1789635362.719740:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789635362.719743:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1be00, rc 0) 00000100:00100000:0.0:1789635362.719815:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+19:10498:x1876568411499264:12345-192.168.203.20@tcp:101:rm.0 Request processed in 652us (3170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635362.719823:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 37 00000100:00100000:2.0:1789635362.728407:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635362.728527:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411499520 00000100:00100000:1.0:1789635362.728536:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411499520 00000100:00100000:1.0:1789635362.728628:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 38 00000100:00100000:1.0:1789635362.728639:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+19:10498:x1876568411499520:12345-192.168.203.20@tcp:36:rm.0 00010000:00010000:1.0:1789635362.728693:0:10094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789635362.728719:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1be00/0xb0c3a59caa40f166 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fa4 expref: 19 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.728764:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139de00/0xb0c3a59caa40f112 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f88 expref: 18 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.728778:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d0447667700) 00010000:00010000:1.0:1789635362.728789:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f127 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f8f expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.728798:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d044764be00) 00010000:00010000:1.0:1789635362.728801:0:10094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789635362.728821:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f16d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.728833:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f16d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.728843:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f16d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.728854:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40f174 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x4003f5df bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.728862:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40f174 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.728868:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40f174 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.728963:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f17b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.728981:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f17b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.728988:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f17b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789635362.729189:0:10094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1789635362.729199:0:10094:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 381412602711ns, next at 382412600488ns, rc = 0 00010000:00010000:1.0:1789635362.729241:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153e00/0xb0c3a59caa40f182 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.729251:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153e00/0xb0c3a59caa40f182 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.729259:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153e00/0xb0c3a59caa40f182 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.729266:0:10094:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153e00/0xb0c3a59caa40f182 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.729273:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153e00/0xb0c3a59caa40f182 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.729279:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153e00/0xb0c3a59caa40f182 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.729476:0:10094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789635362.729496:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f17b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.729503:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f17b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.729516:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f17b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.729523:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e153000 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635362.729526:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f17b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.729534:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f17b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.729543:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d0447667700) 00010000:00010000:1.0:1789635362.729546:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789635362.729549:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f17b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.729554:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f17b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.729569:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f16d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.729575:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f16d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.729580:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f16d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.729586:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152e00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635362.729589:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f16d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.729654:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f16d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.729662:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d044764be00) 00010000:00010000:1.0:1789635362.729665:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635362.729668:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f16d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.729673:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f16d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789635362.729683:0:10094:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fc356670 reply state 0000000007ad370e transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40f174 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.729693:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40f174 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635362.729699:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4003f5df (ffff8d044764b500) 00010000:00010000:1.0:1789635362.729702:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789635362.729705:0:10094:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789635362.729778:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+18:10498:x1876568411499520:12345-192.168.203.20@tcp:36:rm.0 Request processed in 1140us (1379us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789635362.729786:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 38 00010000:00010000:3.0:1789635362.732652:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635362.732665:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153e00/0xb0c3a59caa40f182 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.732677:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e153e00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:3.0:1789635362.732682:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153e00/0xb0c3a59caa40f182 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.732691:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153e00/0xb0c3a59caa40f182 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.732708:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d0447667700) 00010000:00010000:3.0:1789635362.732711:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789635362.732717:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153e00/0xb0c3a59caa40f182 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.732722:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153e00/0xb0c3a59caa40f182 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.732736:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635362.732738:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635362.732740:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635362.737011:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635362.737076:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411499776 00000100:00100000:3.0:1789635362.737085:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411499776 00000100:00100000:3.0:1789635362.737136:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:3.0:1789635362.737146:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+18:10498:x1876568411499776:12345-192.168.203.20@tcp:35:rm.0 00000100:00100000:3.0:1789635362.737779:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+19:10498:x1876568411499776:12345-192.168.203.20@tcp:35:rm.0 Request processed in 631us (772us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789635362.737802:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:1.0:1789635362.749727:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635362.749937:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411500032 00000100:00100000:3.0:1789635362.749955:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411500032 00000100:00100000:3.0:1789635362.750015:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 39 00000100:00100000:3.0:1789635362.750025:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+19:10498:x1876568411500032:12345-192.168.203.20@tcp:36:rm.0 00010000:00010000:3.0:1789635362.750080:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789635362.750106:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152000/0xb0c3a59caa40f143 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f9d expref: 19 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.750128:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d000/0xb0c3a59caa40f0e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f7a expref: 18 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.750140:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d044764be00) 00010000:00010000:3.0:1789635362.750156:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c400/0xb0c3a59caa40f0a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f6c expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.750164:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0447667e00) 00010000:00010000:3.0:1789635362.750169:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789635362.750190:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f189 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.750203:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f189 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.750213:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f189 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.750227:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f190 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.750259:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f190 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.750266:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f190 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.750341:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139de00/0xb0c3a59caa40f197 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.750349:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139de00/0xb0c3a59caa40f197 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.750356:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139de00/0xb0c3a59caa40f197 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635362.750574:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789635362.750588:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139de00/0xb0c3a59caa40f197 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.750654:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139de00/0xb0c3a59caa40f197 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.750662:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139de00/0xb0c3a59caa40f197 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.750669:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d054139de00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635362.750673:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139de00/0xb0c3a59caa40f197 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.750681:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139de00/0xb0c3a59caa40f197 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.750702:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d044764b000) 00010000:00010000:3.0:1789635362.750705:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789635362.750709:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139de00/0xb0c3a59caa40f197 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.750716:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139de00/0xb0c3a59caa40f197 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.750734:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f189 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.750741:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f189 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.750746:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f189 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.750751:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d054139d200 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635362.750754:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f189 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.750760:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f189 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.750766:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d044764b600) 00010000:00010000:3.0:1789635362.750768:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635362.750770:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f189 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.750775:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139d200/0xb0c3a59caa40f189 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789635362.750797:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a44d9557 reply state 000000008662e825 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f190 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.750808:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f190 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635362.750814:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d044764b700) 00010000:00010000:3.0:1789635362.750817:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789635362.750819:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789635362.750885:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+18:10498:x1876568411500032:12345-192.168.203.20@tcp:36:rm.0 Request processed in 861us (1167us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789635362.750893:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 39 00010000:00010000:1.0:1789635362.980430:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635364.005620:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635364.260009:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876568427317760:0@lo:400:kworker.0 00000100:00100000:3.0:1789635364.260073:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635364.260126:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1876568427318272:0@lo:400:kworker.0 00000100:00100000:3.0:1789635364.260148:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635364.260177:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1876568427318784:0@lo:400:kworker.0 00000100:00100000:3.0:1789635364.260199:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635364.260228:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1789635364.260234:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448449f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427317632:0@lo:400:kworker.0 00000100:00100000:3.0:1789635364.260261:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635364.260285:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876568427318144:0@lo:400:kworker.0 00000100:00100000:3.0:1789635364.260306:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635364.260323:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427318656:0@lo:400:kworker.0 00000100:00100000:3.0:1789635364.260345:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635364.260375:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d057b599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427319168:0@lo:400:kworker.0 00000100:00100000:3.0:1789635364.260398:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635364.260425:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427317888:0@lo:400:kworker.0 00000100:00100000:3.0:1789635364.260448:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635364.260464:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1876568427318400:0@lo:400:kworker.0 00000100:00100000:3.0:1789635364.260484:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635364.260499:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1876568427318912:0@lo:400:kworker.0 00000100:00100000:3.0:1789635364.260518:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635364.260531:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789635364.260536:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427318016:0@lo:400:kworker.0 00000100:00100000:3.0:1789635364.260556:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635364.260573:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427318528:0@lo:400:kworker.0 00000100:00100000:3.0:1789635364.260630:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635364.260647:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427319040:0@lo:400:kworker.0 00000100:00100000:3.0:1789635364.260670:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635364.260701:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427317760 00000100:00100000:3.0:1789635364.260709:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427317760 00000100:00100000:3.0:1789635364.260743:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427318272 00000100:00100000:3.0:1789635364.260747:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427318272 00000100:00100000:3.0:1789635364.260769:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427318784 00000100:00100000:3.0:1789635364.260773:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427318784 00000100:00100000:3.0:1789635364.260784:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427318144 00000100:00100000:3.0:1789635364.260787:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427318144 00000100:00100000:3.0:1789635364.260795:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427318400 00000100:00100000:3.0:1789635364.260798:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427318400 00000100:00100000:3.0:1789635364.260808:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427318912 00000100:00100000:3.0:1789635364.260811:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427318912 00000100:00100000:3.0:1789635364.260826:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789635364.260841:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876568427317760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635364.260891:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876568427317760:12345-0@lo:400:kworker.0 Request processed in 51us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635364.260912:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789635364.260931:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789635364.260938:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b59b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876568427318272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635364.260966:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b59b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876568427318272:12345-0@lo:400:kworker.0 Request processed in 30us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635364.260972:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789635364.260984:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789635364.260990:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876568427318784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635364.261015:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876568427318784:12345-0@lo:400:kworker.0 Request processed in 26us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635364.261020:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789635364.261030:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1789635364.261034:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876568427318144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635364.261058:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876568427318144:12345-0@lo:400:kworker.0 Request processed in 23us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635364.261064:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1789635364.261074:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789635364.261080:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876568427318400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635364.261109:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876568427318400:12345-0@lo:400:kworker.0 Request processed in 29us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635364.261114:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789635364.261125:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1789635364.261136:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876568427318912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635364.261164:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876568427318912:12345-0@lo:400:kworker.0 Request processed in 28us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635364.261169:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1789635364.261196:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427317632 00000100:00100000:3.0:1789635364.261200:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427317632 00000100:00100000:3.0:1789635364.261222:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1789635364.261228:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3643:x1876568427317632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635364.261256:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3643:x1876568427317632:12345-0@lo:400:kworker.0 Request processed in 28us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635364.261262:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1789635364.261290:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427318656 00000100:00100000:3.0:1789635364.261294:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427318656 00000100:00100000:3.0:1789635364.261312:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427319168 00000100:00100000:3.0:1789635364.261314:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427319168 00000100:00100000:3.0:1789635364.261323:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427318528 00000100:00100000:3.0:1789635364.261325:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427318528 00000100:00100000:3.0:1789635364.261337:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427319040 00000100:00100000:3.0:1789635364.261339:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427319040 00000100:00100000:3.0:1789635364.261349:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789635364.261354:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447974a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427318656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635364.261380:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447974a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427318656:12345-0@lo:400:kworker.0 Request processed in 26us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635364.261386:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789635364.261394:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789635364.261399:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427319168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635364.261422:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427319168:12345-0@lo:400:kworker.0 Request processed in 22us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635364.261433:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789635364.261444:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789635364.261449:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427318528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635364.261477:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427318528:12345-0@lo:400:kworker.0 Request processed in 27us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635364.261483:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789635364.261492:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789635364.261498:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427319040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635364.261522:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427319040:12345-0@lo:400:kworker.0 Request processed in 24us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635364.261527:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789635364.261547:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427317888 00000100:00100000:3.0:1789635364.261551:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427317888 00000100:00100000:3.0:1789635364.261572:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427318016 00000100:00100000:3.0:1789635364.261575:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427318016 00000100:00100000:3.0:1789635364.261586:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789635364.261591:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427317888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635364.261639:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427317888:12345-0@lo:400:kworker.0 Request processed in 48us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635364.261645:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789635364.261656:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789635364.261662:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427318016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635364.261686:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427318016:12345-0@lo:400:kworker.0 Request processed in 24us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635364.261691:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000004:00080000:3.0:1789635364.261762:0:9895:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 382945164819ns, next at 383945162220ns, rc = 0 00000100:00080000:3.0:1789635364.261807:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789635364.261811:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789635364.261814:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789635364.261816:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635364.261827:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789635364.261837:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427319424:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789635364.261869:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635364.261913:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427319424 00000100:00100000:3.0:1789635364.261917:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427319424 00000100:00100000:3.0:1789635364.261942:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789635364.261949:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427319424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789635364.261963:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635364.261997:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427319424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635364.262004:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:3.0:1789635364.262032:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04467b9f80 x1876568427319424/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635364.262049:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427319424:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789635364.262077:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427318016:0@lo:400:kworker.0 00010000:00080000:3.0:1789635364.262088:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447a87480 x1876568427318528/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635364.262096:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427318528:0@lo:400:kworker.0 00010000:00080000:3.0:1789635364.262105:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04477a9f80 x1876568427319040/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635364.262112:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427319040:0@lo:400:kworker.0 00000100:00100000:3.0:1789635364.262130:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427317888:0@lo:400:kworker.0 00010000:00080000:3.0:1789635364.262140:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447a85c00 x1876568427318400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635364.262146:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1876568427318400:0@lo:400:kworker.0 00010000:00080000:3.0:1789635364.262155:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04477aaa00 x1876568427318912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635364.262162:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1876568427318912:0@lo:400:kworker.0 00000100:00100000:3.0:1789635364.262191:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427319296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789635364.262214:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635364.262236:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448449f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427317632:0@lo:400:kworker.0 00000100:00100000:3.0:1789635364.262246:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876568427318144:0@lo:400:kworker.0 00010000:00080000:3.0:1789635364.262256:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447a86d80 x1876568427318656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635364.262263:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427318656:0@lo:400:kworker.0 00010000:00080000:3.0:1789635364.262272:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d057b599880 x1876568427319168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635364.262279:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d057b599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427319168:0@lo:400:kworker.0 00000100:00100000:3.0:1789635364.262289:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876568427317760:0@lo:400:kworker.0 00000100:00100000:3.0:1789635364.262297:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1876568427318272:0@lo:400:kworker.0 00000100:00100000:3.0:1789635364.262306:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1876568427318784:0@lo:400:kworker.0 00000100:00100000:3.0:1789635364.262346:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427319296 00000100:00100000:3.0:1789635364.262350:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427319296 00000100:00100000:3.0:1789635364.262371:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789635364.262377:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044782a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427319296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789635364.262388:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635364.262418:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044782a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427319296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635364.262424:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:3.0:1789635364.262446:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04467bad80 x1876568427319296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635364.262456:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427319296:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789635365.028072:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635365.283751:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427319552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789635365.283828:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635365.283872:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427319552 00000100:00100000:2.0:1789635365.283881:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427319552 00000100:00100000:2.0:1789635365.283940:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789635365.283948:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427319552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789635365.283974:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635365.285064:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427319552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1114us (1234us total) trans 0 rc 0/0 00010000:00080000:1.0:1789635365.285068:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447828a80 x1876568427319552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635365.285075:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789635365.285092:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427319552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635365.795838:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789635365.795862:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04478edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427319680:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789635365.795938:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635365.796319:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427319680 00000100:00100000:2.0:1789635365.796328:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427319680 00000100:00100000:2.0:1789635365.797608:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789635365.797627:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447829c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427319680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789635365.797674:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635365.797774:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447829c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427319680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 154us (1835us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635365.797781:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:0.0:1789635365.797878:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04478edf80 x1876568427319680/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635365.797914:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04478edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427319680:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789635366.054059:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789635366.851494:0:13683:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1789635367.076011:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635367.335513:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789635367.335534:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427319808:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789635367.335616:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635367.337502:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427319936:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789635367.337558:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635367.337640:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427319808 00000100:00100000:1.0:1789635367.337647:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427319808 00000100:00100000:1.0:1789635367.337689:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427319936 00000100:00100000:1.0:1789635367.337692:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427319936 00000100:00100000:1.0:1789635367.337708:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789635367.337716:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427319808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789635367.337748:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789635367.337792:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427319808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (2176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635367.337799:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789635367.337813:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789635367.337819:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427319936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789635367.337834:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789635367.337862:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427319936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 44us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635367.337868:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789635367.337921:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427319808:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789635367.337970:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427319936:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789635367.361226:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635367.361271:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635367.361303:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635367.361328:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635367.361350:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635367.361373:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635367.361408:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411500160 00000100:00100000:1.0:1789635367.361419:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411500160 00000100:00100000:1.0:1789635367.361466:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 346 00000100:00100000:1.0:1789635367.361477:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2398:x1876568411500160:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789635367.361546:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2398:x1876568411500160:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 71us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635367.361553:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 346 00000100:00100000:2.0:1789635367.362128:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411500544 00000100:00100000:2.0:1789635367.362134:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411500544 00000100:00100000:2.0:1789635367.362177:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 97 00000100:00100000:2.0:1789635367.362186:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411500544:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635367.362218:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411500544:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 35us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635367.362223:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 97 00000100:00100000:0.0:1789635367.362748:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411500288 00000100:00100000:0.0:1789635367.362754:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411500288 00000100:00100000:0.0:1789635367.362796:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411500800 00000100:00100000:0.0:1789635367.362799:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411500800 00000100:00100000:0.0:1789635367.362812:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411500416 00000100:00100000:0.0:1789635367.362815:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411500416 00000100:00100000:0.0:1789635367.362828:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411500672 00000100:00100000:0.0:1789635367.362845:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411500672 00000100:00100000:0.0:1789635367.362862:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 251 00000100:00100000:0.0:1789635367.362869:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+18:2398:x1876568411500288:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635367.362972:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+18:2398:x1876568411500288:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 102us (1756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635367.362979:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 251 00000100:00100000:0.0:1789635367.362992:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 252 00000100:00100000:0.0:1789635367.362999:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411500800:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635367.363024:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411500800:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 26us (1720us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635367.363030:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 252 00000100:00100000:0.0:1789635367.363041:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 253 00000100:00100000:0.0:1789635367.363047:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411500416:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635367.363071:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411500416:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 24us (1721us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635367.363077:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 253 00000100:00100000:0.0:1789635367.363087:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 254 00000100:00100000:0.0:1789635367.363093:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411500672:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635367.363115:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411500672:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 22us (1742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635367.363121:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 254 00000100:00080000:3.0:1789635367.365843:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789635367.365852:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789635367.365856:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:1.0:1789635367.731457:0:13731:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe6e59a080 20000000:00000080:1.0:1789635367.731474:0:13731:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d04478f7800 uarg=0000000000000000 20000000:01000000:1.0:1789635367.731517:0:13731:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789635367.731523:0:13731:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789635367.731528:0:13731:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1789635367.731950:0:13732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1789635367.732632:0:13731:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1789635367.738233:0:13731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1789635367.738294:0:13731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1789635367.738311:0:13731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1789635367.738326:0:13731:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789635367.738346:0:13731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d054139de00/0xb0c3a59caa40f19e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635367.738364:0:13731:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d056e1a3e00/0xb0c3a59caa40f032 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40f02b expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635367.738392:0:13731:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d056f6e8400/0xb0c3a59caa40f040 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40f039 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635367.738399:0:13731:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d056e152800/0xb0c3a59caa40f04e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40f047 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635367.738405:0:13731:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40f05c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40f055 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635367.738413:0:13731:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d056f6e8600/0xb0c3a59caa40f063 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f57 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635367.738421:0:13731:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d056e152a00/0xb0c3a59caa40f06a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f5e expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635367.738427:0:13731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d054139de00/0xb0c3a59caa40f19e lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635367.738466:0:13731:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d056e152a00/0xb0c3a59caa40f06a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f5e expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635367.738481:0:13731:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d056e152a00/0xb0c3a59caa40f06a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f5e expref: 12 pid: 6509 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635367.738496:0:13731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447828a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1876568427320064:192.168.203.20@tcp:104: 00010000:00010000:3.0:1789635367.738624:0:13731:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d056f6e8600/0xb0c3a59caa40f063 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f57 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635367.738633:0:13731:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d056f6e8600/0xb0c3a59caa40f063 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f57 expref: 12 pid: 6508 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635367.738649:0:13731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d057b599880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1876568427320192:192.168.203.20@tcp:104: 00010000:00010000:3.0:1789635367.738690:0:13731:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40f05c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40f055 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635367.738697:0:13731:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40f05c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40f055 expref: 23 pid: 6508 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635367.738706:0:13731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448449f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1876568427320320:0@lo:104: 00000100:00100000:3.0:1789635367.738747:0:13731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789635367.738784:0:13731:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d056e152800/0xb0c3a59caa40f04e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40f047 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635367.738792:0:13731:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d056e152800/0xb0c3a59caa40f04e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40f047 expref: 23 pid: 6508 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635367.738801:0:13731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477aaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1876568427320448:0@lo:104: 00010000:00010000:3.0:1789635367.738827:0:13731:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d056f6e8400/0xb0c3a59caa40f040 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40f039 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635367.738829:0:10394:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1789635367.738834:0:13731:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d056f6e8400/0xb0c3a59caa40f040 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40f039 expref: 23 pid: 6508 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635367.738841:0:13731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477a9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1876568427320576:0@lo:104: 00000100:00100000:0.0:1789635367.738858:0:10394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635367.738892:0:10394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427320320 00000100:00100000:3.0:1789635367.738900:0:13731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635367.738904:0:10394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427320320 00010000:00010000:3.0:1789635367.738922:0:13731:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d056e1a3e00/0xb0c3a59caa40f032 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa40f02b expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635367.738930:0:13731:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d056e1a3e00/0xb0c3a59caa40f032 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa40f02b expref: 23 pid: 6509 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635367.738944:0:13731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a84000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1876568427320704:0@lo:104: 00000100:00100000:0.0:1789635367.738952:0:10394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427320448 00000100:00100000:0.0:1789635367.738956:0:10394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427320448 00000100:00100000:3.0:1789635367.738965:0:13731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635367.738966:0:10394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427320576 00000100:00100000:0.0:1789635367.738968:0:10394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427320576 00000100:00100000:3.0:1789635367.738975:0:13731:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0546451780 going to sleep for 11 seconds 00000100:00100000:0.0:1789635367.738977:0:10394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427320704 00000100:00100000:0.0:1789635367.738979:0:10394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427320704 00000100:00100000:0.0:1789635367.739012:0:10394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789635367.739022:0:10394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044794c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+6:13731:x1876568427320320:12345-0@lo:104: 00010000:00010000:0.0:1789635367.739034:0:10394:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d056e153200/0xb0c3a59caa40f055 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40f05c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635367.739100:0:10394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789635367.739113:0:10394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044794c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+6:13731:x1876568427320320:12345-0@lo:104: Request processed in 94us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635367.739120:0:10394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789635367.739153:0:10394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789635367.739159:0:10394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04478edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+5:13731:x1876568427320448:12345-0@lo:104: 00010000:00010000:0.0:1789635367.739166:0:10394:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9a00/0xb0c3a59caa40f047 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40f04e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635367.739215:0:10394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789635367.739221:0:10394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04478edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+5:13731:x1876568427320448:12345-0@lo:104: Request processed in 63us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635367.739226:0:10394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789635367.739238:0:10394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789635367.739244:0:10394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+4:13731:x1876568427320576:12345-0@lo:104: 00000100:00100000:1.0:1789635367.739251:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00010000:00010000:0.0:1789635367.739251:0:10394:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40f039 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40f040 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635367.739258:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+4:13731:x1876568427320704:12345-0@lo:104: 00010000:00010000:1.0:1789635367.739266:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d056e152c00/0xb0c3a59caa40f02b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40f032 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635367.739293:0:10394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789635367.739298:0:10394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6356ed01-c755-4f9e-b839-20feb7c3f098+4:13731:x1876568427320576:12345-0@lo:104: Request processed in 55us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635367.739304:0:10394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789635367.739337:0:13731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448449f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1876568427320320:0@lo:104: 00000100:00100000:3.0:1789635367.739344:0:13731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477aaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1876568427320448:0@lo:104: 00000100:00100000:3.0:1789635367.739349:0:13731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477a9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1876568427320576:0@lo:104: 00000100:00100000:3.0:1789635367.739354:0:13731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a84000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1876568427320704:0@lo:104: 00010000:00010000:1.0:1789635367.739381:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:2.0:1789635367.739384:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:1.0:1789635367.739387:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+3:13731:x1876568427320704:12345-0@lo:104: Request processed in 130us (420us total) trans 0 rc 0/0 00010000:00010000:2.0:1789635367.739393:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d056e153200/0xb0c3a59caa40f055 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40f05c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635367.739408:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:2.0:1789635367.739414:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e153200 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:2.0:1789635367.739420:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d056e153200/0xb0c3a59caa40f055 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40f05c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.739430:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056e153200/0xb0c3a59caa40f055 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40f05c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635367.739450:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789635367.739456:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9a00/0xb0c3a59caa40f047 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40f04e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635367.739463:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056f6e9a00 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:0.0:1789635367.739466:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9a00/0xb0c3a59caa40f047 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40f04e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635367.739474:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9a00/0xb0c3a59caa40f047 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40f04e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789635367.739480:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9a00/0xb0c3a59caa40f047 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40f04e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635367.739486:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789635367.739842:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9a00/0xb0c3a59caa40f047 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40f04e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635367.739851:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:2.0:1789635367.739944:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056e153200/0xb0c3a59caa40f055 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40f05c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635367.739945:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04478eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427320832:0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1789635367.739958:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789635367.739991:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d056e153200/0xb0c3a59caa40f055 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40f05c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.740000:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789635367.740001:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789635367.740007:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9a00/0xb0c3a59caa40f047 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40f04e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635367.740016:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9a00/0xb0c3a59caa40f047 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40f04e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.740033:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d056e153200/0xb0c3a59caa40f055 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40f05c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635367.740038:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789635367.740045:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056e153200/0xb0c3a59caa40f055 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40f05c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635367.740046:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40f039 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40f040 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635367.740063:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152600 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:0.0:1789635367.740066:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40f039 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40f040 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.740067:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635367.740073:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d056e152c00/0xb0c3a59caa40f02b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa40f032 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635367.740076:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40f039 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40f040 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.740086:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152c00 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:0.0:1789635367.740089:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40f039 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40f040 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789635367.740092:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d056e152c00/0xb0c3a59caa40f02b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa40f032 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635367.740103:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789635367.740107:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056e152c00/0xb0c3a59caa40f02b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa40f032 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789635367.740115:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056e152c00/0xb0c3a59caa40f02b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa40f032 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635367.740121:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789635367.740121:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40f039 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40f040 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635367.740131:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789635367.740140:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40f039 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40f040 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.740141:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d056e152c00/0xb0c3a59caa40f02b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40f032 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.740156:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789635367.740156:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40f039 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40f040 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635367.740170:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635367.740171:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635367.740173:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635367.740182:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635367.740183:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d056e152c00/0xb0c3a59caa40f02b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40f032 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.740204:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056e152c00/0xb0c3a59caa40f02b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa40f032 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.740221:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635367.740223:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635367.740224:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635367.740236:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d054121bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427320960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789635367.740265:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427320832 00000100:00100000:1.0:1789635367.740271:0:7457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427320832 00000100:00100000:2.0:1789635367.740272:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635367.740297:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1789635367.740298:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d056e152800/0xb0c3a59caa40f04e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40f047 expref: 24 pid: 6508 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635367.740305:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04478eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427321088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789635367.740328:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427320960 00000100:00100000:2.0:1789635367.740331:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635367.740345:0:7457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427320960 00000100:00100000:2.0:1789635367.740360:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427321088 00010000:00010000:1.0:1789635367.740360:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40f05c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40f055 expref: 25 pid: 6508 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635367.740366:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427321088 00010000:00010000:2.0:1789635367.740387:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d056f6e8400/0xb0c3a59caa40f040 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40f039 expref: 26 pid: 6508 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635367.740534:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789635367.740549:0:7457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6356ed01-c755-4f9e-b839-20feb7c3f098+26:3641:x1876568427320832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789635367.740564:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635367.740570:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d056e152800/0xb0c3a59caa40f04e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40f047 expref: 26 pid: 6508 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635367.740579:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d056e152800/0xb0c3a59caa40f04e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40f047 expref: 26 pid: 6508 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635367.740613:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056e152800/0xb0c3a59caa40f04e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40f047 expref: 26 pid: 6508 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635367.740625:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635367.740653:0:7457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6356ed01-c755-4f9e-b839-20feb7c3f098+25:3641:x1876568427320832:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635367.740697:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789635367.740706:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541218e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+25:3642:x1876568427320960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789635367.740714:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635367.740719:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40f05c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40f055 expref: 25 pid: 6508 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.740728:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40f05c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40f055 expref: 25 pid: 6508 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.740739:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056f6e9000/0xb0c3a59caa40f05c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40f055 expref: 25 pid: 6508 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.740757:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635367.740786:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541218e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3642:x1876568427320960:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635367.740793:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789635367.740809:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789635367.740815:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541218000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+23:3642:x1876568427321088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789635367.740823:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635367.740827:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d056f6e8400/0xb0c3a59caa40f040 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40f039 expref: 23 pid: 6508 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.740835:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d056f6e8400/0xb0c3a59caa40f040 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40f039 expref: 23 pid: 6508 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.740844:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056f6e8400/0xb0c3a59caa40f040 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40f039 expref: 23 pid: 6508 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.740852:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635367.740885:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541218000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+22:3642:x1876568427321088:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635367.740891:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789635367.740923:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04478eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427320832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789635367.740937:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789635367.740942:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d054121b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427321216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789635367.740964:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635367.740990:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04478eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427321088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789635367.740997:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d054121bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427320960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789635367.741022:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427321216 00000100:00100000:2.0:1789635367.741025:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427321216 00010000:00010000:2.0:1789635367.741037:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d056e1a3e00/0xb0c3a59caa40f032 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40f02b expref: 22 pid: 6509 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635367.741050:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789635367.741056:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054121a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+22:3641:x1876568427321216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789635367.741063:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635367.741066:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d056e1a3e00/0xb0c3a59caa40f032 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa40f02b expref: 22 pid: 6509 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.741074:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d056e1a3e00/0xb0c3a59caa40f032 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa40f02b expref: 22 pid: 6509 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.741083:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056e1a3e00/0xb0c3a59caa40f032 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa40f02b expref: 22 pid: 6509 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.741092:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635367.741118:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054121a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+21:3641:x1876568427321216:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635367.741124:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789635367.741144:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d054121b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427321216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789635367.749457:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635367.749639:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411500928 00000100:00100000:2.0:1789635367.749649:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411500928 00010000:00010000:2.0:1789635367.749684:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d056e152a00/0xb0c3a59caa40f06a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f5e expref: 13 pid: 6509 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635367.749714:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 50 00000100:00100000:2.0:1789635367.749723:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2397:x1876568411500928:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635367.749746:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635367.749753:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d056e152a00/0xb0c3a59caa40f06a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f5e expref: 13 pid: 6509 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.749764:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d056e152a00/0xb0c3a59caa40f06a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f5e expref: 13 pid: 6509 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.749783:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635367.749802:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635367.749836:0:13189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411501056 00000100:00100000:3.0:1789635367.749840:0:13189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411501056 00010000:00010000:3.0:1789635367.749860:0:13189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d056f6e8600/0xb0c3a59caa40f063 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f57 expref: 14 pid: 6508 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635367.749890:0:13189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00100000:3.0:1789635367.749942:0:13189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd20b267-9db1-4540-8a6a-0af57c4f3581+14:2397:x1876568411501056:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635367.749952:0:13189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635367.749958:0:13189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d056f6e8600/0xb0c3a59caa40f063 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f57 expref: 14 pid: 6508 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635367.749998:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00010000:3.0:1789635367.750022:0:13189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d056f6e8600/0xb0c3a59caa40f063 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f57 expref: 14 pid: 6508 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635367.750051:0:13189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d054139de00/0xb0c3a59caa40f19e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635367.750060:0:13189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d054139de00/0xb0c3a59caa40f19e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635367.750075:0:13189:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d054139de00/0xb0c3a59caa40f19e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635367.750082:0:13189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d054139de00/0xb0c3a59caa40f19e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635367.750089:0:13189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d054139de00/0xb0c3a59caa40f19e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635367.750096:0:13189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d054139de00/0xb0c3a59caa40f19e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635367.750102:0:13189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d054139de00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:3.0:1789635367.750106:0:13189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d054139de00/0xb0c3a59caa40f19e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635367.750114:0:13189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d054139de00/0xb0c3a59caa40f19e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635367.750124:0:13189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d054139de00/0xb0c3a59caa40f19e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635367.750135:0:13189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635367.750182:0:13189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd20b267-9db1-4540-8a6a-0af57c4f3581+14:2397:x1876568411501056:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 241us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635367.750199:0:13189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00100000:2.0:1789635367.750468:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2397:x1876568411500928:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 744us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635367.750484:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 50 00010000:00010000:2.0:1789635367.750646:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056e152a00/0xb0c3a59caa40f06a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f5e expref: 12 pid: 6509 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635367.750661:0:13731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447828a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1876568427320064:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789635367.750673:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056f6e8600/0xb0c3a59caa40f063 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f57 expref: 11 pid: 6508 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635367.750682:0:13731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d057b599880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1876568427320192:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789635367.750710:0:13731:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d054139de00/0xb0c3a59caa40f19e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.750719:0:13731:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d054139de00/0xb0c3a59caa40f19e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.750726:0:13731:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d054139de00/0xb0c3a59caa40f19e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.750732:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d054139de00/0xb0c3a59caa40f19e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789635367.752797:0:6493:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:1.0:1789635367.752839:0:6493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:1.0:1789635367.752860:0:6493:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:2.0:1789635367.754852:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f0f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.754866:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f0f6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.754886:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f0f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.754892:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d054139c000 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635367.754897:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f0f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.754904:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f0f6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.754923:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4003f5df (ffff8d044764b500) 00010000:00010000:2.0:1789635367.754926:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635367.754930:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f0f6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.754937:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f0f6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.754956:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a000/0xb0c3a59caa40f10b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.754962:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a000/0xb0c3a59caa40f10b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.754968:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a000/0xb0c3a59caa40f10b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.754983:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1a000 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635367.754987:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a000/0xb0c3a59caa40f10b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.754993:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a000/0xb0c3a59caa40f10b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.755001:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d0447667700) 00010000:00010000:2.0:1789635367.755003:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635367.755012:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a000/0xb0c3a59caa40f10b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.755018:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a000/0xb0c3a59caa40f10b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.755035:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40f174 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.755042:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40f174 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.755048:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40f174 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.755052:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e153a00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635367.755055:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40f174 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.755061:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40f174 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.755079:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4003f5df (ffff8d044764b500) 00010000:00010000:2.0:1789635367.755082:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635367.755085:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40f174 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.755091:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40f174 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.755106:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f190 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.755112:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f190 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.755118:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f190 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.755123:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d054139cc00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635367.755126:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f190 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.755131:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f190 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.755138:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d044764b700) 00010000:00010000:2.0:1789635367.755140:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635367.755142:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f190 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635367.755147:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f190 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635367.755177:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789635367.755199:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04478eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427321344:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789635367.755266:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635367.755390:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427321344 00000100:00100000:0.0:1789635367.755397:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427321344 00000100:00100000:0.0:1789635367.755495:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789635367.755505:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054121b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427321344:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789635367.755533:0:8431:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:0.0:1789635367.755565:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aabab22, atime: 0x6aabab22, ctime: 0x6aabab22, blocks: 0x0 00010000:00010000:0.0:1789635367.755572:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7215836/0xb0c3a59caa40f1a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635367.755587:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=386s v=(0 0) 00010000:00010000:0.0:1789635367.755591:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635367.755615:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7215836/0xb0c3a59caa40f1a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635367.755631:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7215836/0xb0c3a59caa40f1a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635367.755641:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7215836/0xb0c3a59caa40f1a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635367.755649:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7215836/0xb0c3a59caa40f1a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635367.755668:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789635367.755788:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635367.755796:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7215836/0xb0c3a59caa40f1a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635367.755805:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1a800 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:1.0:1789635367.755810:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7215836/0xb0c3a59caa40f1a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635367.755820:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054121b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1876568427321344:12345-0@lo:6:osp-syn-1-0.0 Request processed in 314us (550us total) trans 4294967301 rc 0/0 00010000:00010000:1.0:1789635367.755821:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7215836/0xb0c3a59caa40f1a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635367.755834:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1789635367.755854:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7215836/0xb0c3a59caa40f1a5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635367.755866:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7215836/0xb0c3a59caa40f1a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635367.755903:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635367.755909:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635367.755911:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789635367.755942:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789635367.755974:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d04478eca80/2, rc 0, transno 4294967301 00000100:00100000:2.0:1789635367.755981:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04478eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427321344:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789635368.100181:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789635368.381710:0:13780:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe0f5cd230 20000000:00000080:3.0:1789635368.381723:0:13780:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d044790d400 uarg=0000000000000000 20000000:01000000:3.0:1789635368.381754:0:13780:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1789635368.381758:0:13780:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1789635368.381762:0:13780:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:0.0:1789635368.382161:0:13781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1789635368.382236:0:13780:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1789635368.382303:0:13780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1789635368.382330:0:13780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1789635368.382344:0:13780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1789635368.382356:0:13780:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789635368.382375:0:13780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d054139d200/0xb0c3a59caa40f1ac lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635368.382390:0:13780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d054139d200/0xb0c3a59caa40f1ac lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635368.382400:0:13780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d054139d200/0xb0c3a59caa40f1ac lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635368.382406:0:13780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d054139d200/0xb0c3a59caa40f1ac lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635368.382413:0:13780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d054139d200/0xb0c3a59caa40f1ac lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635368.382421:0:13780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d054139d200/0xb0c3a59caa40f1ac lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635368.382427:0:13780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d054139d200 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:3.0:1789635368.382439:0:13780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d054139d200/0xb0c3a59caa40f1ac lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635368.382448:0:13780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d054139d200/0xb0c3a59caa40f1ac lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635368.382461:0:13780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d054139d200/0xb0c3a59caa40f1ac lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635368.382469:0:13780:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d054139d200/0xb0c3a59caa40f1ac lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635368.382475:0:13780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d054139d200/0xb0c3a59caa40f1ac lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635369.123876:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789635369.123885:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0577690000 from 7 10000000:01000000:1.0:1789635369.123890:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789635369.123939:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa40f1b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635369.123953:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa40f1b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635369.123993:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa40f1b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635369.124020:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427321472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789635369.124088:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635369.124134:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0551233840 going to sleep for 11 seconds 00000100:00100000:3.0:1789635369.124284:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427321472 00000100:00100000:3.0:1789635369.124292:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427321472 00000100:00100000:3.0:1789635369.124343:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1789635369.124353:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+20:6512:x1876568427321472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789635369.124366:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635369.124381:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d054139d200/0xb0c3a59caa40f1ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40f1b3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635369.124403:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d054139d200/0xb0c3a59caa40f1ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40f1b3 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635369.124412:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d054139d200/0xb0c3a59caa40f1ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40f1b3 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635369.124420:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d054139d200, rc 0) 00000100:00100000:3.0:1789635369.124463:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+21:6512:x1876568427321472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635369.124474:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1789635369.124618:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427321472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635369.124645:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa40f1b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40f1ba expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635369.124654:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa40f1b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40f1ba expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635369.124712:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d054121bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427321600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635369.124740:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635369.124768:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d054a0bd540 going to sleep for 11 seconds 00000100:00100000:3.0:1789635369.124961:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427321600 00000100:00100000:3.0:1789635369.124967:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427321600 00000100:00100000:3.0:1789635369.125005:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1789635369.125013:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+21:6512:x1876568427321600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635369.125121:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+21:6512:x1876568427321600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635369.125128:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00010000:00010000:1.0:1789635369.125381:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635369.126085:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d054121bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427321600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635369.126124:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d054121bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427321728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789635369.126174:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635369.126215:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d054a0bd540 going to sleep for 11 seconds 00000100:00100000:1.0:1789635369.126445:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427321728 00000100:00100000:1.0:1789635369.126451:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427321728 00000100:00100000:1.0:1789635369.126493:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1789635369.126501:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+21:6512:x1876568427321728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789635369.126637:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+21:6512:x1876568427321728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635369.126644:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1789635369.128929:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d054121bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427321728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789635369.133533:0:13793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d054121bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:13793:1876568427321856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789635369.133656:0:13793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635369.133706:0:13793:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d054a0bd300 going to sleep for 11 seconds 00000100:00100000:0.0:1789635369.133813:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427321856 00000100:00100000:0.0:1789635369.133822:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427321856 00000100:00100000:0.0:1789635369.133877:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1789635369.133887:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+21:13793:x1876568427321856:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789635369.134017:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+21:13793:x1876568427321856:12345-0@lo:502:llog_process_th.0 Request processed in 131us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635369.134025:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1789635369.135106:0:13793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d054121bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:13793:1876568427321856:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789635369.135148:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789635369.135158:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635369.135160:0:13793:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789635369.135167:0:13793:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d0577690000 00000020:00000080:2.0:1789635369.135170:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789635369.135228:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789635369.135231:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635369.135232:0:13793:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789635369.135235:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789635369.135237:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635369.135239:0:13793:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789635369.135242:0:13793:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d0577690000 00000020:00000080:2.0:1789635369.135244:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789635369.135278:0:13793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d054121bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:13793:1876568427321984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789635369.135456:0:13793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635369.135534:0:13793:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d054a0bd300 going to sleep for 11 seconds 00000100:00100000:3.0:1789635369.144588:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427321984 00000100:00100000:3.0:1789635369.144614:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427321984 00000100:00100000:3.0:1789635369.144669:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1789635369.144679:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+21:13793:x1876568427321984:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789635369.144850:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+21:13793:x1876568427321984:12345-0@lo:502:llog_process_th.0 Request processed in 172us (9393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635369.144857:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1789635369.144914:0:13793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d054121bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:13793:1876568427321984:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789635369.144951:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635369.144957:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635369.144959:0:13793:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789635369.144964:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789635369.145356:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1789635369.145376:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789635369.145386:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa40f1b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40f1ba expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635369.145396:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa40f1b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40f1ba expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635369.145406:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789635369.145409:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d056f7ce800 from 7 10000000:01000000:1.0:1789635369.145411:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789635369.145440:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40f1c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635369.145456:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40f1c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635369.145464:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40f1c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635369.145484:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427322112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789635369.145520:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635369.145569:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0551233900 going to sleep for 11 seconds 00000100:00100000:3.0:1789635369.145573:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427322112 00000100:00100000:3.0:1789635369.145578:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427322112 00000100:00100000:3.0:1789635369.145644:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1789635369.145652:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+21:6512:x1876568427322112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789635369.145661:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635369.145672:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d054139c400/0xb0c3a59caa40f1c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40f1c1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635369.145690:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d054139c400/0xb0c3a59caa40f1c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40f1c1 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635369.145697:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d054139c400/0xb0c3a59caa40f1c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40f1c1 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635369.145708:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d054139c400, rc 0) 00000100:00100000:3.0:1789635369.145741:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+22:6512:x1876568427322112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635369.145796:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427322112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789635369.145809:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40f1c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40f1c8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635369.145823:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40f1c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40f1c8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635369.145882:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427322240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635369.145908:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635369.145927:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0551233900 going to sleep for 11 seconds 00000100:00100000:2.0:1789635369.150491:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427322240 00000100:00100000:2.0:1789635369.150507:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427322240 00000100:00100000:3.0:1789635369.153030:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1789635369.156877:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1789635369.156895:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+22:6512:x1876568427322240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635369.157082:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+22:6512:x1876568427322240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 193us (11172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635369.157090:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1789635369.157118:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427322240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635369.157180:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427322368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789635369.157238:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635369.157272:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427322368 00000100:00100000:3.0:1789635369.157276:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05446f3180 going to sleep for 11 seconds 00000100:00100000:2.0:1789635369.157279:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427322368 00000100:00100000:2.0:1789635369.157311:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1789635369.157317:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+22:6512:x1876568427322368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789635369.157388:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+22:6512:x1876568427322368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635369.157392:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1789635369.157465:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427322368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789635369.157724:0:13796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:13796:1876568427322496:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789635369.157761:0:13796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635369.157781:0:13796:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05446f3180 going to sleep for 11 seconds 00000100:00100000:2.0:1789635369.157793:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427322496 00000100:00100000:2.0:1789635369.157799:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427322496 00000100:00100000:2.0:1789635369.157825:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1789635369.157832:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+22:13796:x1876568427322496:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789635369.157917:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+22:13796:x1876568427322496:12345-0@lo:502:llog_process_th.0 Request processed in 86us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635369.157922:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1789635369.157953:0:13796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:13796:1876568427322496:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789635369.157974:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789635369.157983:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635369.157985:0:13796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789635369.157994:0:13796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d056f7ce800 00000020:00000080:3.0:1789635369.157997:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789635369.158052:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789635369.158056:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635369.158058:0:13796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789635369.158061:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789635369.158064:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635369.158066:0:13796:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789635369.158069:0:13796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d056f7ce800 00000020:00000080:3.0:1789635369.158077:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789635369.158112:0:13796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:13796:1876568427322624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789635369.158157:0:13796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635369.158180:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427322624 00000100:00100000:3.0:1789635369.158183:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427322624 00000100:00100000:3.0:1789635369.158221:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1789635369.158228:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b811450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+22:13796:x1876568427322624:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789635369.158293:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b811450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+22:13796:x1876568427322624:12345-0@lo:502:llog_process_th.0 Request processed in 65us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635369.158300:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1789635369.158332:0:13796:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05463dd180 going to sleep for 11 seconds 00000100:00100000:3.0:1789635369.158343:0:13796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:13796:1876568427322624:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789635369.158363:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789635369.158367:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635369.158369:0:13796:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789635369.158373:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789635369.158514:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1789635369.158534:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789635369.158542:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40f1c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40f1c8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635369.158550:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40f1c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40f1c8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635369.158557:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789635369.158559:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0550107000 from 7 10000000:01000000:2.0:1789635369.158561:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789635369.158579:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3200/0xb0c3a59caa40f1cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635369.158587:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3200/0xb0c3a59caa40f1cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635369.158626:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3200/0xb0c3a59caa40f1cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635369.158651:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541219180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427322752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789635369.158682:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635369.158710:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427322752 00000100:00100000:2.0:1789635369.158713:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d054a0bd240 going to sleep for 11 seconds 00000100:00100000:3.0:1789635369.158716:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427322752 00000100:00100000:3.0:1789635369.158746:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1789635369.158755:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b811050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+22:6512:x1876568427322752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789635369.158764:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635369.158777:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d054139d000/0xb0c3a59caa40f1d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40f1cf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635369.158799:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d054139d000/0xb0c3a59caa40f1d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40f1cf expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635369.158809:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d054139d000/0xb0c3a59caa40f1d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40f1cf expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635369.158839:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d054139d000, rc 0) 00000100:00100000:3.0:1789635369.158894:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b811050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+23:6512:x1876568427322752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635369.158900:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1789635369.159011:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541219180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427322752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635369.159023:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3200/0xb0c3a59caa40f1cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40f1d6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635369.159032:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3200/0xb0c3a59caa40f1cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40f1d6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635369.159078:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541219180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427322880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635369.159102:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635369.159151:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d054a0bd240 going to sleep for 11 seconds 00000100:00100000:3.0:1789635369.159181:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427322880 00000100:00100000:3.0:1789635369.159185:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427322880 00000100:00100000:3.0:1789635369.159241:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1789635369.159249:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+23:6512:x1876568427322880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635369.159338:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+23:6512:x1876568427322880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635369.159344:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1789635369.159403:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541219180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427322880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789635369.159431:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04478ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427323008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789635369.159474:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635369.159570:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0543d5c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635369.159713:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427323008 00000100:00100000:2.0:1789635369.159718:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427323008 00000100:00100000:2.0:1789635369.159743:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1789635369.159751:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+23:6512:x1876568427323008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789635369.159838:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+23:6512:x1876568427323008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635369.159845:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1789635369.159976:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04478ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427323008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789635369.160793:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789635369.160995:0:13798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d054121aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:13798:1876568427323136:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789635369.161038:0:13798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635369.161069:0:13798:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d054a0bd840 going to sleep for 11 seconds 00000100:00100000:0.0:1789635369.161135:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427323136 00000100:00100000:0.0:1789635369.161141:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427323136 00000100:00100000:1.0:1789635369.161832:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1789635369.161843:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+23:13798:x1876568427323136:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635369.161952:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+23:13798:x1876568427323136:12345-0@lo:502:llog_process_th.0 Request processed in 111us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635369.161960:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1789635369.162100:0:13798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d054121aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:13798:1876568427323136:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789635369.162131:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789635369.162138:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635369.162141:0:13798:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789635369.162149:0:13798:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d0550107000 00000020:00000080:2.0:1789635369.162151:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789635369.162195:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789635369.162199:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635369.162200:0:13798:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789635369.162203:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789635369.162206:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635369.162208:0:13798:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789635369.162212:0:13798:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d0550107000 00000020:00000080:2.0:1789635369.162215:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789635369.162247:0:13798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d054121aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:13798:1876568427323264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789635369.162279:0:13798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635369.162310:0:13798:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d054a0bd840 going to sleep for 11 seconds 00000100:00100000:1.0:1789635369.162388:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427323264 00000100:00100000:1.0:1789635369.162399:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427323264 00000100:00100000:1.0:1789635369.162431:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1789635369.162437:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+23:13798:x1876568427323264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635369.162496:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+23:13798:x1876568427323264:12345-0@lo:502:llog_process_th.0 Request processed in 59us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635369.162503:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1789635369.162572:0:13798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d054121aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:13798:1876568427323264:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789635369.162587:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789635369.162591:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635369.162592:0:13798:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789635369.162785:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789635369.162907:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1789635369.162931:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789635369.162940:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3200/0xb0c3a59caa40f1cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40f1d6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635369.162960:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3200/0xb0c3a59caa40f1cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40f1d6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635369.163042:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789635369.163045:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0558960000 from 7 10000000:01000000:1.0:1789635369.163048:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789635369.163070:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152c00/0xb0c3a59caa40f1dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635369.163079:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056e152c00/0xb0c3a59caa40f1dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635369.163088:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056e152c00/0xb0c3a59caa40f1dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635369.163100:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427323392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789635369.163130:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635369.163157:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446cbc600 going to sleep for 11 seconds 00000100:00100000:2.0:1789635369.163196:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427323392 00000100:00100000:2.0:1789635369.163201:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427323392 00000100:00100000:2.0:1789635369.163228:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1789635369.163234:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+23:6512:x1876568427323392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635369.163242:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635369.163254:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056e1a2400/0xb0c3a59caa40f1e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40f1dd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635369.163284:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e1a2400/0xb0c3a59caa40f1e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40f1dd expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635369.163294:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056e1a2400/0xb0c3a59caa40f1e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40f1dd expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635369.163302:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a2400, rc 0) 00000100:00100000:2.0:1789635369.163464:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:6512:x1876568427323392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 229us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635369.163470:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1789635369.163520:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427323392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789635369.163531:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056e152c00/0xb0c3a59caa40f1dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40f1e4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635369.163540:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056e152c00/0xb0c3a59caa40f1dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40f1e4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635369.163580:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427323520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635369.163643:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635369.163661:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446cbc600 going to sleep for 11 seconds 00000100:00100000:2.0:1789635369.170276:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427323520 00000100:00100000:2.0:1789635369.170294:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427323520 00000100:00100000:2.0:1789635369.170356:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1789635369.170366:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:6512:x1876568427323520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635369.170539:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:6512:x1876568427323520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 174us (6895us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635369.170547:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1789635369.170742:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427323520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789635369.170792:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04478ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427323648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789635369.170947:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635369.170977:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0543d5c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635369.174647:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427323648 00000100:00100000:2.0:1789635369.174662:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427323648 00000100:00100000:2.0:1789635369.174725:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1789635369.174737:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:6512:x1876568427323648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789635369.174914:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:6512:x1876568427323648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 179us (3966us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635369.174922:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1789635369.176003:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04478ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6356ed01-c755-4f9e-b839-20feb7c3f098:6512:1876568427323648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789635369.176384:0:13800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:13800:1876568427323776:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789635369.176442:0:13800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635369.176489:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427323776 00000100:00100000:3.0:1789635369.176490:0:13800:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b5ebf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789635369.176496:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427323776 00000100:00100000:2.0:1789635369.176554:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1789635369.176566:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:13800:x1876568427323776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789635369.176706:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:13800:x1876568427323776:12345-0@lo:502:llog_process_th.0 Request processed in 143us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635369.176714:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1789635369.176756:0:13800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:13800:1876568427323776:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789635369.176775:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789635369.176782:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635369.176784:0:13800:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789635369.176791:0:13800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d0558960000 00000020:00000080:3.0:1789635369.176794:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789635369.176908:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789635369.176913:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635369.176914:0:13800:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789635369.176918:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789635369.176922:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635369.176923:0:13800:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789635369.176935:0:13800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d0558960000 00000020:00000080:3.0:1789635369.176938:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789635369.176994:0:13800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:13800:1876568427323904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789635369.177052:0:13800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635369.177116:0:13800:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b5ebf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789635369.177146:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427323904 00000100:00100000:1.0:1789635369.177150:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427323904 00000100:00100000:1.0:1789635369.177211:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1789635369.177219:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:13800:x1876568427323904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635369.177295:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:13800:x1876568427323904:12345-0@lo:502:llog_process_th.0 Request processed in 77us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635369.177303:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1789635369.177370:0:13800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6356ed01-c755-4f9e-b839-20feb7c3f098:13800:1876568427323904:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789635369.177388:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789635369.177392:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635369.177394:0:13800:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789635369.177398:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789635369.177547:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1789635369.177568:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789635369.177578:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152c00/0xb0c3a59caa40f1dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40f1e4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635369.177588:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e152c00/0xb0c3a59caa40f1dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40f1e4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789635369.179917:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789635369.380070:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427324160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789635369.380145:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635369.380189:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789635369.380195:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04478edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427324032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789635369.380219:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635369.380849:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427324160 00000100:00100000:3.0:1789635369.380865:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427324160 00000100:00100000:3.0:1789635369.380917:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427324032 00000100:00100000:3.0:1789635369.380921:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427324032 00000100:00100000:3.0:1789635369.380946:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789635369.380954:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054121aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1876568427324160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789635369.380981:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635369.381031:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054121aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1876568427324160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635369.381038:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789635369.381054:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789635369.381061:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427324032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789635369.381070:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635369.381094:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427324032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635369.381100:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789635369.381144:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04478edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427324032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789635369.381169:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427324160:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789635369.381703:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789635369.381831:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427324288:0@lo:400:kworker.0 00000100:00100000:2.0:1789635369.381877:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635369.382015:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d057b599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427324672:0@lo:400:kworker.0 00000100:00100000:2.0:1789635369.382043:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635369.382060:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427325184:0@lo:400:kworker.0 00000100:00100000:2.0:1789635369.382081:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635369.382100:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789635369.382116:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d054121bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427324544:0@lo:400:kworker.0 00000100:00100000:2.0:1789635369.382138:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635369.382153:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04477a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427325056:0@lo:400:kworker.0 00000100:00100000:2.0:1789635369.382173:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635369.382188:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e015f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1876568427325568:0@lo:400:kworker.0 00000100:00100000:2.0:1789635369.382208:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635369.382233:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427325184 00000100:00100000:2.0:1789635369.382238:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427325184 00000100:00100000:2.0:1789635369.382271:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789635369.382278:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427325184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635369.382317:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427325184:12345-0@lo:400:kworker.0 Request processed in 40us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635369.382323:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:2.0:1789635369.382338:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789635369.382347:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427324800:0@lo:400:kworker.0 00000100:00100000:2.0:1789635369.382373:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635369.382388:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448449f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427325312:0@lo:400:kworker.0 00000100:00100000:2.0:1789635369.382407:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635369.382422:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789635369.382427:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427324416:0@lo:400:kworker.0 00000100:00100000:2.0:1789635369.382447:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635369.382461:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427324928:0@lo:400:kworker.0 00000100:00100000:2.0:1789635369.382479:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635369.382492:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427325440:0@lo:400:kworker.0 00000100:00100000:2.0:1789635369.382512:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789635369.382549:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04477aaa00 x1876568427325184/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635369.382561:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427325184:0@lo:400:kworker.0 00000100:00100000:1.0:1789635369.382685:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427324288 00000100:00100000:1.0:1789635369.382690:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427324288 00000100:00100000:1.0:1789635369.382723:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1789635369.382730:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3640:x1876568427324288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635369.382770:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3640:x1876568427324288:12345-0@lo:400:kworker.0 Request processed in 41us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635369.382776:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1789635369.382803:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427324672 00000100:00100000:1.0:1789635369.382806:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427324672 00000100:00100000:1.0:1789635369.382825:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427324544 00000100:00100000:1.0:1789635369.382828:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427324544 00000100:00100000:1.0:1789635369.382841:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789635369.382847:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427324672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635369.382894:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427324672:12345-0@lo:400:kworker.0 Request processed in 47us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635369.382900:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789635369.382918:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789635369.382923:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427324544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635369.383011:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427324544:12345-0@lo:400:kworker.0 Request processed in 87us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635369.383017:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789635369.383036:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427325056 00000100:00100000:1.0:1789635369.383040:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427325056 00000100:00100000:1.0:1789635369.383063:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427325568 00000100:00100000:1.0:1789635369.383066:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427325568 00000100:00100000:1.0:1789635369.383077:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427324800 00000100:00100000:1.0:1789635369.383080:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427324800 00000100:00100000:1.0:1789635369.383089:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427324416 00000100:00100000:1.0:1789635369.383091:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427324416 00000100:00100000:1.0:1789635369.383100:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427324928 00000100:00100000:1.0:1789635369.383102:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427324928 00000100:00100000:1.0:1789635369.383113:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427325440 00000100:00100000:1.0:1789635369.383116:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427325440 00000100:00100000:1.0:1789635369.383128:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789635369.383134:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876568427325056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635369.383164:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876568427325056:12345-0@lo:400:kworker.0 Request processed in 30us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635369.383170:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789635369.383181:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789635369.383187:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876568427325568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635369.383212:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876568427325568:12345-0@lo:400:kworker.0 Request processed in 26us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635369.383217:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789635369.383227:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789635369.383232:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427324800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635369.383264:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427324800:12345-0@lo:400:kworker.0 Request processed in 32us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635369.383271:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789635369.383283:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789635369.383289:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427324416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635369.383317:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427324416:12345-0@lo:400:kworker.0 Request processed in 28us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635369.383322:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789635369.383334:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789635369.383339:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427324928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635369.383364:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427324928:12345-0@lo:400:kworker.0 Request processed in 25us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635369.383369:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789635369.383380:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789635369.383385:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427325440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635369.383409:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427325440:12345-0@lo:400:kworker.0 Request processed in 25us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635369.383415:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00080000:1.0:1789635369.383430:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789635369.383433:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789635369.383451:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d054121bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427324544:0@lo:400:kworker.0 00010000:00080000:1.0:1789635369.383463:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04477a9f80 x1876568427325056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635369.383473:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04477a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427325056:0@lo:400:kworker.0 00010000:00080000:1.0:1789635369.383494:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d056e015f80 x1876568427325568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635369.383503:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e015f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1876568427325568:0@lo:400:kworker.0 00000100:00100000:1.0:1789635369.383512:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d057b599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427324672:0@lo:400:kworker.0 00000100:00100000:1.0:1789635369.383543:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427324416:0@lo:400:kworker.0 00000100:00100000:1.0:1789635369.383552:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427324928:0@lo:400:kworker.0 00000100:00100000:1.0:1789635369.383562:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427325440:0@lo:400:kworker.0 00000100:00100000:1.0:1789635369.383571:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427324800:0@lo:400:kworker.0 00000100:00100000:1.0:1789635369.383579:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427324288:0@lo:400:kworker.0 00000100:00100000:0.0:1789635369.384110:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427325312 00000100:00100000:0.0:1789635369.384115:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427325312 00000100:00100000:0.0:1789635369.384158:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789635369.384165:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427325312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635369.384210:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427325312:12345-0@lo:400:kworker.0 Request processed in 46us (1801us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635369.384216:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:0.0:1789635369.384245:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0448449f80 x1876568427325312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635369.384256:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448449f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427325312:0@lo:400:kworker.0 00000100:00080000:1.0:1789635369.386048:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789635369.596061:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635369.596190:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411501184 00000100:00100000:1.0:1789635369.596200:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411501184 00000100:00100000:1.0:1789635369.596257:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 368 00000100:00100000:1.0:1789635369.596267:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+11:6165:x1876568411501184:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789635369.596283:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635369.596299:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056e153200/0xb0c3a59caa40f1eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73fab expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635369.596325:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e153200/0xb0c3a59caa40f1eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fab expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635369.596336:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056e153200/0xb0c3a59caa40f1eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fab expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635369.596363:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e153200, rc 0) 00000100:00100000:1.0:1789635369.596516:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+12:6165:x1876568411501184:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 Request processed in 250us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635369.596524:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 368 00000100:00100000:1.0:1789635369.598916:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635369.598996:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411501312 00000100:00100000:2.0:1789635369.599005:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411501312 00000100:00100000:2.0:1789635369.599100:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 369 00000100:00100000:2.0:1789635369.599111:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+12:6165:x1876568411501312:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635369.599261:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+12:6165:x1876568411501312:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 Request processed in 152us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635369.599269:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 369 00000100:00100000:2.0:1789635369.601988:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635369.602115:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411501440 00000100:00100000:1.0:1789635369.602125:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411501440 00000100:00100000:1.0:1789635369.602183:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 370 00000100:00100000:1.0:1789635369.602299:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+12:6165:x1876568411501440:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789635369.602438:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+12:6165:x1876568411501440:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 Request processed in 142us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635369.603174:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 370 00000100:00100000:3.0:1789635369.609136:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635369.609268:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411501568 00000100:00100000:2.0:1789635369.609279:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411501568 00000100:00100000:2.0:1789635369.609383:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 371 00000100:00100000:2.0:1789635369.609394:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+12:10782:x1876568411501568:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789635369.609549:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+12:10782:x1876568411501568:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 156us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635369.609557:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 371 00000100:00100000:2.0:1789635369.616570:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635369.616778:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411501696 00000100:00100000:1.0:1789635369.616788:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411501696 00000100:00100000:1.0:1789635369.616841:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 372 00000100:00100000:1.0:1789635369.616850:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+12:10782:x1876568411501696:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789635369.617036:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+12:10782:x1876568411501696:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 187us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635369.617044:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 372 00000100:00100000:0.0:1789635369.632474:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635369.632756:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411501824 00000100:00100000:2.0:1789635369.632765:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411501824 00000100:00100000:2.0:1789635369.632823:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 373 00000100:00100000:2.0:1789635369.632841:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+12:6165:x1876568411501824:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635369.632870:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635369.632888:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056e1a2c00/0xb0c3a59caa40f1f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73fb2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635369.632931:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e1a2c00/0xb0c3a59caa40f1f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fb2 expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635369.632952:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056e1a2c00/0xb0c3a59caa40f1f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fb2 expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635369.632962:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a2c00, rc 0) 00000100:00100000:2.0:1789635369.633074:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:6165:x1876568411501824:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 Request processed in 241us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635369.633082:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 373 00000100:00100000:1.0:1789635369.636586:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635369.636711:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411501952 00000100:00100000:2.0:1789635369.636720:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411501952 00000100:00100000:2.0:1789635369.636819:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 374 00000100:00100000:2.0:1789635369.636830:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054645ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:6165:x1876568411501952:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635369.636989:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054645ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:6165:x1876568411501952:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 Request processed in 160us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635369.636998:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 374 00000100:00100000:1.0:1789635369.643740:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635369.643849:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411502080 00000100:00100000:0.0:1789635369.643869:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411502080 00000100:00100000:0.0:1789635369.643926:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 375 00000100:00100000:0.0:1789635369.643937:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546459850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:6165:x1876568411502080:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789635369.644229:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546459850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:6165:x1876568411502080:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 Request processed in 292us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635369.644242:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 375 00000100:00100000:0.0:1789635369.654208:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635369.654532:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411502208 00000100:00100000:2.0:1789635369.654541:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411502208 00000100:00100000:2.0:1789635369.654591:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 376 00000100:00100000:2.0:1789635369.654628:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054645b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:10786:x1876568411502208:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789635369.655575:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054645b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:10786:x1876568411502208:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 134us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635369.655587:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 376 00000100:00100000:1.0:1789635369.659385:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635369.659472:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411502336 00000100:00100000:0.0:1789635369.659482:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411502336 00000100:00100000:0.0:1789635369.659571:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 377 00000100:00100000:0.0:1789635369.659581:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546458850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:10786:x1876568411502336:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789635369.659746:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546458850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:10786:x1876568411502336:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 165us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635369.659754:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 377 00010000:00010000:1.0:1789635370.148024:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789635370.212289:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789635370.216461:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789635370.404155:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789635370.404178:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427325696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635370.404247:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635370.404487:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427325696 00000100:00100000:3.0:1789635370.404495:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427325696 00000100:00100000:3.0:1789635370.404546:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789635370.404557:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04478ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427325696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789635370.404584:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635370.404896:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04478ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427325696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 340us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635370.404903:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:0.0:1789635370.405216:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04459ddf80 x1876568427325696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635370.405234:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427325696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635370.915953:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789635370.915976:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04478ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427325824:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789635370.916065:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635370.916220:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427325824 00000100:00100000:0.0:1789635370.916229:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427325824 00000100:00100000:0.0:1789635370.916290:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789635370.916298:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427325824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789635370.916431:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635370.916589:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427325824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 291us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635370.916619:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:3.0:1789635370.916815:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04478ec380 x1876568427325824/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635370.916835:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04478ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427325824:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789635371.171783:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635372.201696:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635372.451908:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789635372.451913:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789635372.451931:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427326080:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789635372.451931:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427325952:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789635372.455971:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635372.457964:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635372.466618:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427326080 00000100:00100000:1.0:1789635372.466635:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427326080 00000100:00100000:1.0:1789635372.466721:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427325952 00000100:00100000:1.0:1789635372.466725:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427325952 00000100:00100000:1.0:1789635372.466746:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789635372.466756:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427326080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789635372.466794:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789635372.466895:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789635372.466907:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427326080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 151us (10942us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635372.466910:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427325952:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789635372.466920:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000004:00000024:2.0:1789635372.466936:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789635372.466990:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427325952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (9032us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635372.466996:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789635372.469261:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427326080:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789635372.469552:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427325952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789635372.483288:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635372.483342:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635372.483378:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635372.483411:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635372.483431:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635372.483452:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635372.483533:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411502592 00000100:00100000:0.0:1789635372.483544:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411502592 00000100:00100000:0.0:1789635372.483644:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411503104 00000100:00100000:0.0:1789635372.483648:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411503104 00000100:00100000:0.0:1789635372.483664:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411502720 00000100:00100000:0.0:1789635372.483666:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411502720 00000100:00100000:0.0:1789635372.483679:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411502976 00000100:00100000:0.0:1789635372.483681:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411502976 00000100:00100000:0.0:1789635372.483697:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 261 00000100:00100000:0.0:1789635372.483706:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2396:x1876568411502592:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635372.483777:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2396:x1876568411502592:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 71us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635372.483784:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 261 00000100:00100000:0.0:1789635372.483800:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 262 00000100:00100000:0.0:1789635372.483807:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2396:x1876568411503104:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635372.483843:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2396:x1876568411503104:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 27us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635372.483849:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 262 00000100:00100000:0.0:1789635372.483862:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 263 00000100:00100000:0.0:1789635372.483868:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2396:x1876568411502720:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635372.483903:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2396:x1876568411502720:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 35us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635372.483910:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 263 00000100:00100000:0.0:1789635372.483920:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 264 00000100:00100000:0.0:1789635372.483925:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2396:x1876568411502976:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635372.483966:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2396:x1876568411502976:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 41us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635372.483974:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 264 00000100:00080000:1.0:1789635372.484418:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789635372.484423:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635372.485290:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411502464 00000100:00100000:2.0:1789635372.485298:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411502464 00000100:00100000:2.0:1789635372.485353:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 378 00000100:00100000:2.0:1789635372.485361:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054645bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2396:x1876568411502464:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635372.485459:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054645bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2396:x1876568411502464:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 98us (2046us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635372.485465:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 378 00000100:00100000:3.0:1789635372.485635:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411502848 00000100:00100000:3.0:1789635372.485639:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411502848 00000100:00100000:3.0:1789635372.485684:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 100 00000100:00100000:3.0:1789635372.485691:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2396:x1876568411502848:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635372.485721:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2396:x1876568411502848:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 30us (2379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635372.485738:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 100 00000100:00080000:2.0:1789635372.485827:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789635373.222815:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789635373.486101:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:0.0:1789635374.243863:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635374.499780:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789635374.499803:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427326208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789635374.499884:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635374.499935:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427326208 00000100:00100000:0.0:1789635374.499946:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427326208 00000100:00080000:3.0:1789635374.499986:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789635374.500007:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789635374.500018:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427326208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789635374.500055:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635374.500217:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04478ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427326336:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789635374.500253:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635374.500286:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427326208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 269us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635374.500294:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789635374.500305:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000100:00100000:2.0:1789635374.500308:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427326336 00000004:00080000:3.0:1789635374.500313:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d04478eca80, transno 4294967301 00000100:00100000:2.0:1789635374.500314:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427326336 00000100:00100000:3.0:1789635374.500340:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427326208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789635374.500359:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789635374.500366:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04478ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427326464:0@lo:400:kworker.0 00000100:00100000:2.0:1789635374.500373:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427326336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789635374.500388:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635374.500410:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635374.500434:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427326336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635374.500455:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789635374.500460:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04478eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876568427326976:0@lo:400:kworker.0 00000100:00100000:2.0:1789635374.500479:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04478edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427326720:0@lo:400:kworker.0 00000100:00100000:0.0:1789635374.500485:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427326464 00000100:00100000:0.0:1789635374.500490:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427326464 00000100:00100000:3.0:1789635374.500499:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635374.500512:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635374.500526:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1789635374.500530:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427327488:0@lo:400:kworker.0 00000100:00100000:2.0:1789635374.500537:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448449f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427327232:0@lo:400:kworker.0 00000100:00100000:0.0:1789635374.500538:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546459450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3641:x1876568427326464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635374.500571:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635374.500576:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635374.500589:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546459450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3641:x1876568427326464:12345-0@lo:400:kworker.0 Request processed in 54us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635374.500619:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1789635374.500625:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1876568427327744:0@lo:400:kworker.0 00000100:00100000:3.0:1789635374.500638:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04478ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427326464:0@lo:400:kworker.0 00000100:00100000:2.0:1789635374.500656:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635374.500657:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789635374.500666:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04478ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427326848:0@lo:400:kworker.0 00000100:00100000:0.0:1789635374.500683:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427326976 00000100:00100000:0.0:1789635374.500687:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427326976 00000100:00100000:2.0:1789635374.500701:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04478ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427326336:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789635374.500704:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635374.500719:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427327232 00000100:00100000:0.0:1789635374.500722:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427327232 00000100:00100000:2.0:1789635374.500724:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789635374.500734:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04478ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876568427326592:0@lo:400:kworker.0 00000100:00100000:3.0:1789635374.500737:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427327360:0@lo:400:kworker.0 00000100:00100000:0.0:1789635374.500745:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427327744 00000100:00100000:0.0:1789635374.500749:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427327744 00000100:00100000:2.0:1789635374.500769:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635374.500774:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789635374.500781:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635374.500786:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876568427326976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635374.500789:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04478eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1876568427327104:0@lo:400:kworker.0 00000100:00100000:1.0:1789635374.500935:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427327488 00000100:00100000:1.0:1789635374.500940:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427327488 00000100:00100000:1.0:1789635374.500968:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427327360 00000100:00100000:1.0:1789635374.500971:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427327360 00000100:00100000:1.0:1789635374.501001:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789635374.501008:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427327488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635374.501656:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635374.501671:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447af1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1876568427327616:0@lo:400:kworker.0 00000100:00100000:2.0:1789635374.501688:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635374.501710:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427326592 00000100:00100000:2.0:1789635374.501714:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427326592 00000100:00100000:0.0:1789635374.501727:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876568427326976:12345-0@lo:400:kworker.0 Request processed in 942us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635374.501734:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427327104 00000100:00100000:2.0:1789635374.501738:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427327104 00000100:00100000:0.0:1789635374.501738:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789635374.501761:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789635374.501769:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044146a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876568427327232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635374.501809:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044146a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876568427327232:12345-0@lo:400:kworker.0 Request processed in 42us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635374.501815:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789635374.501840:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789635374.501846:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0441469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876568427327744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635374.501874:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0441469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876568427327744:12345-0@lo:400:kworker.0 Request processed in 29us (1221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635374.501880:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789635374.501886:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427327616 00000100:00100000:2.0:1789635374.501891:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427327616 00000100:00100000:0.0:1789635374.501896:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789635374.501905:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447bfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876568427326592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635374.501921:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789635374.501931:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447bf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876568427327104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635374.501940:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447bfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876568427326592:12345-0@lo:400:kworker.0 Request processed in 35us (1172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635374.501947:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789635374.501961:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789635374.501970:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447bfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876568427327616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635374.501977:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447bf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876568427327104:12345-0@lo:400:kworker.0 Request processed in 45us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635374.501999:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789635374.502014:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447bfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876568427327616:12345-0@lo:400:kworker.0 Request processed in 45us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635374.502022:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789635374.502033:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427326720 00000100:00100000:3.0:1789635374.502035:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04478eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876568427326976:0@lo:400:kworker.0 00000100:00100000:2.0:1789635374.502038:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427326720 00000100:00100000:2.0:1789635374.502073:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427326848 00000100:00100000:2.0:1789635374.502077:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427326848 00000100:00100000:0.0:1789635374.502080:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789635374.502092:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04478ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427327360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635374.502097:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789635374.502108:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427326720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635374.502150:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04478ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427327360:12345-0@lo:400:kworker.0 Request processed in 60us (1370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635374.502158:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427326720:12345-0@lo:400:kworker.0 Request processed in 52us (1646us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635374.502159:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789635374.502179:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789635374.502199:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00080000:3.0:1789635374.502201:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789635374.502208:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789635374.502211:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04478ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427326848:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789635374.502220:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789635374.502225:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789635374.502237:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04478ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876568427326592:0@lo:400:kworker.0 00000100:00100000:2.0:1789635374.502254:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04478eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1876568427327104:0@lo:400:kworker.0 00000100:00100000:0.0:1789635374.502264:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04478ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427326848:12345-0@lo:400:kworker.0 Request processed in 56us (1563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635374.502268:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447af1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1876568427327616:0@lo:400:kworker.0 00000100:00100000:0.0:1789635374.502274:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789635374.502286:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04478edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427326720:0@lo:400:kworker.0 00010000:00080000:2.0:1789635374.502301:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0448449f80 x1876568427327232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635374.502311:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448449f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427327232:0@lo:400:kworker.0 00010000:00080000:2.0:1789635374.502322:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0575ad9f80 x1876568427327744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635374.502330:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1876568427327744:0@lo:400:kworker.0 00000100:00100000:1.0:1789635374.502943:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427327488:12345-0@lo:400:kworker.0 Request processed in 1934us (2371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635374.502959:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:3.0:1789635374.504431:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447977800 x1876568427327360/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635374.504448:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427327360:0@lo:400:kworker.0 00010000:00080000:3.0:1789635374.504481:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447975c00 x1876568427327488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635374.504490:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427327488:0@lo:400:kworker.0 00000100:00100000:3.0:1789635374.504535:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04478ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427326848:0@lo:400:kworker.0 00010000:00010000:1.0:1789635375.268001:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635375.523883:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789635375.523906:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04478ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427327872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635375.523974:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635375.524107:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427327872 00000100:00100000:1.0:1789635375.524248:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427327872 00000100:00100000:1.0:1789635375.524369:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789635375.524379:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427327872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789635375.524417:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789635375.524475:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427327872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635375.524482:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00010000:00080000:0.0:1789635375.524552:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04478ef100 x1876568427327872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635375.524571:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04478ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427327872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789635376.036004:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789635376.036028:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427328000:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789635376.036098:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635376.036217:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427328000 00000100:00100000:0.0:1789635376.036226:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427328000 00000100:00100000:0.0:1789635376.036291:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789635376.036302:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427328000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789635376.036325:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635376.036381:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427328000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635376.036388:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:3.0:1789635376.036486:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789635376.036534:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0575ada300 x1876568427328000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635376.036554:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427328000:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789635376.292246:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635377.315779:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635377.571823:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427328128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789635377.571921:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635377.572063:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427328128 00000100:00100000:0.0:1789635377.572071:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427328128 00000100:00100000:0.0:1789635377.572139:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789635377.572164:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447af1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427328128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789635377.572200:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789635377.572512:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04478eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427328256:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789635377.572555:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635377.572624:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427328256 00000100:00100000:1.0:1789635377.572628:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427328256 00000100:00100000:1.0:1789635377.572650:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789635377.572656:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427328256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789635377.572675:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789635377.572712:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427328256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635377.572719:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789635377.572760:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04478eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427328256:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789635377.580339:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447af1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427328128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 8165us (8414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635377.580353:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789635377.587618:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427328128:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789635377.598321:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635377.598377:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635377.598411:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635377.598447:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635377.598468:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635377.598550:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635377.598561:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411503616 00000100:00100000:1.0:1789635377.598586:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411503616 00000100:00100000:0.0:1789635377.598777:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411503360 00000100:00100000:0.0:1789635377.598787:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411503360 00000100:00080000:3.0:1789635377.605299:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789635377.605341:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411503872 00000100:00100000:3.0:1789635377.605352:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411503872 00000100:00100000:1.0:1789635377.605365:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 103 00000100:00100000:1.0:1789635377.605392:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04478eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411503616:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635377.605416:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411503488 00000100:00100000:3.0:1789635377.605421:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411503488 00000100:00100000:3.0:1789635377.605437:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411503744 00000100:00100000:3.0:1789635377.605439:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411503744 00000100:00100000:3.0:1789635377.605454:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 271 00000100:00100000:3.0:1789635377.605462:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04478ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411503872:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789635377.605514:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04478eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411503616:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 138us (7136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635377.605522:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 103 00000100:00100000:3.0:1789635377.605574:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04478ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411503872:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 112us (7161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635377.605615:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 271 00000100:00100000:3.0:1789635377.605633:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 272 00000100:00100000:3.0:1789635377.605640:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04478edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411503488:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635377.605663:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04478edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411503488:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 24us (7195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635377.605670:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 272 00000100:00100000:3.0:1789635377.605684:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 273 00000100:00100000:3.0:1789635377.605693:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04478eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411503744:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635377.605706:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 274 00000100:00100000:0.0:1789635377.605718:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04478eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411503360:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635377.605723:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04478eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411503744:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 30us (7171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635377.605736:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 273 00000100:00100000:0.0:1789635377.605756:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04478eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411503360:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 40us (7449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635377.605761:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 274 00000100:00100000:3.0:1789635377.605768:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411503232 00000100:00100000:3.0:1789635377.605773:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411503232 00000100:00080000:0.0:1789635377.605784:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789635377.605788:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635377.605827:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 380 00000100:00100000:3.0:1789635377.605835:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546459050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2398:x1876568411503232:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635377.605862:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546459050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2398:x1876568411503232:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 29us (7415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635377.605869:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 380 00010000:00010000:1.0:1789635378.339917:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635379.364351:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635379.619985:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789635379.620005:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e015f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427328640:0@lo:400:kworker.0 00000100:00100000:1.0:1789635379.620067:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635379.620138:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427328640 00000100:00100000:1.0:1789635379.620146:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427328640 00000100:00100000:1.0:1789635379.620192:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789635379.620200:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427328640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635379.620249:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427328640:12345-0@lo:400:kworker.0 Request processed in 49us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635379.620256:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789635379.620309:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e015f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427328640:0@lo:400:kworker.0 00000100:00100000:1.0:1789635379.620341:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d054121bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427328768:0@lo:400:kworker.0 00000100:00100000:1.0:1789635379.620363:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635379.620407:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789635379.620412:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427329152:0@lo:400:kworker.0 00000100:00100000:1.0:1789635379.620434:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635379.620486:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427329280:0@lo:400:kworker.0 00000100:00100000:1.0:1789635379.620513:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635379.620555:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789635379.620560:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541327b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1876568427329664:0@lo:400:kworker.0 00000100:00100000:1.0:1789635379.620580:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635379.620631:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427329792:0@lo:400:kworker.0 00000100:00100000:1.0:1789635379.620650:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635379.620673:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427329280 00000100:00100000:1.0:1789635379.620676:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427329280 00000100:00100000:1.0:1789635379.620703:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427329792 00000100:00100000:1.0:1789635379.620706:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427329792 00000100:00100000:1.0:1789635379.620722:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789635379.620729:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541325880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427329280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635379.620763:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541325880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427329280:12345-0@lo:400:kworker.0 Request processed in 35us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635379.620769:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789635379.620797:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789635379.620806:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541325c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427329792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635379.620838:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541325c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427329792:12345-0@lo:400:kworker.0 Request processed in 35us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635379.620849:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789635379.620884:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427329792:0@lo:400:kworker.0 00010000:00080000:1.0:1789635379.620897:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0541326680 x1876568427329280/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635379.620908:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427329280:0@lo:400:kworker.0 00000100:00100000:0.0:1789635379.621021:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427328768 00000100:00100000:0.0:1789635379.621026:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427328768 00000100:00100000:0.0:1789635379.621063:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789635379.621071:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e015f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427328768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635379.621128:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e015f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427328768:12345-0@lo:400:kworker.0 Request processed in 59us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635379.621135:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:0.0:1789635379.621154:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789635379.621158:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789635379.621182:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d054121bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427328768:0@lo:400:kworker.0 00000100:00100000:3.0:1789635379.621378:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876568427328512:0@lo:400:kworker.0 00000100:00100000:3.0:1789635379.621409:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635379.621431:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044791ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1876568427329024:0@lo:400:kworker.0 00000100:00100000:3.0:1789635379.621451:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635379.621468:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1876568427329536:0@lo:400:kworker.0 00000100:00100000:3.0:1789635379.621496:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635379.621512:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1789635379.621517:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d057b599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427328384:0@lo:400:kworker.0 00000100:00100000:3.0:1789635379.621539:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635379.621560:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447918380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876568427328896:0@lo:400:kworker.0 00000100:00100000:3.0:1789635379.621579:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635379.621587:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427329408:0@lo:400:kworker.0 00000100:00100000:3.0:1789635379.621621:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635379.621635:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427329920:0@lo:400:kworker.0 00000100:00100000:3.0:1789635379.621664:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635379.621689:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427329152 00000100:00100000:3.0:1789635379.621693:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427329152 00000100:00100000:3.0:1789635379.621716:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427329664 00000100:00100000:3.0:1789635379.621719:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427329664 00000100:00100000:3.0:1789635379.621730:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427328512 00000100:00100000:3.0:1789635379.621732:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427328512 00000100:00100000:3.0:1789635379.621742:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427329024 00000100:00100000:3.0:1789635379.621744:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427329024 00000100:00100000:3.0:1789635379.621756:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427329536 00000100:00100000:3.0:1789635379.621758:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427329536 00000100:00100000:3.0:1789635379.621770:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427328896 00000100:00100000:3.0:1789635379.621772:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427328896 00000100:00100000:3.0:1789635379.621799:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789635379.621806:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876568427329152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635379.621842:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876568427329152:12345-0@lo:400:kworker.0 Request processed in 37us (1407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635379.621848:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789635379.621861:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1789635379.621873:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876568427329664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635379.621902:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876568427329664:12345-0@lo:400:kworker.0 Request processed in 30us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635379.621908:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1789635379.621921:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789635379.621927:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04478ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876568427328512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635379.621959:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04478ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876568427328512:12345-0@lo:400:kworker.0 Request processed in 32us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635379.621964:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789635379.621974:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1789635379.621979:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876568427329024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635379.622005:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876568427329024:12345-0@lo:400:kworker.0 Request processed in 26us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635379.622010:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1789635379.622021:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1789635379.622027:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876568427329536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635379.622049:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876568427329536:12345-0@lo:400:kworker.0 Request processed in 23us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635379.622054:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1789635379.622064:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1789635379.622069:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05446f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876568427328896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635379.622088:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05446f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876568427328896:12345-0@lo:400:kworker.0 Request processed in 20us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635379.622093:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1789635379.622108:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427329408 00000100:00100000:3.0:1789635379.622115:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427329408 00000100:00100000:3.0:1789635379.622134:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427329920 00000100:00100000:3.0:1789635379.622136:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427329920 00000100:00100000:3.0:1789635379.622148:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789635379.622153:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05446f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427329408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635379.622180:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05446f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427329408:12345-0@lo:400:kworker.0 Request processed in 27us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635379.622186:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789635379.622196:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789635379.622201:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05412adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427329920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635379.622221:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05412adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427329920:12345-0@lo:400:kworker.0 Request processed in 21us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635379.622227:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789635379.622251:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427328384 00000100:00100000:3.0:1789635379.622254:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427328384 00000100:00100000:3.0:1789635379.622272:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1789635379.622277:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054645b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3641:x1876568427328384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635379.622302:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054645b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3641:x1876568427328384:12345-0@lo:400:kworker.0 Request processed in 25us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635379.622308:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1789635379.622344:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d057b599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427328384:0@lo:400:kworker.0 00000100:00100000:3.0:1789635379.622355:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447918380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876568427328896:0@lo:400:kworker.0 00010000:00080000:3.0:1789635379.622365:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0541326300 x1876568427329408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635379.622375:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427329408:0@lo:400:kworker.0 00000100:00100000:3.0:1789635379.622396:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427329920:0@lo:400:kworker.0 00000100:00100000:3.0:1789635379.622406:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876568427328512:0@lo:400:kworker.0 00000100:00100000:3.0:1789635379.622414:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044791ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1876568427329024:0@lo:400:kworker.0 00000100:00100000:3.0:1789635379.622423:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1876568427329536:0@lo:400:kworker.0 00000100:00080000:0.0:1789635379.622619:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789635379.622622:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789635379.622625:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789635379.622632:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789635379.622650:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0541327b80 x1876568427329664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635379.622661:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541327b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1876568427329664:0@lo:400:kworker.0 00010000:00080000:0.0:1789635379.622671:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447918000 x1876568427329152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635379.622680:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427329152:0@lo:400:kworker.0 00000100:00100000:3.0:1789635379.623543:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427330048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789635379.623591:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635379.624329:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427330048 00000100:00100000:1.0:1789635379.624347:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427330048 00000100:00100000:1.0:1789635379.624402:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789635379.624410:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05412aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427330048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789635379.624437:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789635379.624488:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05412aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427330048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635379.624495:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789635379.624862:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427330048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789635379.625040:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427330176:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789635379.625075:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635379.625129:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427330176 00000100:00100000:3.0:1789635379.625134:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427330176 00000100:00100000:3.0:1789635379.625167:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789635379.625174:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447828a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427330176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789635379.625187:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635379.625447:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447828a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427330176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 272us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635379.625454:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789635379.625544:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427330176:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789635380.387844:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789635380.453209:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789635380.454643:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789635380.644860:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05412aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427330304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635380.644951:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635380.645884:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427330304 00000100:00100000:3.0:1789635380.645895:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427330304 00000100:00100000:3.0:1789635380.645960:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789635380.645970:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427330304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789635380.646009:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635380.646073:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427330304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635380.646081:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00080000:0.0:1789635380.646315:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05412aed80 x1876568427330304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635380.646336:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05412aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427330304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789635381.159948:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427330432:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789635381.160019:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635381.160427:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427330432 00000100:00100000:0.0:1789635381.160436:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427330432 00000100:00100000:0.0:1789635381.160506:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789635381.160547:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427330432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789635381.160652:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635381.160744:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427330432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 202us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635381.160752:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:1.0:1789635381.160894:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789635381.160916:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0575ad8e00 x1876568427330432/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635381.160935:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427330432:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789635381.412665:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635382.443653:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635382.691957:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427330560:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789635382.692047:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635382.692173:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427330560 00000100:00100000:1.0:1789635382.692181:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427330560 00000100:00100000:1.0:1789635382.692238:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789635382.692259:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427330560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789635382.692309:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789635382.692370:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427330560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635382.692377:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789635382.692421:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427330560:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789635382.696921:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05412aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427330688:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789635382.696993:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635382.697268:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427330688 00000100:00100000:1.0:1789635382.697278:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427330688 00000100:00100000:1.0:1789635382.697340:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789635382.697350:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427330688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789635382.697383:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789635382.697437:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427330688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635382.697459:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789635382.697543:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05412aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427330688:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789635382.747699:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635382.747783:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635382.747821:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635382.747879:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635382.747962:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411504128 00000100:00100000:0.0:1789635382.747971:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411504128 00000100:00100000:0.0:1789635382.748042:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411504256 00000100:00100000:0.0:1789635382.748051:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411504256 00000100:00100000:0.0:1789635382.748075:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 281 00000100:00100000:0.0:1789635382.748083:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411504128:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635382.748151:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411504128:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 69us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635382.748158:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 281 00000100:00100000:0.0:1789635382.748173:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 282 00000100:00100000:0.0:1789635382.748178:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411504256:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635382.748200:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411504256:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 22us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635382.748205:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 282 00000100:00100000:3.0:1789635382.748539:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411504000 00000100:00100000:3.0:1789635382.748544:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411504000 00000100:00100000:3.0:1789635382.748585:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 382 00000100:00100000:3.0:1789635382.748616:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054645a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2399:x1876568411504000:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635382.748658:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054645a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2399:x1876568411504000:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 65us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635382.748664:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 382 00000100:00100000:3.0:1789635382.748691:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411504384 00000100:00100000:3.0:1789635382.748694:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411504384 00000100:00100000:3.0:1789635382.748724:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:3.0:1789635382.748731:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05489c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2395:x1876568411504384:12345-192.168.203.20@tcp:9:kworker.0 00000020:00000080:3.0:1789635382.748750:0:8432:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40f119 00000100:00080000:3.0:1789635382.748770:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8d04478c3000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789635382.748814:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:3.0:1789635382.748933:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05489c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+2:2395:x1876568411504384:12345-192.168.203.20@tcp:9:kworker.0 Request processed in 202us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635382.748940:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 27 00010000:00010000:0.0:1789635382.749141:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789635382.749282:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789635382.749287:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789635382.749289:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635382.762678:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635382.762784:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635382.763110:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411504512 00000100:00100000:0.0:1789635382.763121:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411504512 00000100:00100000:0.0:1789635382.763197:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411504640 00000100:00100000:0.0:1789635382.763201:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411504640 00000100:00100000:0.0:1789635382.763228:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 283 00000100:00100000:0.0:1789635382.763239:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05489cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411504512:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635382.763348:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05489cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411504512:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 110us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635382.763356:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 283 00000100:00100000:0.0:1789635382.763373:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 284 00000100:00100000:0.0:1789635382.763380:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05489c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2399:x1876568411504640:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635382.763408:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05489c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2399:x1876568411504640:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 28us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635382.763431:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 284 00000100:00080000:2.0:1789635382.764740:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789635382.764748:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789635383.459817:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635384.485729:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635384.740105:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789635384.740127:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427330816:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789635384.740193:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635384.740316:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427330816 00000100:00100000:2.0:1789635384.740325:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427330816 00000100:00100000:2.0:1789635384.740385:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789635384.740396:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541324380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427330816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789635384.740422:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789635384.740539:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427330816:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789635384.740570:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789635384.740636:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541324380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427330816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 242us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635384.740644:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789635384.740837:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05412ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427331328:0@lo:400:kworker.0 00000100:00100000:3.0:1789635384.740869:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635384.741000:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05412ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427331840:0@lo:400:kworker.0 00000100:00100000:3.0:1789635384.741025:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635384.741042:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05412ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427332352:0@lo:400:kworker.0 00000100:00100000:3.0:1789635384.741073:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635384.741093:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789635384.741098:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05412ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427331200:0@lo:400:kworker.0 00000100:00100000:3.0:1789635384.741117:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635384.741132:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05412ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427331712:0@lo:400:kworker.0 00000100:00100000:3.0:1789635384.741155:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635384.741172:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05412ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1876568427332224:0@lo:400:kworker.0 00000100:00100000:3.0:1789635384.741191:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635384.741215:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427331328 00000100:00100000:3.0:1789635384.741219:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427331328 00000100:00100000:3.0:1789635384.741244:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427331200 00000100:00100000:3.0:1789635384.741247:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427331200 00000100:00100000:3.0:1789635384.741262:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789635384.741268:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05412ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427331328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635384.741305:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05412ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427331328:12345-0@lo:400:kworker.0 Request processed in 36us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635384.741312:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789635384.741326:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789635384.741332:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05412aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427331200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635384.741356:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05412aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427331200:12345-0@lo:400:kworker.0 Request processed in 25us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635384.741361:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789635384.741377:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427331840 00000100:00100000:3.0:1789635384.741380:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427331840 00000100:00100000:3.0:1789635384.741409:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427332352 00000100:00100000:3.0:1789635384.741412:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427332352 00000100:00100000:3.0:1789635384.741429:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789635384.741441:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05412af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427331840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635384.741561:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05412af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427330944:0@lo:400:kworker.0 00000100:00100000:2.0:1789635384.741590:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635384.742100:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427331712 00000100:00100000:0.0:1789635384.742104:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427331712 00000100:00100000:0.0:1789635384.742132:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427332224 00000100:00100000:0.0:1789635384.742135:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427332224 00000100:00100000:0.0:1789635384.742158:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789635384.742165:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e017100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876568427331712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635384.742211:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e017100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876568427331712:12345-0@lo:400:kworker.0 Request processed in 47us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635384.742217:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789635384.742229:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1789635384.742236:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876568427332224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635384.742263:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876568427332224:12345-0@lo:400:kworker.0 Request processed in 28us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635384.742268:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1789635384.742309:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789635384.742317:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05412aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427332352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635384.742347:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05412aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427332352:12345-0@lo:400:kworker.0 Request processed in 32us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635384.742353:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1789635384.742372:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789635384.742375:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789635384.742377:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789635384.742396:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05412ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427331200:0@lo:400:kworker.0 00010000:00080000:0.0:1789635384.742410:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05412ad500 x1876568427331712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635384.742433:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05412ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427331712:0@lo:400:kworker.0 00010000:00080000:0.0:1789635384.742444:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05412ace00 x1876568427332224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635384.742521:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05412adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876568427331072:0@lo:400:kworker.0 00000100:00100000:1.0:1789635384.742552:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635384.742572:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05412ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1876568427331584:0@lo:400:kworker.0 00000100:00100000:1.0:1789635384.742590:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635384.742627:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05412af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1876568427332096:0@lo:400:kworker.0 00000100:00100000:1.0:1789635384.742648:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635384.742664:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789635384.742669:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427332480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635384.742688:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635384.743272:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05412ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1876568427332224:0@lo:400:kworker.0 00000100:00100000:0.0:1789635384.743289:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05412ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427331328:0@lo:400:kworker.0 00000100:00100000:0.0:1789635384.743298:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05412ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427332352:0@lo:400:kworker.0 00000100:00100000:3.0:1789635384.743485:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05412af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427331840:12345-0@lo:400:kworker.0 Request processed in 2043us (2458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635384.743493:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789635384.743517:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427331072 00000100:00100000:3.0:1789635384.743522:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427331072 00000100:00100000:3.0:1789635384.743544:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427331584 00000100:00100000:3.0:1789635384.743547:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427331584 00000100:00100000:3.0:1789635384.743564:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427332096 00000100:00100000:3.0:1789635384.743566:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427332096 00000100:00100000:3.0:1789635384.743578:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1789635384.743584:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876568427331072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635384.743634:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876568427331072:12345-0@lo:400:kworker.0 Request processed in 49us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635384.743640:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1789635384.743651:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789635384.743657:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876568427331584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635384.743696:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876568427331584:12345-0@lo:400:kworker.0 Request processed in 38us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635384.743702:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789635384.743723:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789635384.743729:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876568427332096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635384.743766:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876568427332096:12345-0@lo:400:kworker.0 Request processed in 37us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635384.743772:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00080000:3.0:1789635384.743788:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789635384.743804:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05412ac700 x1876568427331840/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635384.743820:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05412ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427331840:0@lo:400:kworker.0 00000100:00100000:2.0:1789635384.744846:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05412ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427331456:0@lo:400:kworker.0 00000100:00100000:2.0:1789635384.744900:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635384.744923:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05412afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427331968:0@lo:400:kworker.0 00000100:00100000:2.0:1789635384.744945:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635384.744976:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427330944 00000100:00100000:2.0:1789635384.744982:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427330944 00000100:00100000:2.0:1789635384.745013:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1789635384.745020:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054645a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3640:x1876568427330944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635384.745055:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054645a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3640:x1876568427330944:12345-0@lo:400:kworker.0 Request processed in 35us (3464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635384.745061:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1789635384.745154:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427331456 00000100:00100000:2.0:1789635384.745158:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427331456 00000100:00100000:2.0:1789635384.745181:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1789635384.745188:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05489caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427331456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635384.745229:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05489caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427331456:12345-0@lo:400:kworker.0 Request processed in 42us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635384.745235:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1789635384.745277:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427331968 00000100:00100000:2.0:1789635384.745281:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427331968 00000100:00100000:2.0:1789635384.745310:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789635384.745316:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05489cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427331968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635384.745347:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05489cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427331968:12345-0@lo:400:kworker.0 Request processed in 32us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635384.745353:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789635384.745375:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05412af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427330944:0@lo:400:kworker.0 00000100:00100000:2.0:1789635384.745385:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05412ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427331456:0@lo:400:kworker.0 00010000:00080000:2.0:1789635384.745395:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05412afb80 x1876568427331968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635384.745404:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05412afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427331968:0@lo:400:kworker.0 00000100:00080000:2.0:1789635384.745431:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789635384.746059:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05412adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876568427331072:0@lo:400:kworker.0 00000100:00100000:0.0:1789635384.746071:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05412ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1876568427331584:0@lo:400:kworker.0 00000100:00100000:0.0:1789635384.746081:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05412af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1876568427332096:0@lo:400:kworker.0 00000100:00100000:3.0:1789635384.746328:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427332480 00000100:00100000:3.0:1789635384.746333:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427332480 00000100:00100000:3.0:1789635384.746365:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789635384.746372:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427332480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789635384.746390:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635384.746569:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427332480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 196us (3879us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635384.746575:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789635384.746828:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427332480:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789635385.507779:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635385.764851:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789635385.764872:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044791ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427332608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789635385.764931:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635385.765198:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427332608 00000100:00100000:3.0:1789635385.765206:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427332608 00000100:00100000:3.0:1789635385.765255:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789635385.765264:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05489c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427332608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789635385.765290:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635385.765339:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05489c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427332608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635385.765346:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00010000:00080000:2.0:1789635385.765443:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d044791ad80 x1876568427332608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635401 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635385.765462:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044791ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427332608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635386.276076:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789635386.276097:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427332736:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789635386.276160:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635386.276340:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427332736 00000100:00100000:2.0:1789635386.276348:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427332736 00000100:00100000:2.0:1789635386.276426:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789635386.276436:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427332736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789635386.276456:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635386.276501:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427332736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635386.276519:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00080000:2.0:1789635386.276553:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0575ad9f80 x1876568427332736/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635386.276571:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427332736:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789635386.278267:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789635386.531817:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635387.557630:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635387.812017:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427332864:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789635387.812103:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635387.812180:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427332864 00000100:00100000:0.0:1789635387.812189:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427332864 00000100:00100000:1.0:1789635387.812203:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789635387.812225:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427332992:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789635387.812247:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789635387.812253:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635387.812256:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05489cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427332864:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789635387.812532:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427332992 00000100:00100000:3.0:1789635387.812537:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427332992 00000004:00000024:0.0:1789635387.812559:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789635387.812650:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789635387.812659:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427332992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789635387.812680:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789635387.812743:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427332992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635387.812750:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789635387.812789:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05489cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427332864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 534us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635387.812795:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789635387.813028:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427332864:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789635387.813103:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427332992:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789635387.833478:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635387.833534:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635387.833579:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635387.833658:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635387.833882:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411504896 00000100:00100000:2.0:1789635387.833894:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411504896 00000100:00100000:2.0:1789635387.833975:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411505152 00000100:00100000:2.0:1789635387.833978:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411505152 00000100:00100000:2.0:1789635387.834002:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 291 00000100:00100000:2.0:1789635387.834012:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411504896:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635387.834478:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411504896:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 466us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635387.834486:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 291 00000100:00100000:2.0:1789635387.834506:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411505024 00000100:00100000:2.0:1789635387.834647:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411505024 00000100:00100000:2.0:1789635387.834673:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 292 00000100:00100000:2.0:1789635387.834682:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2399:x1876568411505152:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635387.834722:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2399:x1876568411505152:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 33us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635387.834730:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 292 00000100:00100000:2.0:1789635387.834743:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 293 00000100:00100000:2.0:1789635387.834750:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411505024:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635387.834776:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411505024:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 27us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635387.834782:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 293 00000100:00080000:0.0:1789635387.835011:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789635387.835023:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635387.835237:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411504768 00000100:00100000:1.0:1789635387.835255:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411504768 00000100:00100000:1.0:1789635387.835310:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 384 00000100:00100000:1.0:1789635387.835319:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0565a0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2399:x1876568411504768:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789635387.835356:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0565a0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2399:x1876568411504768:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 40us (1776us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635387.835363:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 384 00000100:00100000:0.0:1789635387.837261:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635387.837801:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411505280 00000100:00100000:2.0:1789635387.837812:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411505280 00000100:00100000:2.0:1789635387.837895:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 294 00000100:00100000:2.0:1789635387.837907:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05412af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2399:x1876568411505280:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635387.837999:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05412af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2399:x1876568411505280:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 95us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635387.838007:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 294 00000100:00080000:0.0:1789635387.838212:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:0.0:1789635388.338908:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e1c17f2-a595-4ed0-97c8-b9260d0850ab 00000020:00000080:0.0:1789635388.338917:0:9509:0:(genops.c:885:class_export_put()) final put ffff8d04478c1800/6e1c17f2-a595-4ed0-97c8-b9260d0850ab 00000020:00000080:3.0:1789635388.339004:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffff8d04478c1800/6e1c17f2-a595-4ed0-97c8-b9260d0850ab for lustre-OST0001 00000020:00000080:3.0:1789635388.339093:0:492:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d04478c3000 for lustre-OST0001 00010000:00010000:1.0:1789635388.581252:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635389.617658:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635389.859869:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05412ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427333120:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789635389.859972:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635389.860097:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427333120 00000100:00100000:0.0:1789635389.860106:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427333120 00000100:00100000:0.0:1789635389.860185:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789635389.860396:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541326680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427333120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789635389.860431:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635389.860499:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541326680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427333120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 305us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635389.860506:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789635389.860562:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05412ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427333120:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789635389.860962:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789635389.876797:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05412ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427333248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789635389.876874:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635389.889846:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427333248 00000100:00100000:0.0:1789635389.889863:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427333248 00000100:00100000:0.0:1789635389.889935:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789635389.889945:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044791ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427333248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789635389.889971:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635389.890047:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044791ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427333248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (13179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635389.890054:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789635389.890121:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05412ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427333248:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789635389.890146:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789635389.890620:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427333376:0@lo:400:kworker.0 00000100:00100000:1.0:1789635389.890661:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635389.890694:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876568427333888:0@lo:400:kworker.0 00000100:00100000:1.0:1789635389.890739:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635389.890756:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427334400:0@lo:400:kworker.0 00000100:00100000:1.0:1789635389.890779:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635389.890797:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789635389.890802:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427333760:0@lo:400:kworker.0 00000100:00100000:1.0:1789635389.890825:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635389.890840:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427334272:0@lo:400:kworker.0 00000100:00100000:1.0:1789635389.890855:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635389.890876:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427333504:0@lo:400:kworker.0 00000100:00100000:1.0:1789635389.890895:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635389.890908:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427334016:0@lo:400:kworker.0 00000100:00100000:1.0:1789635389.890928:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635389.890956:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427334528:0@lo:400:kworker.0 00000100:00100000:1.0:1789635389.890977:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635389.890995:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789635389.891000:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427333632:0@lo:400:kworker.0 00000100:00100000:1.0:1789635389.891021:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635389.891037:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1876568427334144:0@lo:400:kworker.0 00000100:00100000:1.0:1789635389.891065:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635389.891081:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1876568427334656:0@lo:400:kworker.0 00000100:00100000:1.0:1789635389.891100:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635389.891120:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427333888 00000100:00100000:1.0:1789635389.891125:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427333888 00000100:00100000:1.0:1789635389.891150:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427333504 00000100:00100000:1.0:1789635389.891153:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427333504 00000100:00100000:1.0:1789635389.891165:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427334016 00000100:00100000:1.0:1789635389.891168:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427334016 00000100:00100000:1.0:1789635389.891188:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427334528 00000100:00100000:1.0:1789635389.891191:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427334528 00000100:00100000:2.0:1789635389.891231:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427333376 00000100:00100000:2.0:1789635389.891238:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427333376 00000100:00100000:2.0:1789635389.891269:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1789635389.891277:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0565a08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3643:x1876568427333376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635389.891325:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0565a08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3643:x1876568427333376:12345-0@lo:400:kworker.0 Request processed in 49us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635389.891331:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1789635389.891366:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427334144 00000100:00100000:2.0:1789635389.891370:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427334144 00000100:00100000:2.0:1789635389.891387:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427334656 00000100:00100000:2.0:1789635389.891389:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427334656 00000100:00100000:2.0:1789635389.891403:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1789635389.891409:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876568427333888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635389.891441:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876568427333888:12345-0@lo:400:kworker.0 Request processed in 33us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635389.891448:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1789635389.891461:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1789635389.891518:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427334400 00000100:00100000:3.0:1789635389.891522:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427334400 00000100:00100000:3.0:1789635389.891549:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427334272 00000100:00100000:3.0:1789635389.891552:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427334272 00000100:00100000:3.0:1789635389.891567:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789635389.891574:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543295180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427334400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635389.891625:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543295180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427334400:12345-0@lo:400:kworker.0 Request processed in 51us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635389.891631:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789635389.891643:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789635389.891649:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543294700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427334272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635389.891676:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543294700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427334272:12345-0@lo:400:kworker.0 Request processed in 27us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635389.891682:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789635389.891715:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1789635389.891722:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427334016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635389.891756:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427334016:12345-0@lo:400:kworker.0 Request processed in 35us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635389.891762:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1789635389.891775:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1789635389.891781:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0558968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876568427334144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635389.891807:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0558968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876568427334144:12345-0@lo:400:kworker.0 Request processed in 27us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635389.891823:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1789635389.891836:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1789635389.891843:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d055896bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876568427334656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635389.891873:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d055896bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876568427334656:12345-0@lo:400:kworker.0 Request processed in 30us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635389.891878:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00010000:00080000:3.0:1789635389.891915:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0543294a80 x1876568427334144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635389.891927:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1876568427334144:0@lo:400:kworker.0 00010000:00080000:3.0:1789635389.891938:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0543294380 x1876568427334656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635389.891945:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1876568427334656:0@lo:400:kworker.0 00000100:00100000:3.0:1789635389.891953:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427334016:0@lo:400:kworker.0 00000100:00100000:3.0:1789635389.891995:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427333760 00000100:00100000:3.0:1789635389.891998:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427333760 00000100:00100000:3.0:1789635389.892020:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427333632 00000100:00100000:3.0:1789635389.892022:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427333632 00000100:00100000:3.0:1789635389.892031:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789635389.892037:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427333760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635389.892066:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427333760:12345-0@lo:400:kworker.0 Request processed in 30us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635389.892072:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789635389.892082:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789635389.892088:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427333632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635389.892124:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427333632:12345-0@lo:400:kworker.0 Request processed in 37us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635389.892130:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789635389.892151:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427333632:0@lo:400:kworker.0 00000100:00100000:3.0:1789635389.892172:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427333760:0@lo:400:kworker.0 00010000:00080000:3.0:1789635389.892182:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0543297100 x1876568427334272/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635389.892191:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427334272:0@lo:400:kworker.0 00000100:00100000:3.0:1789635389.892200:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427333376:0@lo:400:kworker.0 00000100:00100000:3.0:1789635389.892209:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876568427333888:0@lo:400:kworker.0 00010000:00080000:3.0:1789635389.892218:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0543295c00 x1876568427334400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635389.892226:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427334400:0@lo:400:kworker.0 00000100:00100000:1.0:1789635389.893168:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1789635389.893178:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427334528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635389.893250:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427334528:12345-0@lo:400:kworker.0 Request processed in 73us (2271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635389.893256:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1789635389.895242:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427333504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635389.895329:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427333504:12345-0@lo:400:kworker.0 Request processed in 3861us (4432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635389.895339:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00080000:0.0:1789635389.895842:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789635389.895848:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789635389.895851:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635389.896760:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427333504:0@lo:400:kworker.0 00000100:00100000:3.0:1789635389.896775:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427334528:0@lo:400:kworker.0 00010000:00010000:0.0:1789635390.627943:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789635390.696465:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789635390.705457:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789635390.888908:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789635390.888929:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427334784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635390.888992:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635390.889036:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427334784 00000100:00100000:3.0:1789635390.889044:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427334784 00000100:00100000:3.0:1789635390.889451:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789635390.889470:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543296300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427334784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789635390.889498:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635390.889551:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543296300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427334784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635390.889557:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00010000:00080000:1.0:1789635390.889687:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0541324700 x1876568427334784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635390.889718:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427334784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789635391.398394:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789635391.398417:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05489c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427334912:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789635391.398482:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635391.398549:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427334912 00000100:00100000:2.0:1789635391.398557:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427334912 00000100:00100000:2.0:1789635391.398633:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789635391.398644:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05489ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427334912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789635391.398665:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635391.398719:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05489ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427334912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635391.398726:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:2.0:1789635391.398770:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789635391.398798:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05489c9c00 x1876568427334912/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635391.398850:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05489c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427334912:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789635391.662123:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635392.676929:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635392.934954:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d055896b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427335040:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789635392.935038:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635392.935202:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427335040 00000100:00100000:1.0:1789635392.935210:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427335040 00000100:00100000:1.0:1789635392.935273:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789635392.935282:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05489c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427335040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789635392.935315:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789635392.935365:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05489c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427335040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635392.935372:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789635392.935413:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d055896b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427335040:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789635392.938088:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789635392.938108:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d055896b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427335168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789635392.938173:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635392.938220:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427335168 00000100:00100000:1.0:1789635392.938228:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427335168 00000100:00100000:1.0:1789635392.938270:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789635392.938278:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0558968e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427335168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789635392.938309:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789635392.938353:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0558968e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427335168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635392.938360:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789635392.938400:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d055896b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427335168:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789635392.953399:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635392.953444:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635392.953481:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635392.953504:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635392.953528:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635392.953557:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411505408 00000100:00100000:3.0:1789635392.953574:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411505408 00000100:00100000:3.0:1789635392.953666:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 386 00000100:00100000:3.0:1789635392.953687:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0565a0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2398:x1876568411505408:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789635392.954026:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411505536 00000100:00100000:1.0:1789635392.954032:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411505536 00000100:00100000:1.0:1789635392.954074:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411505792 00000100:00100000:1.0:1789635392.954078:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411505792 00000100:00100000:1.0:1789635392.954094:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411505664 00000100:00100000:1.0:1789635392.954096:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411505664 00000100:00100000:1.0:1789635392.954108:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411505920 00000100:00100000:1.0:1789635392.954111:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411505920 00000100:00100000:1.0:1789635392.954151:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 301 00000100:00100000:1.0:1789635392.954160:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411505536:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789635392.954197:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411505536:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 39us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635392.954204:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 301 00000100:00100000:1.0:1789635392.954220:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 302 00000100:00100000:1.0:1789635392.954225:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411505792:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789635392.954246:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411505792:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 21us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635392.954251:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 302 00000100:00100000:1.0:1789635392.954261:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 303 00000100:00100000:1.0:1789635392.954266:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411505664:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789635392.954288:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411505664:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 22us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635392.954294:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 303 00000100:00100000:1.0:1789635392.954305:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 304 00000100:00100000:1.0:1789635392.954311:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411505920:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789635392.954332:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411505920:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 22us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635392.954338:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 304 00000100:00080000:1.0:1789635392.954358:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789635392.954362:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635392.954400:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0565a0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2398:x1876568411505408:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 89us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635392.954407:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 386 00010000:00010000:0.0:1789635393.699870:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635394.724829:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635394.980480:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05412ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427335296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789635394.980552:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635394.980850:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789635394.980858:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427335424:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789635394.980896:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635394.981036:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427335296 00000100:00100000:3.0:1789635394.981044:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427335296 00000100:00100000:3.0:1789635394.981100:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427335424 00000100:00100000:3.0:1789635394.981103:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427335424 00000100:00100000:3.0:1789635394.981122:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789635394.981130:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05489c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427335296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789635394.981157:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635394.981201:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05489c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427335296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635394.981207:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789635394.981238:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789635394.981244:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05489ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427335424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789635394.981254:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635394.981280:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05489ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427335424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635394.981286:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:2.0:1789635394.981387:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789635394.981424:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427335424:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789635394.981439:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05412ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427335296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635394.992057:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427335552:0@lo:400:kworker.0 00000100:00100000:3.0:1789635394.992118:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427335936:0@lo:400:kworker.0 00000100:00100000:1.0:1789635394.992140:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635394.992157:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635394.992220:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427336064:0@lo:400:kworker.0 00000100:00100000:0.0:1789635394.992234:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876568427335680:0@lo:400:kworker.0 00000100:00100000:2.0:1789635394.992729:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427335936 00000100:00100000:2.0:1789635394.992738:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427335936 00000100:00100000:2.0:1789635394.992802:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789635394.992811:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427335936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635394.994253:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543292300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427336448:0@lo:400:kworker.0 00000100:00100000:1.0:1789635394.994265:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635394.994302:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635394.994313:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427336576:0@lo:400:kworker.0 00000100:00100000:3.0:1789635394.994329:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789635394.994339:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427335808:0@lo:400:kworker.0 00000100:00100000:1.0:1789635394.994346:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635394.994376:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635394.994395:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427336064 00000100:00100000:3.0:1789635394.994403:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543291c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427336320:0@lo:400:kworker.0 00000100:00100000:1.0:1789635394.994403:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427336064 00000100:00100000:3.0:1789635394.994429:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635394.994447:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1876568427336832:0@lo:400:kworker.0 00000100:00100000:3.0:1789635394.994466:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635394.994493:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427335552 00000100:00100000:3.0:1789635394.994497:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427335552 00000100:00100000:3.0:1789635394.994531:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1789635394.994539:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0565a09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3640:x1876568427335552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635394.994583:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0565a09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3640:x1876568427335552:12345-0@lo:400:kworker.0 Request processed in 45us (2450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635394.994590:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1789635394.994645:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427336448 00000100:00100000:3.0:1789635394.994671:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427336448 00000100:00100000:3.0:1789635394.994707:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427336576 00000100:00100000:3.0:1789635394.994710:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427336576 00000100:00100000:3.0:1789635394.994731:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789635394.994737:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427336448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635394.994772:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427336448:12345-0@lo:400:kworker.0 Request processed in 35us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635394.994777:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789635394.994789:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789635394.994794:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0558968000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427336576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635394.994816:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0558968000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427336576:12345-0@lo:400:kworker.0 Request processed in 23us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635394.994821:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789635394.994851:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427335808 00000100:00100000:3.0:1789635394.994855:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427335808 00000100:00100000:3.0:1789635394.994870:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789635394.994876:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427335808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635394.995110:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427335808:12345-0@lo:400:kworker.0 Request processed in 233us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635394.995118:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789635394.995140:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427336320 00000100:00100000:3.0:1789635394.995144:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427336320 00000100:00100000:3.0:1789635394.995170:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427336832 00000100:00100000:3.0:1789635394.995172:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427336832 00000100:00100000:3.0:1789635394.995192:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1789635394.995198:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876568427336320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635394.995227:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876568427336320:12345-0@lo:400:kworker.0 Request processed in 30us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635394.995243:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1789635394.995257:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1789635394.995264:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876568427336832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635394.995274:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1789635394.995295:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876568427336832:12345-0@lo:400:kworker.0 Request processed in 31us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635394.995301:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1789635394.995363:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d055896b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427336064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635394.995403:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427335808:0@lo:400:kworker.0 00000100:00100000:1.0:1789635394.995410:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d055896b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427336064:12345-0@lo:400:kworker.0 Request processed in 126us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635394.995418:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00010000:00080000:3.0:1789635394.995423:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0543291c00 x1876568427336320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635394.995435:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543291c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427336320:0@lo:400:kworker.0 00010000:00080000:3.0:1789635394.995448:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0543291180 x1876568427336832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635394.995458:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1876568427336832:0@lo:400:kworker.0 00010000:00080000:1.0:1789635394.995467:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0543290380 x1876568427336576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1789635394.995474:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0543292300 x1876568427336448/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635394.995484:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427336576:0@lo:400:kworker.0 00000100:00100000:3.0:1789635394.995489:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543292300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427336448:0@lo:400:kworker.0 00000100:00100000:1.0:1789635394.995503:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427335552:0@lo:400:kworker.0 00000100:00100000:1.0:1789635394.995518:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427336064:0@lo:400:kworker.0 00000100:00080000:3.0:1789635394.995749:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789635394.995754:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789635394.999060:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635394.999119:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d057b599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1876568427336192:0@lo:400:kworker.0 00000100:00100000:0.0:1789635394.999157:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635394.999186:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1876568427336704:0@lo:400:kworker.0 00000100:00100000:0.0:1789635394.999205:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635394.999260:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427335680 00000100:00100000:0.0:1789635394.999268:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427335680 00000100:00100000:1.0:1789635394.999306:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427336192 00000100:00100000:1.0:1789635394.999313:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427336192 00000100:00100000:0.0:1789635394.999318:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427336704 00000100:00100000:0.0:1789635394.999323:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427336704 00000100:00100000:0.0:1789635394.999357:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1789635394.999429:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05412adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876568427335680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635394.999484:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05412adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876568427335680:12345-0@lo:400:kworker.0 Request processed in 119us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635395.004214:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427335936:12345-0@lo:400:kworker.0 Request processed in 11395us (12049us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635395.004230:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789635395.004304:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427335936:0@lo:400:kworker.0 00000100:00080000:2.0:1789635395.004348:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635395.004372:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1789635395.004384:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1789635395.004391:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05412afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876568427336192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635395.004399:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05412ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876568427336704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635395.004462:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05412ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876568427336704:12345-0@lo:400:kworker.0 Request processed in 70us (5255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635395.004470:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1789635395.004514:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05412afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876568427336192:12345-0@lo:400:kworker.0 Request processed in 131us (5354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635395.004522:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1789635395.010178:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876568427335680:0@lo:400:kworker.0 00000100:00100000:2.0:1789635395.010198:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d057b599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1876568427336192:0@lo:400:kworker.0 00000100:00100000:2.0:1789635395.010210:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1876568427336704:0@lo:400:kworker.0 00000100:00100000:0.0:1789635395.012741:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00010000:00010000:2.0:1789635395.752610:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635396.004501:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543292300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427336960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789635396.004570:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635396.004740:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427336960 00000100:00100000:0.0:1789635396.004748:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427336960 00000100:00100000:0.0:1789635396.004820:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789635396.004830:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05489c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427336960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789635396.004857:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789635396.010734:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789635396.017830:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05489c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427336960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 12991us (13250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635396.017858:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00010000:00080000:2.0:1789635396.017956:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0543292300 x1876568427336960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635412 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635396.017980:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543292300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427336960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635396.539190:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427337088:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789635396.539269:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635396.540200:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427337088 00000100:00100000:3.0:1789635396.540210:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427337088 00000100:00080000:1.0:1789635396.540267:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789635396.540282:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789635396.540293:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05412af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427337088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789635396.540330:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635396.542212:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05412af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427337088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1913us (2936us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635396.542371:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00010000:00080000:1.0:1789635396.542789:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0543291180 x1876568427337088/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635412 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635396.542823:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427337088:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789635396.771912:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789635397.128537:0:14064:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 04:56:35 (1789635395) 00010000:00010000:0.0:1789635397.795761:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635398.052033:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789635398.052053:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0558969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427337216:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789635398.052115:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635398.052115:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789635398.052126:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543291c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427337344:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789635398.052174:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635398.052192:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427337216 00000100:00100000:3.0:1789635398.052199:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427337216 00000100:00100000:3.0:1789635398.052246:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427337344 00000100:00100000:3.0:1789635398.052249:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427337344 00000100:00100000:3.0:1789635398.052264:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789635398.052273:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427337216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789635398.052315:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789635398.052370:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427337216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635398.052376:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789635398.052392:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789635398.052397:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05489c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427337344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789635398.052422:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789635398.052451:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05489c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427337344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635398.052456:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789635398.052501:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0558969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427337216:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789635398.052665:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543291c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427337344:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789635398.133487:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635398.133531:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635398.133560:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635398.133592:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635398.133737:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635398.133780:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411506304 00000100:00100000:1.0:1789635398.133789:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411506304 00000100:00100000:1.0:1789635398.133867:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411506560 00000100:00100000:1.0:1789635398.133870:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411506560 00000100:00100000:1.0:1789635398.133886:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411506176 00000100:00100000:1.0:1789635398.133889:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411506176 00000100:00100000:1.0:1789635398.133900:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411506432 00000100:00100000:1.0:1789635398.133902:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411506432 00000100:00100000:1.0:1789635398.133916:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 311 00000100:00100000:1.0:1789635398.133924:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d055896b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411506304:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789635398.133995:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d055896b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411506304:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 71us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635398.134002:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 311 00000100:00100000:1.0:1789635398.134017:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 312 00000100:00100000:1.0:1789635398.134023:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0558969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411506560:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789635398.134046:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0558969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411506560:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 23us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635398.134052:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 312 00000100:00100000:1.0:1789635398.134062:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 313 00000100:00100000:1.0:1789635398.134067:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d055896aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411506176:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789635398.134103:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d055896aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411506176:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 35us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635398.134109:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 313 00000100:00100000:1.0:1789635398.134120:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 314 00000100:00100000:1.0:1789635398.134127:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d055896ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411506432:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789635398.134147:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d055896ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411506432:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 22us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635398.134152:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 314 00000100:00080000:1.0:1789635398.134167:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789635398.134171:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789635398.136564:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411506048 00000100:00100000:3.0:1789635398.136577:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411506048 00000100:00100000:3.0:1789635398.136719:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 388 00000100:00100000:3.0:1789635398.136728:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0565a09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2398:x1876568411506048:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635398.136828:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0565a09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2398:x1876568411506048:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 101us (3351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635398.136836:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 388 00010000:00010000:2.0:1789635398.820846:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635399.700188:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635399.700287:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411506688 00000100:00100000:2.0:1789635399.700296:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411506688 00000100:00100000:2.0:1789635399.700351:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00100000:2.0:1789635399.700360:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0558968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:11077:x1876568411506688:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789635399.700380:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635399.700425:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f1f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73fb9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635399.700497:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f200 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635399.700510:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f200 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635399.700522:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f200 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635399.700561:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789635399.700564:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789635399.700654:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f200 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635399.700679:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f1f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fb9 expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635399.700697:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f200 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fb9 expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635399.700717:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d056f407400) 00010000:00010000:2.0:1789635399.700720:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789635399.700723:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a3a00, rc 0) 00000100:00100000:2.0:1789635399.700782:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0558968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:11077:x1876568411506688:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 423us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635399.701800:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00100000:1.0:1789635399.723262:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635399.723332:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411506816 00000100:00100000:2.0:1789635399.723340:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411506816 00000100:00100000:2.0:1789635399.723409:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 41 00000100:00100000:2.0:1789635399.723418:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d055896b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:11078:x1876568411506816:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789635399.723436:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635399.723454:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f207 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73fc0 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635399.723509:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f20e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635399.723522:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f20e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635399.723533:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f20e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635399.723547:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3c00/0xb0c3a59caa40f215 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635399.723554:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3c00/0xb0c3a59caa40f215 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635399.723561:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3c00/0xb0c3a59caa40f215 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635399.723657:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3600/0xb0c3a59caa40f21c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635399.723665:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3600/0xb0c3a59caa40f21c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635399.723673:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3600/0xb0c3a59caa40f21c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635399.723723:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789635399.723727:0:9526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789635399.723755:0:9526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3600/0xb0c3a59caa40f21c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635399.723764:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f20e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635399.723769:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f20e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635399.723776:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f20e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635399.723782:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3800 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635399.723795:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f20e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635399.723802:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f20e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635399.723814:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d056f407400) 00010000:00010000:2.0:1789635399.723817:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635399.723820:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f20e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635399.723832:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f20e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635399.723844:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3c00/0xb0c3a59caa40f215 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635399.723859:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3c00/0xb0c3a59caa40f215 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635399.723865:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3c00/0xb0c3a59caa40f215 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635399.723869:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3c00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635399.723871:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3c00/0xb0c3a59caa40f215 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635399.723876:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3c00/0xb0c3a59caa40f215 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635399.723884:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8d056f407c00) 00010000:00010000:2.0:1789635399.723887:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635399.723890:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3c00/0xb0c3a59caa40f215 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635399.723896:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3c00/0xb0c3a59caa40f215 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635399.723922:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f207 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fc0 expref: 8 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635399.723932:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3600/0xb0c3a59caa40f21c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fc0 expref: 7 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635399.723940:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d056f407a00) 00010000:00010000:2.0:1789635399.723942:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789635399.723948:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a3600, rc 0) 00000100:00100000:2.0:1789635399.723993:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d055896b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:11078:x1876568411506816:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 578us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635399.724000:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 41 00000100:00100000:1.0:1789635399.749011:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635399.749108:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411506944 00000100:00100000:2.0:1789635399.749118:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411506944 00000100:00100000:2.0:1789635399.749268:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:2.0:1789635399.749279:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0558969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:11078:x1876568411506944:12345-192.168.203.20@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789635399.749356:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0558969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:11078:x1876568411506944:12345-192.168.203.20@tcp:900:lhsmtool_posix.0 Request processed in 80us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635399.749364:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:1.0:1789635399.754886:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635399.757791:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411507200 00000100:00100000:3.0:1789635399.757811:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411507200 00000100:00100000:3.0:1789635399.757908:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 42 00000100:00100000:3.0:1789635399.757923:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d055896a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:11078:x1876568411507200:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789635399.757965:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635399.757992:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f223 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73fc7 expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635399.758085:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f22a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635399.758101:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f22a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635399.758115:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f22a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635399.762514:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f231 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635399.762537:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f231 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635399.762564:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f231 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635399.762713:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139de00/0xb0c3a59caa40f238 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635399.762723:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139de00/0xb0c3a59caa40f238 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635399.762731:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139de00/0xb0c3a59caa40f238 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635399.762742:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1789635399.762830:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f22a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635399.762837:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f22a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635399.762843:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f22a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635399.762850:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d054139cc00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635399.762854:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f22a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635399.762862:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f22a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635399.762874:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d056f407a00) 00010000:00010000:3.0:1789635399.762890:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635399.762901:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f22a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635399.762908:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f22a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635399.762923:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f231 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635399.762930:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f231 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635399.762935:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f231 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635399.762941:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d054139c000 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635399.762944:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f231 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635399.762950:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f231 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635399.762958:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d044766d100) 00010000:00010000:3.0:1789635399.762960:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635399.762963:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f231 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635399.762969:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f231 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635399.765969:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f223 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fc7 expref: 10 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635399.766070:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139de00/0xb0c3a59caa40f238 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fc7 expref: 9 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635399.766081:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d044766d300) 00010000:00010000:3.0:1789635399.766084:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635399.766087:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d054139de00, rc 0) 00000100:00100000:3.0:1789635399.766156:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d055896a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+9:11078:x1876568411507200:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 8237us (11285us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789635399.766164:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 42 00000100:00100000:1.0:1789635399.781317:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635399.781377:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411507328 00000100:00100000:2.0:1789635399.781387:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411507328 00000100:00100000:2.0:1789635399.781449:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 43 00000100:00100000:2.0:1789635399.781459:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0558968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+9:11078:x1876568411507328:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789635399.781553:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0558968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+9:11078:x1876568411507328:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 Request processed in 95us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635399.781560:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 43 00000100:00100000:1.0:1789635399.796452:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635399.796579:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411507456 00000100:00100000:0.0:1789635399.796589:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411507456 00000100:00100000:0.0:1789635399.796675:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 44 00000100:00100000:0.0:1789635399.796692:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d055896a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:11078:x1876568411507456:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1789635399.802754:0:6515:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 6011us 00000100:00100000:3.0:1789635399.829908:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d055896a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:11078:x1876568411507456:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 Request processed in 33207us (33456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635399.829922:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 44 00010000:00010000:0.0:1789635399.861137:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789635399.909192:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789635399.909562:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789635400.113960:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789635400.114000:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0558969180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427337600:0@lo:400:kworker.0 00000100:00100000:0.0:1789635400.114098:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635400.114161:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427337472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789635400.114191:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635400.114228:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427337472 00000100:00100000:0.0:1789635400.114237:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427337472 00000100:00100000:0.0:1789635400.114304:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789635400.114315:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05412ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427337472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789635400.114352:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635400.114410:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05412ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427337472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635400.114417:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789635400.114471:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427337472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789635400.114518:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0558969500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876568427337856:0@lo:400:kworker.0 00000100:00100000:0.0:1789635400.114548:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635400.115453:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427337600 00000100:00100000:2.0:1789635400.115460:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427337600 00000100:00100000:2.0:1789635400.115503:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1789635400.115511:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0565a0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3642:x1876568427337600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635400.115569:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0565a0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3642:x1876568427337600:12345-0@lo:400:kworker.0 Request processed in 59us (1472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635400.115576:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1789635400.115687:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427337728:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789635400.115924:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635400.115950:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427338240:0@lo:400:kworker.0 00000100:00100000:2.0:1789635400.115975:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635400.115997:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789635400.116003:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427338368:0@lo:400:kworker.0 00000100:00100000:2.0:1789635400.116024:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635400.116052:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427337856 00000100:00100000:2.0:1789635400.116056:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427337856 00000100:00100000:2.0:1789635400.116084:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427338240 00000100:00100000:2.0:1789635400.116087:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427338240 00000100:00100000:2.0:1789635400.116103:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427338368 00000100:00100000:2.0:1789635400.116106:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427338368 00000100:00100000:2.0:1789635400.116123:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1789635400.116130:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05412ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876568427337856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635400.124692:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1789635400.124736:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05489cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427338240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635400.124895:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05489cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427338240:12345-0@lo:400:kworker.0 Request processed in 183us (8918us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635400.124903:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1789635400.124943:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1789635400.124952:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05489cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427338368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635400.124984:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05489cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427338368:12345-0@lo:400:kworker.0 Request processed in 35us (8959us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635400.124989:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1789635400.125022:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427337728 00000100:00100000:3.0:1789635400.125032:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427337728 00000100:00100000:3.0:1789635400.125110:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789635400.125117:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05489c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427337728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789635400.125140:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635400.125177:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05489c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427337728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (9254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635400.125184:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789635400.125271:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427338368:0@lo:400:kworker.0 00000100:00100000:3.0:1789635400.125293:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427337728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789635400.125304:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427338240:0@lo:400:kworker.0 00000100:00080000:1.0:1789635400.125548:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789635400.125554:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789635400.125571:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427338112:0@lo:400:kworker.0 00000100:00100000:2.0:1789635400.128267:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05412ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876568427337856:12345-0@lo:400:kworker.0 Request processed in 12122us (13703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635400.128286:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1789635400.128431:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0558969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427337984:0@lo:400:kworker.0 00000100:00100000:2.0:1789635400.128511:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635400.128563:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427338496:0@lo:400:kworker.0 00000100:00100000:2.0:1789635400.128753:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635400.128787:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1876568427339008:0@lo:400:kworker.0 00000100:00100000:2.0:1789635400.128815:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635400.128858:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0558969180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427337600:0@lo:400:kworker.0 00000100:00100000:2.0:1789635400.128926:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427337984 00000100:00100000:2.0:1789635400.128952:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427337984 00000100:00100000:2.0:1789635400.129003:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789635400.129012:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05489c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427337984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635400.129074:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05489c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427337984:12345-0@lo:400:kworker.0 Request processed in 64us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635400.129246:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789635400.129285:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0558969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427337984:0@lo:400:kworker.0 00000100:00100000:2.0:1789635400.129303:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427338496 00000100:00100000:2.0:1789635400.129308:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427338496 00000100:00100000:2.0:1789635400.129349:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427339008 00000100:00100000:2.0:1789635400.129353:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427339008 00000100:00100000:2.0:1789635400.129373:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1789635400.129379:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05489c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427338496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635400.129415:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05489c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427338496:12345-0@lo:400:kworker.0 Request processed in 36us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635400.129421:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1789635400.129434:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1789635400.129440:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876568427339008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635400.129468:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876568427339008:12345-0@lo:400:kworker.0 Request processed in 29us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635400.129474:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00010000:00080000:2.0:1789635400.129502:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447b5ca80 x1876568427338496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635400.129513:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427338496:0@lo:400:kworker.0 00010000:00080000:2.0:1789635400.129522:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447b5c380 x1876568427339008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635400.129554:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1876568427339008:0@lo:400:kworker.0 00000100:00100000:3.0:1789635400.130629:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427338752:0@lo:400:kworker.0 00000100:00100000:3.0:1789635400.130692:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635400.130732:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789635400.130740:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427338880:0@lo:400:kworker.0 00000100:00100000:3.0:1789635400.130768:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635400.130804:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427338752 00000100:00100000:3.0:1789635400.130811:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427338752 00000100:00100000:3.0:1789635400.130857:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789635400.130866:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543293480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427338752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635400.130934:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543293480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427338752:12345-0@lo:400:kworker.0 Request processed in 70us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635400.130942:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789635400.130964:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427338880 00000100:00100000:3.0:1789635400.130967:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427338880 00000100:00100000:3.0:1789635400.130996:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1789635400.131003:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427338880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635400.131043:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427338880:12345-0@lo:400:kworker.0 Request processed in 41us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635400.131050:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1789635400.131089:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427338880:0@lo:400:kworker.0 00010000:00080000:3.0:1789635400.131101:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447b5dc00 x1876568427338752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635400.131110:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427338752:0@lo:400:kworker.0 00000100:00080000:1.0:1789635400.134037:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789635400.134052:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789635400.134057:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789635400.134147:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635400.134202:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427338112 00000100:00100000:1.0:1789635400.134206:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427338624:0@lo:400:kworker.0 00000100:00100000:2.0:1789635400.134214:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427338112 00000100:00100000:1.0:1789635400.134245:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635400.134283:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789635400.134296:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427338112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635400.134300:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427338624 00000100:00100000:1.0:1789635400.134306:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427338624 00000100:00100000:1.0:1789635400.134355:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789635400.134364:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427338624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635400.134372:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427338112:12345-0@lo:400:kworker.0 Request processed in 78us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635400.134381:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789635400.134406:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427338624:12345-0@lo:400:kworker.0 Request processed in 43us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635400.134414:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789635400.135056:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0558969500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876568427337856:0@lo:400:kworker.0 00010000:00080000:0.0:1789635400.135172:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447b5f100 x1876568427338624/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635400.135184:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427338624:0@lo:400:kworker.0 00000100:00100000:0.0:1789635400.135205:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427338112:0@lo:400:kworker.0 00000100:00080000:1.0:1789635400.135251:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789635400.873861:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789635400.933472:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789635400.934217:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789635401.144165:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789635401.144186:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427339136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635401.144253:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635401.144644:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427339136 00000100:00100000:1.0:1789635401.144654:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427339136 00000100:00100000:1.0:1789635401.144703:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789635401.144712:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543292d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427339136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789635401.144741:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789635401.144783:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543292d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427339136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635401.144790:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00010000:00080000:3.0:1789635401.144999:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0543292a00 x1876568427339136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635401.145019:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427339136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635401.638479:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427339264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789635401.638550:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635401.639048:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427339264 00000100:00100000:1.0:1789635401.639058:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427339264 00000100:00100000:1.0:1789635401.639165:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789635401.639176:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575f74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427339264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789635401.639208:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789635401.639486:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575f74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427339264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 312us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635401.639495:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00010000:00080000:3.0:1789635401.639844:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0543292a00 x1876568427339264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635401.639867:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427339264:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789635401.897556:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635402.916914:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635403.023349:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635403.023420:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411507584 00000100:00100000:3.0:1789635403.023431:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411507584 00000100:00100000:3.0:1789635403.023494:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 45 00000100:00100000:3.0:1789635403.023505:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+9:11120:x1876568411507584:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789635403.023525:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635403.023542:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f246 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73fce expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.023827:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f24d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.023841:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f24d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.023851:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f24d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.023865:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f254 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.023871:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f254 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.023878:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f254 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.023915:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f24d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.023921:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f24d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.023928:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f24d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.023935:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d054139c000 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635403.023939:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f24d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.023955:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f24d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.023966:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d056f407400) 00010000:00010000:3.0:1789635403.023969:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635403.023973:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f24d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.023979:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f24d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.023991:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f254 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.023997:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f254 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.024003:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f254 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.024008:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d054139cc00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635403.024012:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f254 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.024017:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f254 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.024023:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d044766dc00) 00010000:00010000:3.0:1789635403.024025:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635403.024028:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f254 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.024041:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f254 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.024194:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f246 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fce expref: 10 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.024204:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d056f407400) 00010000:00010000:3.0:1789635403.024207:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635403.024210:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f246 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fce expref: 10 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.024220:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d054139c600, rc 0) 00000100:00100000:3.0:1789635403.024271:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+9:11120:x1876568411507584:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 768us (930us total) trans 0 rc 301/301 00000100:00100000:3.0:1789635403.024277:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 45 00000100:00080000:1.0:1789635403.024380:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635403.064748:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635403.064806:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411507840 00000100:00100000:2.0:1789635403.064821:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411507840 00000100:00100000:2.0:1789635403.064892:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 46 00000100:00100000:2.0:1789635403.064903:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+9:11120:x1876568411507840:12345-192.168.203.20@tcp:36:lfs.0 00010000:00010000:2.0:1789635403.064956:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635403.064981:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f200 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fb9 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.064999:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d056f407400) 00010000:00010000:2.0:1789635403.065010:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789635403.065079:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40f25b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.065092:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40f25b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.065102:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40f25b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.065133:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40f262 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.065140:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40f262 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.065299:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40f262 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.065826:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f269 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.065836:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f269 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.065843:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f269 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789635403.065855:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000012790e0c reply state 0000000051d06d99 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f269 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.065864:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f269 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.065871:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d0558d1c900) 00010000:00010000:2.0:1789635403.065873:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789635403.065876:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789635403.065880:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789635403.065887:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40f25b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.065892:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40f25b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.065906:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40f25b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.065911:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3400 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635403.065915:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40f25b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.065922:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40f25b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.065930:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0558d1ca00) 00010000:00010000:2.0:1789635403.065933:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635403.065936:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40f25b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.065942:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40f25b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789635403.065954:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000012790e0c reply state 0000000051d06d99 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40f262 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.065962:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40f262 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.065967:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d0558d1cb00) 00010000:00010000:2.0:1789635403.065969:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789635403.065971:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789635403.066077:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+10:11120:x1876568411507840:12345-192.168.203.20@tcp:36:lfs.0 Request processed in 1175us (1337us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789635403.066084:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 46 00000100:00100000:3.0:1789635403.171807:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789635403.171830:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427339392:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789635403.171892:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635403.171960:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427339392 00000100:00100000:3.0:1789635403.171968:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427339392 00000100:00100000:3.0:1789635403.172021:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789635403.172030:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427339392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789635403.172077:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1789635403.172122:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427339392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635403.172128:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789635403.172187:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427339392:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789635403.172967:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789635403.172978:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427339520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789635403.173014:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635403.173297:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427339520 00000100:00100000:0.0:1789635403.173304:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427339520 00000100:00100000:0.0:1789635403.173354:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789635403.173364:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427339520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789635403.173386:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789635403.173635:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427339520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 272us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635403.173642:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789635403.173960:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427339520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789635403.194506:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635403.194550:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635403.194568:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635403.194623:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635403.194652:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411508224 00000100:00100000:0.0:1789635403.194689:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411508224 00000100:00100000:0.0:1789635403.194756:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 321 00000100:00100000:0.0:1789635403.194768:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05412ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2399:x1876568411508224:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635403.194786:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411507968 00000100:00100000:3.0:1789635403.194793:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411507968 00000100:00100000:3.0:1789635403.194835:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 390 00000100:00100000:0.0:1789635403.194843:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05412ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2399:x1876568411508224:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 77us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635403.194845:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2399:x1876568411507968:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635403.194858:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 321 00000100:00100000:0.0:1789635403.194878:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411508096 00000100:00100000:0.0:1789635403.194882:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411508096 00000100:00100000:3.0:1789635403.194883:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2399:x1876568411507968:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 40us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635403.194892:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 390 00000100:00100000:0.0:1789635403.194909:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411508352 00000100:00100000:0.0:1789635403.194913:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411508352 00000100:00100000:3.0:1789635403.194932:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 322 00000100:00100000:3.0:1789635403.194941:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05412ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411508096:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635403.194968:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05412ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411508096:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 28us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635403.199318:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 323 00000100:00100000:0.0:1789635403.199347:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05412ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2399:x1876568411508352:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635403.199419:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05412ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2399:x1876568411508352:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 89us (4824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635403.199426:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 323 00000100:00080000:0.0:1789635403.199459:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789635403.199464:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635403.212148:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 322 00000100:00100000:0.0:1789635403.285419:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635403.290147:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411508480 00000100:00100000:3.0:1789635403.290163:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411508480 00000100:00100000:3.0:1789635403.290220:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 47 00000100:00100000:3.0:1789635403.290375:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05412ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+10:11129:x1876568411508480:12345-192.168.203.20@tcp:101:lctl.0 00010000:00010000:3.0:1789635403.290400:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635403.290421:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f270 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73fd5 expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.290502:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f277 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.290516:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f277 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.290527:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f277 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635403.290582:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789635403.290586:0:10094:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789635403.290666:0:10094:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f277 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.290690:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f270 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fd5 expref: 12 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.290705:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f277 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fd5 expref: 11 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.290713:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d044766dc00) 00010000:00010000:3.0:1789635403.290716:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789635403.290719:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d054139cc00, rc 0) 00000100:00100000:3.0:1789635403.293551:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05412ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+11:11129:x1876568411508480:12345-192.168.203.20@tcp:101:lctl.0 Request processed in 3315us (8132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635403.293564:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 47 00000100:00100000:0.0:1789635403.425088:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635403.425270:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411508608 00000100:00100000:2.0:1789635403.425280:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411508608 00000100:00100000:2.0:1789635403.425339:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 48 00000100:00100000:2.0:1789635403.425349:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05412aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+11:11135:x1876568411508608:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1789635403.425369:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635403.425389:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f27e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73fdc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.425450:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f285 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.425464:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f285 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.425477:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f285 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.425488:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f28c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.425495:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f28c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.425502:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f28c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.425585:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3c00/0xb0c3a59caa40f293 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.425655:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3c00/0xb0c3a59caa40f293 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.425693:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3c00/0xb0c3a59caa40f293 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635403.425728:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789635403.425731:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789635403.425777:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3c00/0xb0c3a59caa40f293 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.425790:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f285 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.425796:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f285 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.425802:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f285 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.425808:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a2e00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635403.425813:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f285 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.425820:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f285 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.425832:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d044766dc00) 00010000:00010000:2.0:1789635403.425835:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635403.425839:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f285 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.425845:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f285 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.425869:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f28c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.425875:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f28c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.425884:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f28c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.425889:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3800 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635403.425891:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f28c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.425896:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f28c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.425904:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d0558d1cb00) 00010000:00010000:2.0:1789635403.425906:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635403.425908:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f28c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.425914:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f28c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.425939:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f27e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fdc expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.425951:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3c00/0xb0c3a59caa40f293 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fdc expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.425968:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d0558d1c900) 00010000:00010000:2.0:1789635403.425970:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789635403.425972:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a3c00, rc 0) 00000100:00100000:2.0:1789635403.426030:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05412aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+12:11135:x1876568411508608:12345-192.168.203.20@tcp:101:bash.0 Request processed in 682us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635403.426037:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 48 00000100:00100000:2.0:1789635403.433114:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635403.434372:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411508864 00000100:00100000:3.0:1789635403.434384:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411508864 00000100:00100000:3.0:1789635403.434450:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 49 00000100:00100000:3.0:1789635403.434458:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b59a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+12:11135:x1876568411508864:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:3.0:1789635403.434477:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635403.434496:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f29a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73fe3 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.434966:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f2a1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.434982:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f2a1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.434992:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f2a1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.435007:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8600/0xb0c3a59caa40f2a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.435014:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8600/0xb0c3a59caa40f2a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.435021:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8600/0xb0c3a59caa40f2a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789635403.435441:0:9526:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1789635403.436092:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f2af lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.436106:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f2af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.436114:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f2af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.436155:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f2a1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.436161:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f2a1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.436168:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f2a1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.436174:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d054139c000 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635403.436178:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f2a1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.436186:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f2a1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.436197:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d0558d1c900) 00010000:00010000:3.0:1789635403.436201:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635403.436205:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f2a1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.436211:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f2a1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789635403.436224:0:9526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac321d9f reply state 00000000e2e27c77 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8600/0xb0c3a59caa40f2a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.436413:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8600/0xb0c3a59caa40f2a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.436419:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d044766db00) 00010000:00010000:3.0:1789635403.436427:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789635403.436430:0:9526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789635403.436467:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f29a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fe3 expref: 15 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.436483:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f2af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fe3 expref: 14 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.436491:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d044766d900) 00010000:00010000:3.0:1789635403.436493:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789635403.436496:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056f6e9a00, rc 0) 00000100:00100000:3.0:1789635403.438125:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b59a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+15:11135:x1876568411508864:12345-192.168.203.20@tcp:101:bash.0 Request processed in 3659us (5012us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1789635403.438138:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 49 00000100:00100000:0.0:1789635403.450722:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635403.451179:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411508992 00000100:00100000:3.0:1789635403.451189:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411508992 00000100:00100000:3.0:1789635403.451241:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:3.0:1789635403.451249:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05412af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2395:x1876568411508992:12345-192.168.203.20@tcp:8:bash.0 00010000:00080000:3.0:1789635403.451282:0:8432:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 6e1c17f2-a595-4ed0-97c8-b9260d0850ab@192.168.203.20@tcp t0 exp 0000000000000000 cur 422 last 0 00000020:00000080:3.0:1789635403.451314:0:8432:0:(genops.c:1384:class_connect()) connect: client 6e1c17f2-a595-4ed0-97c8-b9260d0850ab, cookie 0xb0c3a59caa40f2bd 00002000:00100000:3.0:1789635403.451325:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6e1c17f2-a595-4ed0-97c8-b9260d0850ab/ffff8d0447ba5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789635403.451342:0:8432:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789635403.451460:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789635403.451489:0:8432:0:(import.c:65:import_set_state_nolock()) ffff8d0447ba3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789635403.451563:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05412af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2395:x1876568411508992:12345-192.168.203.20@tcp:8:bash.0 Request processed in 313us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635403.451571:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:0.0:1789635403.455018:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635403.455105:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411509120 00000100:00100000:1.0:1789635403.455115:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411509120 00000100:00100000:1.0:1789635403.455189:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:1.0:1789635403.455200:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05412ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:0:x1876568411509120:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:1.0:1789635403.455215:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635403.455248:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b971c04/0xb0c3a59caa40f2c4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73fea expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789635403.455274:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789635403.455292:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1789635403.455296:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635403.455305:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b971c04/0xb0c3a59caa40f2c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fea expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635403.455325:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b971c04/0xb0c3a59caa40f2c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fea expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635403.455339:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e152e00, rc 0) 00000100:00100000:1.0:1789635403.455395:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05412ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:0:x1876568411509120:12345-192.168.203.20@tcp:101:bash.0 Request processed in 197us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635403.455402:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00080000:0.0:1789635403.457239:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789635403.467866:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635403.467963:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411509248 00000100:00100000:3.0:1789635403.467973:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411509248 00000100:00100000:3.0:1789635403.468031:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:3.0:1789635403.468042:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0558969500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:11135:x1876568411509248:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:3.0:1789635403.468059:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635403.468079:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c971bec1/0xb0c3a59caa40f2cb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73ff1 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.468109:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001b971c04/0xb0c3a59caa40f2c4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fea expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.468118:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635403.468123:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635403.468129:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c971bec1/0xb0c3a59caa40f2cb lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ff1 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.468163:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001b971c04/0xb0c3a59caa40f2c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fea expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.468176:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001b971c04/0xb0c3a59caa40f2c4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fea expref: 8 pid: 8430 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635403.468189:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543292a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1876568427339648:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789635403.468287:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0548dc6240 going to sleep for 11 seconds 00000100:00100000:3.0:1789635403.471931:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543292a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1876568427339648:192.168.203.20@tcp:104: 00010000:00010000:3.0:1789635403.471969:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c971bec1/0xb0c3a59caa40f2cb lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ff1 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.472005:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056f6e8400, rc 0) 00000100:00100000:3.0:1789635403.472062:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0558969500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:11135:x1876568411509248:12345-192.168.203.20@tcp:101:bash.0 Request processed in 4021us (4204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635403.472070:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:0.0:1789635403.477500:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635403.479822:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411509376 00000100:00100000:3.0:1789635403.479836:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411509376 00010000:00010000:3.0:1789635403.479878:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001b971c04/0xb0c3a59caa40f2c4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fea expref: 8 pid: 8430 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635403.479923:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 52 00000100:00100000:3.0:1789635403.479934:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b404450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:2396:x1876568411509376:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635403.479950:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635403.479970:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001b971c04/0xb0c3a59caa40f2c4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fea expref: 8 pid: 8430 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.479983:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001b971c04/0xb0c3a59caa40f2c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fea expref: 8 pid: 8430 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.480013:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b971c04/0xb0c3a59caa40f2c4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fea expref: 8 pid: 8430 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.480029:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635403.480034:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635403.480041:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c971bec1/0xb0c3a59caa40f2cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ff1 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.480065:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c971bec1/0xb0c3a59caa40f2cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ff1 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.480102:0:6499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c971bec1/0xb0c3a59caa40f2cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ff1 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635403.480116:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543292a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6499:1876568427339776:192.168.203.20@tcp:105: 00000100:00100000:3.0:1789635403.480201:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0548dc6240 going to sleep for 11 seconds 00000100:00100000:3.0:1789635403.483209:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543292a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6499:1876568427339776:192.168.203.20@tcp:105: 00010000:00010000:3.0:1789635403.483306:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635403.483409:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b404450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:2396:x1876568411509376:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 3475us (5916us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635403.483419:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 52 00000100:00100000:2.0:1789635403.493401:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635403.493486:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411509632 00000100:00100000:3.0:1789635403.493496:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411509632 00000100:00100000:3.0:1789635403.493552:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:3.0:1789635403.493562:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0558969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+15:11135:x1876568411509632:12345-192.168.203.20@tcp:35:bash.0 00000100:00100000:3.0:1789635403.493922:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0558969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+16:11135:x1876568411509632:12345-192.168.203.20@tcp:35:bash.0 Request processed in 361us (528us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789635403.493930:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:0.0:1789635403.691972:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635403.692101:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411509888 00000100:00100000:3.0:1789635403.692111:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411509888 00000100:00100000:3.0:1789635403.692172:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 50 00000100:00100000:3.0:1789635403.692183:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05412ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+16:11145:x1876568411509888:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789635403.692222:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635403.692256:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9000/0xb0c3a59caa40f2d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73ff8 expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635403.692359:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789635403.692845:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9000/0xb0c3a59caa40f2d2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ff8 expref: 18 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.692861:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d044766dc00) 00010000:00010000:3.0:1789635403.692864:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789635403.692868:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9000/0xb0c3a59caa40f2d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ff8 expref: 18 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635403.692885:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056f6e9000, rc 0) 00000100:00100000:3.0:1789635403.692945:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05412ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+17:11145:x1876568411509888:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 763us (983us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1789635403.692952:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 50 00000100:00100000:2.0:1789635403.709043:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635403.709136:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411510144 00000100:00100000:3.0:1789635403.709147:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411510144 00000100:00100000:3.0:1789635403.709202:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:3.0:1789635403.709214:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0558969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+17:11145:x1876568411510144:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:3.0:1789635403.709465:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0558969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+18:11145:x1876568411510144:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 253us (432us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789635403.709473:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00010000:00010000:1.0:1789635403.939997:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635403.992918:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635403.993019:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411510272 00000100:00100000:2.0:1789635403.993029:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411510272 00000100:00100000:2.0:1789635403.993092:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00100000:2.0:1789635403.993102:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+18:11151:x1876568411510272:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1789635403.993126:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635403.993146:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f2e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab73fff expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.993211:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f2e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.993225:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f2e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.993236:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f2e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635403.993294:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789635403.993298:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789635403.993318:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f2e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.993346:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f2e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fff expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.993363:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f2e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fff expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635403.993371:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d0558d1c900) 00010000:00010000:2.0:1789635403.993374:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789635403.993377:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a3800, rc 0) 00000100:00100000:2.0:1789635403.993448:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+19:11151:x1876568411510272:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 347us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635403.993455:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00100000:1.0:1789635404.009950:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635404.010404:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411510528 00000100:00100000:3.0:1789635404.010415:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411510528 00000100:00100000:3.0:1789635404.010481:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 52 00000100:00100000:3.0:1789635404.010505:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+19:11151:x1876568411510528:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789635404.010537:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635404.010557:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9000/0xb0c3a59caa40f2ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74006 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.011329:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f2f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.011344:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f2f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.011355:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f2f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635404.011365:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789635404.011476:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9000/0xb0c3a59caa40f2ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74006 expref: 22 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.011492:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f2f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74006 expref: 21 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.011500:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d044766d900) 00010000:00010000:3.0:1789635404.011503:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789635404.011506:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056f6e8800, rc 0) 00000100:00100000:3.0:1789635404.011944:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+21:11151:x1876568411510528:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 1439us (2001us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1789635404.011952:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 52 00000100:00100000:0.0:1789635404.032363:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635404.032560:0:13189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411510656 00000100:00100000:3.0:1789635404.032572:0:13189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411510656 00000100:00100000:3.0:1789635404.032735:0:13189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:3.0:1789635404.032746:0:13189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541325f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+21:2396:x1876568411510656:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635404.032764:0:13189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635404.032791:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f2f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74006 expref: 21 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.032814:0:13189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d044766d900) 00010000:00010000:3.0:1789635404.032819:0:13189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635404.033475:0:13189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541325f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+20:2396:x1876568411510656:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 726us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635404.033486:0:13189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:0.0:1789635404.057985:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635404.058129:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411510912 00000100:00100000:2.0:1789635404.058141:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411510912 00000100:00100000:2.0:1789635404.058206:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:2.0:1789635404.058216:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+20:11151:x1876568411510912:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1789635404.058241:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635404.058259:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f303 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7400d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.058371:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f30a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.058415:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f30a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.058427:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f30a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635404.058441:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789635404.058542:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f303 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7400d expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.058559:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f30a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7400d expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.058567:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d044766d900) 00010000:00010000:2.0:1789635404.058570:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789635404.058573:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a3a00, rc 0) 00000100:00100000:2.0:1789635404.058913:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+22:11151:x1876568411510912:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 697us (935us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789635404.058921:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:1.0:1789635404.158730:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635404.160544:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411511040 00000100:00100000:3.0:1789635404.160559:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411511040 00000100:00100000:3.0:1789635404.160661:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 31 00000100:00100000:3.0:1789635404.160672:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:2397:x1876568411511040:12345-192.168.203.20@tcp:1:lfs.0 00010000:00010000:3.0:1789635404.160713:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c80d3ff/0xb0c3a59caa40f318 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.160732:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c971bec1/0xb0c3a59caa40f2cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ff1 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.160742:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635404.160746:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789635404.160751:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c80d3ff/0xb0c3a59caa40f318 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.160784:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c971bec1/0xb0c3a59caa40f2cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ff1 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.160809:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c971bec1/0xb0c3a59caa40f2cb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ff1 expref: 7 pid: 8432 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635404.160824:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543292a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1876568427339904:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789635404.160902:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d054a0bd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635404.170958:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635404.171203:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411511168 00000100:00100000:2.0:1789635404.171213:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411511168 00002000:00100000:2.0:1789635404.171264:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff8d0543292d80 x1876568411511168/t0(0) o4->6e1c17f2-a595-4ed0-97c8-b9260d0850ab@192.168.203.20@tcp:25/0 lens 504/0 e 0 to 0 dl 1789635415 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789635404.171276:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0543292d80 with x1876568411511168 ext(0->12) 00010000:00010000:2.0:1789635404.171285:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c971bec1/0xb0c3a59caa40f2cb lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ff1 expref: 8 pid: 8432 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.171326:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c971bec1/0xb0c3a59caa40f2cb lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ff1 expref: 8 pid: 8432 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789635404.171335:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d0543292d80 00000100:00100000:2.0:1789635404.171367:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:2.0:1789635404.171377:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543292d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:2397:x1876568411511168:12345-192.168.203.20@tcp:4:lfs.0 00000100:00100000:1.0:1789635404.173494:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543292a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1876568427339904:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789635404.173545:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000c80d3ff/0xb0c3a59caa40f318 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1789635404.189490:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e1c17f2-a595-4ed0-97c8-b9260d0850ab 00000100:00100000:3.0:1789635404.190873:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543292d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+9:2397:x1876568411511168:12345-192.168.203.20@tcp:4:lfs.0 Request processed in 19488us (19915us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789635404.190891:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 0 00002000:00100000:3.0:1789635404.190904:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff8d0543292d80 x1876568411511168/t4294967300(0) o4->6e1c17f2-a595-4ed0-97c8-b9260d0850ab@192.168.203.20@tcp:25/0 lens 504/448 e 0 to 0 dl 1789635415 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789635404.190916:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0543292d80 with x1876568411511168 ext(0->12) 00010000:00010000:3.0:1789635404.190926:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c971bec1/0xb0c3a59caa40f2cb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ff1 expref: 9 pid: 8432 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.190947:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c971bec1/0xb0c3a59caa40f2cb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ff1 expref: 9 pid: 8432 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789635404.190956:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d0543292d80 00000100:00100000:2.0:1789635404.211417:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635404.211865:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411511296 00000100:00100000:1.0:1789635404.211874:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411511296 00010000:00010000:1.0:1789635404.211912:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c971bec1/0xb0c3a59caa40f2cb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ff1 expref: 9 pid: 8432 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635404.211955:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:1.0:1789635404.211965:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+9:2397:x1876568411511296:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635404.211978:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789635404.212002:0:6501:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789635404.212005:0:6501:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1789635403 00002000:00010000:1.0:1789635404.212008:0:6501:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1789635404 00002000:00010000:1.0:1789635404.212010:0:6501:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1789635403 00002000:00010000:1.0:1789635404.212013:0:6501:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1789635404.212019:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c971bec1/0xb0c3a59caa40f2cb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ff1 expref: 9 pid: 8432 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635404.212183:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c971bec1/0xb0c3a59caa40f2cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ff1 expref: 9 pid: 8432 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635404.212207:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c971bec1/0xb0c3a59caa40f2cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ff1 expref: 9 pid: 8432 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635404.213753:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789635404.213775:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789635404.213783:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c80d3ff/0xb0c3a59caa40f318 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635404.213797:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c80d3ff/0xb0c3a59caa40f318 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635404.213879:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635404.213939:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:2397:x1876568411511296:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 1972us (2527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635404.213948:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 53 00010000:00010000:0.0:1789635404.222470:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000c80d3ff/0xb0c3a59caa40f318 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635404.222490:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c80d3ff/0xb0c3a59caa40f318 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635404.222519:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c80d3ff/0xb0c3a59caa40f318 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635404.222537:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c80d3ff/0xb0c3a59caa40f318 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635404.222547:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c80d3ff/0xb0c3a59caa40f318 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635404.222556:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056f6e8800 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:0.0:1789635404.222560:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c80d3ff/0xb0c3a59caa40f318 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635404.222569:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c80d3ff/0xb0c3a59caa40f318 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635404.222615:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c80d3ff/0xb0c3a59caa40f318 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635404.222623:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c80d3ff/0xb0c3a59caa40f318 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635404.222929:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:2397:x1876568411511040:12345-192.168.203.20@tcp:1:lfs.0 Request processed in 62254us (64204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635404.222939:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 31 00000100:00100000:2.0:1789635404.225431:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635404.225512:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411511552 00000100:00100000:3.0:1789635404.225521:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411511552 00000100:00100000:3.0:1789635404.225584:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:3.0:1789635404.225631:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+22:11151:x1876568411511552:12345-192.168.203.20@tcp:35:lfs.0 00000004:00010000:3.0:1789635404.225704:0:6518:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f30a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7400d expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789635404.225892:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1789635404.225931:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1789635404.234330:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:3.0:1789635404.234411:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9000/0xb0c3a59caa40f31f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.234431:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f2af lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fe3 expref: 26 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.234440:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9000/0xb0c3a59caa40f31f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.234480:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f2af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fe3 expref: 26 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.234496:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f2af lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fe3 expref: 26 pid: 9526 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635404.234511:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543291880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6518:1876568427340032:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789635404.234615:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d054a0bd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635404.246250:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543291880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6518:1876568427340032:192.168.203.20@tcp:104: 00010000:00010000:3.0:1789635404.246283:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9000/0xb0c3a59caa40f31f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635404.246485:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635404.247733:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411511680 00000100:00100000:3.0:1789635404.247743:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411511680 00010000:00010000:3.0:1789635404.247783:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f2af lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fe3 expref: 27 pid: 9526 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635404.247844:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 54 00000100:00100000:3.0:1789635404.247854:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+27:2397:x1876568411511680:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635404.247868:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635404.247876:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f2af lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fe3 expref: 27 pid: 9526 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.247888:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f2af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fe3 expref: 27 pid: 9526 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.247910:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f2af lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fe3 expref: 27 pid: 9526 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.247926:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d044766d900) 00010000:00010000:3.0:1789635404.247931:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9000/0xb0c3a59caa40f31f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.247940:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9000/0xb0c3a59caa40f31f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.247947:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9000/0xb0c3a59caa40f31f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.247978:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635404.248023:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+26:2397:x1876568411511680:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 171us (1539us total) trans 0 rc 0/0 00010000:00010000:0.0:1789635404.248148:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9000/0xb0c3a59caa40f31f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635404.248157:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9000/0xb0c3a59caa40f31f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789635404.248267:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:0.0:1789635404.248375:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:0.0:1789635404.248452:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541327b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6518:1876568427340160:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789635404.248494:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635404.248522:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d055161e780 going to sleep for 11 seconds 00000100:00100000:3.0:1789635404.249392:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 54 00000100:00100000:3.0:1789635404.249420:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427340160 00000100:00100000:3.0:1789635404.249434:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427340160 00000100:00100000:3.0:1789635404.249471:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789635404.249480:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6518:x1876568427340160:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789635404.249559:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6518:x1876568427340160:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 80us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635404.249566:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789635404.249624:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541327b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6518:1876568427340160:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789635404.249777:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:3.0:1789635404.249829:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543291880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6518:1876568427340288:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789635404.249859:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635404.249877:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d056e17a000 going to sleep for 11 seconds 00000100:00100000:3.0:1789635404.249890:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427340288 00000100:00100000:3.0:1789635404.249894:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427340288 00000100:00100000:3.0:1789635404.249914:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789635404.249920:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6518:x1876568427340288:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789635404.250002:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6518:x1876568427340288:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 82us (142us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789635404.250009:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:0.0:1789635404.251136:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789635404.253412:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543291880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6518:1876568427340288:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789635404.261949:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1789635404.262016:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9000/0xb0c3a59caa40f31f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.262092:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9000/0xb0c3a59caa40f31f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.262102:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9000/0xb0c3a59caa40f31f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.262109:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056f6e9000 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635404.262113:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9000/0xb0c3a59caa40f31f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.262120:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9000/0xb0c3a59caa40f31f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.262136:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d044766d900) 00010000:00010000:2.0:1789635404.262139:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789635404.262155:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9000/0xb0c3a59caa40f31f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.262161:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9000/0xb0c3a59caa40f31f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789635404.262324:0:6518:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789635404.262384:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1789635404.262394:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 422945796629ns, next at 423945795257ns, rc = 0 00000001:00080000:2.0:1789635404.262400:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1789635404.262422:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d044766d900) 00010000:00010000:2.0:1789635404.262425:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789635404.262433:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f30a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7400d expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635404.262837:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+29:11151:x1876568411511552:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 37206us (37411us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1789635404.262846:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 8 00000020:00080000:2.0:1789635404.262852:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789635404.266176:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635404.266260:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411511808 00000100:00100000:1.0:1789635404.266269:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411511808 00000100:00100000:1.0:1789635404.266326:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 54 00000100:00100000:1.0:1789635404.266335:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+29:11151:x1876568411511808:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789635404.266359:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635404.266379:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153e00/0xb0c3a59caa40f326 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74014 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635404.266429:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153e00/0xb0c3a59caa40f326 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74014 expref: 30 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635404.266444:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153e00/0xb0c3a59caa40f326 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74014 expref: 30 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635404.266460:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:1.0:1789635404.266463:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789635404.266478:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e153e00, rc 0) 00000100:00100000:1.0:1789635404.266536:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+30:11151:x1876568411511808:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 202us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635404.266543:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 54 00000100:00100000:0.0:1789635404.270977:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635404.271067:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411512064 00000100:00100000:2.0:1789635404.271076:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411512064 00000100:00100000:2.0:1789635404.271128:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:2.0:1789635404.271138:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057ae28450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+30:11151:x1876568411512064:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:2.0:1789635404.271769:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057ae28450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+31:11151:x1876568411512064:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 631us (799us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1789635404.271778:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:2.0:1789635404.422272:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635404.422491:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411512320 00000100:00100000:3.0:1789635404.422500:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411512320 00000100:00100000:3.0:1789635404.422679:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:3.0:1789635404.422690:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+31:11161:x1876568411512320:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789635404.422720:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635404.422739:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f32d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7401b expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635404.422845:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789635404.423411:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f32d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7401b expref: 33 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.423426:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d044766dc00) 00010000:00010000:3.0:1789635404.423429:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789635404.423434:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f32d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7401b expref: 33 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.423449:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056f6e9a00, rc 0) 00000100:00100000:3.0:1789635404.423515:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+32:11161:x1876568411512320:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 827us (1252us total) trans 4294967329 rc 301/301 00000100:00100000:3.0:1789635404.423523:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:0.0:1789635404.432980:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635404.433149:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411512448 00000100:00100000:2.0:1789635404.433170:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411512448 00000100:00100000:2.0:1789635404.433232:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 56 00000100:00100000:2.0:1789635404.433242:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+32:11161:x1876568411512448:12345-192.168.203.20@tcp:34:lfs.0 00010000:00010000:2.0:1789635404.433309:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f33b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.433325:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f33b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.433339:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f33b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.433350:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f342 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.433358:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f342 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.433365:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f342 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.433429:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f349 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.433437:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f349 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.433443:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f349 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789635404.433485:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f349 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.433507:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f33b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.433513:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f33b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.433547:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f33b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.433553:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3a00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635404.433557:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f33b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.433565:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f33b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.433577:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d0558d1c900) 00010000:00010000:2.0:1789635404.433580:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635404.433624:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f33b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.433632:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f33b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.433645:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f342 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.433651:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f342 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.433657:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f342 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.433677:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a2600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635404.433681:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f342 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.433687:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f342 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.433695:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d044766db00) 00010000:00010000:2.0:1789635404.433698:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635404.433701:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f342 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.433707:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f342 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.433723:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f349 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.433729:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f349 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.433735:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f349 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.433740:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a2e00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635404.433742:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f349 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.433748:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f349 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.433765:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:2.0:1789635404.433767:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635404.433770:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f349 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.433775:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f349 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635404.433837:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+32:11161:x1876568411512448:12345-192.168.203.20@tcp:34:lfs.0 Request processed in 596us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635404.433845:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 56 00000100:00100000:1.0:1789635404.440068:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635404.440190:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411512704 00000100:00100000:3.0:1789635404.440201:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411512704 00000100:00100000:3.0:1789635404.440265:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:3.0:1789635404.440275:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+32:11161:x1876568411512704:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:3.0:1789635404.440486:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+33:11161:x1876568411512704:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 212us (425us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1789635404.440494:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:0.0:1789635404.497750:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635404.498298:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411512960 00000100:00100000:3.0:1789635404.498308:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411512960 00000100:00100000:3.0:1789635404.498452:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 57 00000100:00100000:3.0:1789635404.498463:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+33:11164:x1876568411512960:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789635404.498485:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635404.498511:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f350 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74022 expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.498582:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9000/0xb0c3a59caa40f357 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.498650:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9000/0xb0c3a59caa40f357 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.498662:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9000/0xb0c3a59caa40f357 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.498681:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f35e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.498688:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f35e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.498695:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f35e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.499127:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8400/0xb0c3a59caa40f365 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.499137:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8400/0xb0c3a59caa40f365 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.499145:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8400/0xb0c3a59caa40f365 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635404.499156:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789635404.499234:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9000/0xb0c3a59caa40f357 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.499250:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9000/0xb0c3a59caa40f357 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.499257:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9000/0xb0c3a59caa40f357 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.499264:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056f6e9000 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635404.499268:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9000/0xb0c3a59caa40f357 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.499276:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9000/0xb0c3a59caa40f357 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.499287:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d0558d1c900) 00010000:00010000:3.0:1789635404.499290:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635404.499294:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9000/0xb0c3a59caa40f357 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.499301:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9000/0xb0c3a59caa40f357 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.499315:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f35e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.499320:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f35e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.499325:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f35e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.499330:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056f6e8800 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635404.499339:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f35e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.499346:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f35e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.499355:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d044766db00) 00010000:00010000:3.0:1789635404.499357:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635404.499360:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f35e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.499367:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f35e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.499403:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f350 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74022 expref: 36 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.499415:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8400/0xb0c3a59caa40f365 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74022 expref: 35 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.499422:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:3.0:1789635404.499424:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789635404.499426:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056f6e8400, rc 0) 00000100:00100000:3.0:1789635404.499478:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+35:11164:x1876568411512960:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 1017us (1735us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1789635404.499486:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 57 00000100:00100000:2.0:1789635404.504370:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635404.504431:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411513088 00000100:00100000:3.0:1789635404.504439:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411513088 00000100:00100000:3.0:1789635404.504487:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 58 00000100:00100000:3.0:1789635404.504497:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0558969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+35:11164:x1876568411513088:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:3.0:1789635404.504568:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f373 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.504756:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f373 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.504778:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f373 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.504811:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f373 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.504818:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f373 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.504825:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f373 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.504831:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d054139c600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635404.504834:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f373 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.504842:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f373 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.504851:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:3.0:1789635404.504854:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789635404.504858:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f373 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.504865:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f373 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635404.504951:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0558969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+35:11164:x1876568411513088:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 455us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635404.504959:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 58 00000100:00100000:1.0:1789635404.508999:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635404.509144:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411513344 00000100:00100000:3.0:1789635404.509153:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411513344 00000100:00100000:3.0:1789635404.509204:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:3.0:1789635404.509213:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+35:11164:x1876568411513344:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:3.0:1789635404.509420:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+36:11164:x1876568411513344:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 207us (428us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1789635404.509428:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:1.0:1789635404.921140:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635404.921336:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411513600 00000100:00100000:0.0:1789635404.921346:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411513600 00000100:00100000:0.0:1789635404.921409:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00100000:0.0:1789635404.921420:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+36:11195:x1876568411513600:12345-192.168.203.20@tcp:101:cat.0 00010000:00010000:0.0:1789635404.921444:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635404.921464:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f37a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74029 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635404.922449:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f381 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635404.922482:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f381 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635404.922494:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f381 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635404.922508:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789635404.922920:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f37a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74029 expref: 39 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635404.922940:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f381 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74029 expref: 38 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635404.922949:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:0.0:1789635404.922952:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789635404.922955:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1a200, rc 0) 00000100:00100000:0.0:1789635404.923022:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+38:11195:x1876568411513600:12345-192.168.203.20@tcp:101:cat.0 Request processed in 1604us (1892us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1789635404.923031:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 59 00000001:00080000:2.0:1789635404.927268:0:6493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967333 is committed 00000004:00080000:2.0:1789635404.927297:0:6493:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1789635404.927319:0:6493:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d057b9119c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1789635404.927323:0:6493:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d044672b700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d054a0bd0c0 00000020:00080000:2.0:1789635404.927326:0:6493:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d044672ba00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d044757d200 00000100:00100000:0.0:1789635404.927542:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789635404.927572:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427340416:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789635404.927684:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1789635404.927875:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1789635404.928025:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:1.0:1789635404.928291:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40f262 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635404.928303:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40f262 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635404.928311:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40f262 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635404.928317:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3e00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635404.928321:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40f262 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635404.928328:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40f262 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635404.928344:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d0558d1cb00) 00010000:00010000:1.0:1789635404.928348:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635404.928353:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40f262 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635404.928359:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40f262 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635404.928388:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f269 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635404.928395:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f269 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635404.928401:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f269 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635404.928405:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3000 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635404.928408:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f269 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635404.928414:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f269 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635404.928422:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d0558d1c900) 00010000:00010000:1.0:1789635404.928425:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635404.928427:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f269 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635404.928433:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f269 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635404.928447:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8600/0xb0c3a59caa40f2a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635404.928454:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8600/0xb0c3a59caa40f2a8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635404.928460:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8600/0xb0c3a59caa40f2a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635404.928470:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056f6e8600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635404.928473:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8600/0xb0c3a59caa40f2a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635404.928479:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8600/0xb0c3a59caa40f2a8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635404.928487:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d044766db00) 00010000:00010000:1.0:1789635404.928489:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635404.928492:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8600/0xb0c3a59caa40f2a8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635404.928497:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8600/0xb0c3a59caa40f2a8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635404.928524:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427340416 00000100:00100000:1.0:1789635404.928531:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427340416 00000100:00100000:3.0:1789635404.928784:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789635404.928796:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541218000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1876568427340416:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789635404.928822:0:8432:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:3.0:1789635404.928849:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6aabab4b, atime: 0x6aabab4c, ctime: 0x6aabab4b, blocks: 0x8 00010000:00010000:3.0:1789635404.928855:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001041820d/0xb0c3a59caa40f38f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.928869:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1789635404.928874:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635404.928880:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001041820d/0xb0c3a59caa40f38f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.928894:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001041820d/0xb0c3a59caa40f38f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.928910:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001041820d/0xb0c3a59caa40f38f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.928917:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001041820d/0xb0c3a59caa40f38f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.928932:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789635404.929064:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541218000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3642:x1876568427340416:12345-0@lo:6:osp-syn-0-0.0 Request processed in 270us (1378us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789635404.929072:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000004:00080000:3.0:1789635404.929117:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d0541218e00/2, rc 0, transno 4294967302 00000100:00100000:3.0:1789635404.929124:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427340416:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1789635404.929320:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635404.929327:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001041820d/0xb0c3a59caa40f38f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.929335:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d054139c600 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635404.929339:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001041820d/0xb0c3a59caa40f38f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.929346:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001041820d/0xb0c3a59caa40f38f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.929370:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001041820d/0xb0c3a59caa40f38f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.929377:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001041820d/0xb0c3a59caa40f38f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.929392:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635404.929393:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635404.929395:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635404.940880:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635404.941080:0:13189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411513728 00000100:00100000:0.0:1789635404.941091:0:13189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411513728 00000100:00100000:0.0:1789635404.941161:0:13189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:0.0:1789635404.941170:0:13189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0558969180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+13:2397:x1876568411513728:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789635404.941196:0:13189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635404.941230:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f381 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74029 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635404.941246:0:13189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:0.0:1789635404.941252:0:13189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635404.941308:0:13189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0558969180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+12:2397:x1876568411513728:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 139us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635404.941315:0:13189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:2.0:1789635404.941525:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635404.941644:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411513984 00000100:00100000:0.0:1789635404.941648:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411513984 00000100:00100000:0.0:1789635404.941695:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:0.0:1789635404.941703:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+12:11195:x1876568411513984:12345-192.168.203.20@tcp:35:cat.0 00000100:00100000:0.0:1789635404.941917:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+13:11195:x1876568411513984:12345-192.168.203.20@tcp:35:cat.0 Request processed in 214us (391us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1789635404.941924:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 12 00010000:00010000:0.0:1789635404.963864:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635405.058244:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635405.068822:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411514240 00000100:00100000:3.0:1789635405.068835:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411514240 00000100:00080000:0.0:1789635405.068903:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635405.068921:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:3.0:1789635405.068933:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054121a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+13:11201:x1876568411514240:12345-192.168.203.20@tcp:101:dd.0 00010000:00010000:0.0:1789635405.069165:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635405.069178:0:10094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789635405.069204:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f2e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fff expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.069223:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d0558d1c900) 00010000:00010000:0.0:1789635405.069228:0:10094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789635405.069241:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f396 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74030 expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.069546:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f39d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.069560:0:10094:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8400/0xb0c3a59caa40f365 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74022 expref: 13 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.069570:0:10094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f39d lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.069842:0:10094:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8400/0xb0c3a59caa40f365 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74022 expref: 13 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.069857:0:10094:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8400/0xb0c3a59caa40f365 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74022 expref: 13 pid: 10094 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635405.069872:0:10094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d054121aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10094:1876568427340544:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789635405.070045:0:10094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0558be5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789635405.086409:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635405.086669:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411514368 00000100:00100000:2.0:1789635405.086680:0:7457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411514368 00010000:00010000:2.0:1789635405.086793:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8400/0xb0c3a59caa40f365 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74022 expref: 14 pid: 10094 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635405.086805:0:10094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d054121aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10094:1876568427340544:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789635405.086833:0:10094:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f39d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635405.088506:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:2.0:1789635405.088527:0:7457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543291180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+14:2397:x1876568411514368:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635405.088558:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635405.088569:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8400/0xb0c3a59caa40f365 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74022 expref: 14 pid: 10094 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.088608:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8400/0xb0c3a59caa40f365 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74022 expref: 14 pid: 10094 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.088633:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8400/0xb0c3a59caa40f365 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74022 expref: 14 pid: 10094 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.088664:0:7457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:2.0:1789635405.088669:0:7457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f39d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.088678:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f39d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.088686:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f39d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.088720:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635405.088784:0:7457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543291180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+13:2397:x1876568411514368:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 266us (2383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635405.088792:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 55 00010000:00010000:0.0:1789635405.088979:0:10094:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f39d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.088986:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f39d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635405.089004:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789635405.089150:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f396 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74030 expref: 14 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.089166:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f39d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74030 expref: 13 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.089174:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:0.0:1789635405.089177:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789635405.089179:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1a400, rc 0) 00000100:00100000:0.0:1789635405.089227:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054121a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+13:11201:x1876568411514240:12345-192.168.203.20@tcp:101:dd.0 Request processed in 20298us (30992us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1789635405.089234:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:3.0:1789635405.101714:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635405.101886:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411514496 00000100:00100000:2.0:1789635405.101897:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411514496 00000100:00100000:2.0:1789635405.101949:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 61 00000100:00100000:2.0:1789635405.101958:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+13:11201:x1876568411514496:12345-192.168.203.20@tcp:101:dd.0 00010000:00010000:2.0:1789635405.101983:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635405.102000:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40f3ab lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74037 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.102032:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f3b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.102045:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f3b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.102055:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f3b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.102176:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40f3ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74037 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.102191:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f3b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74037 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.102199:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:2.0:1789635405.102203:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789635405.102205:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a3800, rc 0) 00000100:00100000:2.0:1789635405.102253:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+14:11201:x1876568411514496:12345-192.168.203.20@tcp:101:dd.0 Request processed in 296us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635405.102260:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 61 00000100:00100000:1.0:1789635405.107355:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635405.110529:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411514752 00000100:00100000:0.0:1789635405.110545:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411514752 00000100:00100000:0.0:1789635405.110640:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 62 00000100:00100000:0.0:1789635405.110651:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+14:11201:x1876568411514752:12345-192.168.203.20@tcp:36:dd.0 00010000:00010000:0.0:1789635405.112188:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f3b9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.112209:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f3b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.112221:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f3b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789635405.112265:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:0.0:1789635405.112290:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e506e56c reply state 000000002a3df675 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f3b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.112301:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f3b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.112323:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:0.0:1789635405.112325:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789635405.112329:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789635405.112437:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+17:11201:x1876568411514752:12345-192.168.203.20@tcp:36:dd.0 Request processed in 1785us (5087us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1789635405.112446:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 62 00000020:00080000:0.0:1789635405.112451:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789635405.220042:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427340672:0@lo:400:kworker.0 00000100:00100000:0.0:1789635405.220112:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635405.220157:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427341184:0@lo:400:kworker.0 00000100:00100000:0.0:1789635405.220180:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635405.220198:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427341696:0@lo:400:kworker.0 00000100:00100000:0.0:1789635405.220218:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635405.220249:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789635405.220255:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427340800:0@lo:400:kworker.0 00000100:00100000:0.0:1789635405.220274:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635405.220289:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427341312:0@lo:400:kworker.0 00000100:00100000:0.0:1789635405.220306:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635405.220320:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1876568427341824:0@lo:400:kworker.0 00000100:00100000:0.0:1789635405.220336:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635405.220360:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427341184 00000100:00100000:0.0:1789635405.220367:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427341184 00000100:00100000:0.0:1789635405.220422:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427341696 00000100:00100000:0.0:1789635405.220425:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427341696 00000100:00100000:0.0:1789635405.220444:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427340800 00000100:00100000:0.0:1789635405.220447:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427340800 00000100:00100000:0.0:1789635405.220471:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427341312 00000100:00100000:0.0:1789635405.220473:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427341312 00000100:00100000:0.0:1789635405.220484:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427341824 00000100:00100000:0.0:1789635405.220487:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427341824 00000100:00100000:0.0:1789635405.220501:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1789635405.220509:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054121aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427341184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635405.220559:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054121aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427341184:12345-0@lo:400:kworker.0 Request processed in 50us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635405.220566:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1789635405.220623:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1789635405.220630:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427341696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635405.220657:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427341696:12345-0@lo:400:kworker.0 Request processed in 28us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635405.220663:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1789635405.220677:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1789635405.220682:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054121bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427340800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635405.220707:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054121bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427340800:12345-0@lo:400:kworker.0 Request processed in 25us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635405.220713:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1789635405.220723:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1789635405.220730:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427341312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635405.220753:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427341312:12345-0@lo:400:kworker.0 Request processed in 25us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635405.220759:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1789635405.220768:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1789635405.220774:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876568427341824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635405.220805:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876568427341824:12345-0@lo:400:kworker.0 Request processed in 32us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635405.220824:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00080000:0.0:1789635405.220841:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789635405.220845:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635405.220868:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427340800:0@lo:400:kworker.0 00000100:00100000:0.0:1789635405.220877:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427341312:0@lo:400:kworker.0 00010000:00080000:0.0:1789635405.220889:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05759d1180 x1876568427341824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635405.220900:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1876568427341824:0@lo:400:kworker.0 00000100:00100000:0.0:1789635405.220908:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427341184:0@lo:400:kworker.0 00000100:00100000:0.0:1789635405.220917:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427341696:0@lo:400:kworker.0 00000100:00100000:2.0:1789635405.221794:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427341056:0@lo:400:kworker.0 00000100:00100000:2.0:1789635405.221848:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635405.221878:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427341568:0@lo:400:kworker.0 00000100:00100000:2.0:1789635405.221898:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635405.221915:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427342080:0@lo:400:kworker.0 00000100:00100000:2.0:1789635405.221932:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635405.221949:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789635405.221955:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427340928:0@lo:400:kworker.0 00000100:00100000:2.0:1789635405.221984:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635405.221998:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427341440:0@lo:400:kworker.0 00000100:00100000:2.0:1789635405.222018:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635405.222032:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427341952:0@lo:400:kworker.0 00000100:00100000:2.0:1789635405.222063:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635405.222088:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427341568 00000100:00100000:2.0:1789635405.222094:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427341568 00000100:00100000:2.0:1789635405.222130:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427342080 00000100:00100000:2.0:1789635405.222133:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427342080 00000100:00100000:2.0:1789635405.222144:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427341952 00000100:00100000:2.0:1789635405.222146:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427341952 00000100:00100000:2.0:1789635405.222160:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789635405.222166:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427341568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635405.222208:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427341568:12345-0@lo:400:kworker.0 Request processed in 42us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635405.222215:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789635405.222229:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789635405.222626:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427340672 00000100:00100000:1.0:1789635405.222631:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427340672 00000100:00100000:1.0:1789635405.222659:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1789635405.222665:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3640:x1876568427340672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635405.222700:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3640:x1876568427340672:12345-0@lo:400:kworker.0 Request processed in 36us (2589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635405.222718:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1789635405.222749:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789635405.222756:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427341952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635405.222801:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427341952:12345-0@lo:400:kworker.0 Request processed in 45us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635405.222871:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789635405.223143:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427342080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635405.223175:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427342080:12345-0@lo:400:kworker.0 Request processed in 941us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635405.223182:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:2.0:1789635405.223199:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789635405.223203:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789635405.223228:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427341952:0@lo:400:kworker.0 00000100:00100000:3.0:1789635405.223396:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427341056 00000100:00100000:3.0:1789635405.223400:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427341056 00000100:00100000:3.0:1789635405.223425:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427340928 00000100:00100000:3.0:1789635405.223427:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427340928 00000100:00100000:3.0:1789635405.223440:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789635405.223446:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427341056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635405.223481:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427341056:12345-0@lo:400:kworker.0 Request processed in 35us (1633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635405.223493:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789635405.223506:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789635405.223512:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427340928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635405.223538:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427340928:12345-0@lo:400:kworker.0 Request processed in 26us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635405.223544:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789635405.223710:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789635405.223720:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427342208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789635405.223750:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635405.223777:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427342208 00000100:00100000:3.0:1789635405.223781:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427342208 00000100:00100000:0.0:1789635405.227782:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427340672:0@lo:400:kworker.0 00000100:00100000:0.0:1789635405.228009:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427341440 00000100:00100000:0.0:1789635405.228015:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427341440 00000100:00100000:0.0:1789635405.228070:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1789635405.228079:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876568427341440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635405.228146:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876568427341440:12345-0@lo:400:kworker.0 Request processed in 68us (6127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635405.228153:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00080000:0.0:1789635405.228184:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789635405.228285:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427341056:0@lo:400:kworker.0 00000100:00100000:2.0:1789635405.228298:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427341568:0@lo:400:kworker.0 00000100:00100000:2.0:1789635405.228310:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427342080:0@lo:400:kworker.0 00000100:00100000:2.0:1789635405.228332:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427340928:0@lo:400:kworker.0 00010000:00080000:2.0:1789635405.228344:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447b5ea00 x1876568427341440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635405.228366:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427341440:0@lo:400:kworker.0 00000100:00100000:3.0:1789635405.228769:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789635405.228780:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543290380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427342208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789635405.228805:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635405.228858:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543290380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427342208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (5107us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635405.228864:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789635405.228897:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427342208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635405.231394:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789635405.231413:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427342336:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789635405.231470:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635405.231510:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427342336 00000100:00100000:1.0:1789635405.231517:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427342336 00000100:00100000:1.0:1789635405.231556:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789635405.231564:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427342336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789635405.231619:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789635405.231658:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427342336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635405.231665:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789635405.231714:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05446f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427342336:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789635405.368844:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635405.368936:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411514880 00000100:00100000:0.0:1789635405.368946:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411514880 00000100:00100000:0.0:1789635405.369008:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00100000:0.0:1789635405.369027:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+17:11215:x1876568411514880:12345-192.168.203.20@tcp:101:stat.0 00010000:00010000:0.0:1789635405.369052:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635405.369081:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1aa00/0xb0c3a59caa40f3c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7403e expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.369145:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1be00/0xb0c3a59caa40f3c7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.369159:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1be00/0xb0c3a59caa40f3c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.369172:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1be00/0xb0c3a59caa40f3c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.369186:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b800/0xb0c3a59caa40f3ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.369192:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b800/0xb0c3a59caa40f3ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.369199:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b800/0xb0c3a59caa40f3ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.369279:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f3d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.369290:0:9526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f39d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74030 expref: 18 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.369299:0:9526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f3d5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.369350:0:9526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f39d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74030 expref: 18 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.369364:0:9526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f39d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74030 expref: 18 pid: 10094 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635405.369377:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447969f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9526:1876568427342464:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789635405.369449:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05489c2900 going to sleep for 11 seconds 00000100:00100000:3.0:1789635405.378130:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635405.378285:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411515136 00000100:00100000:2.0:1789635405.378296:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411515136 00000100:00100000:2.0:1789635405.378356:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:2.0:1789635405.378367:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+19:6163:x1876568411515136:12345-192.168.203.20@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789635405.378679:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+20:6163:x1876568411515136:12345-192.168.203.20@tcp:35:ldlm_bl.0 Request processed in 314us (556us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1789635405.378688:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:0.0:1789635405.380413:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447969f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9526:1876568427342464:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789635405.380442:0:9526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f3d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635405.384826:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635405.384960:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411515264 00000100:00100000:0.0:1789635405.384969:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411515264 00010000:00010000:0.0:1789635405.385008:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f39d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74030 expref: 20 pid: 10094 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635405.385050:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 56 00000100:00100000:0.0:1789635405.385059:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05446f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+20:2396:x1876568411515264:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789635405.385073:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635405.385080:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f39d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74030 expref: 20 pid: 10094 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.385094:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f39d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74030 expref: 20 pid: 10094 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.385133:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f39d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74030 expref: 20 pid: 10094 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.385149:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:0.0:1789635405.385155:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f3d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.385164:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.385172:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f3d5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.385205:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635405.385344:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05446f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+19:2396:x1876568411515264:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 285us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635405.385353:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 56 00010000:00010000:2.0:1789635405.386077:0:9526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.386088:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635405.386137:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789635405.386142:0:9526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789635405.386182:0:9526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.386195:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.386204:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1be00/0xb0c3a59caa40f3c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.386211:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1be00/0xb0c3a59caa40f3c7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.386217:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1be00/0xb0c3a59caa40f3c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.386245:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1be00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635405.386250:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1be00/0xb0c3a59caa40f3c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.386258:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1be00/0xb0c3a59caa40f3c7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.386270:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d0558d1c900) 00010000:00010000:2.0:1789635405.386273:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635405.386277:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1be00/0xb0c3a59caa40f3c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.386284:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1be00/0xb0c3a59caa40f3c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.386297:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b800/0xb0c3a59caa40f3ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.386304:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b800/0xb0c3a59caa40f3ce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.386310:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b800/0xb0c3a59caa40f3ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.386315:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1b800 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635405.386318:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b800/0xb0c3a59caa40f3ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.386325:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b800/0xb0c3a59caa40f3ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.386341:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d0447664d00) 00010000:00010000:2.0:1789635405.386344:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635405.386347:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b800/0xb0c3a59caa40f3ce lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.386353:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b800/0xb0c3a59caa40f3ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.386390:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1aa00/0xb0c3a59caa40f3c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7403e expref: 19 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.386403:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f3d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7403e expref: 18 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.386411:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:2.0:1789635405.386414:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789635405.386417:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1b600, rc 0) 00000100:00100000:2.0:1789635405.386460:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+18:11215:x1876568411514880:12345-192.168.203.20@tcp:101:stat.0 Request processed in 17435us (17624us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635405.386468:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00100000:1.0:1789635405.565416:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635405.565519:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411515520 00000100:00100000:0.0:1789635405.565811:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411515520 00000100:00100000:1.0:1789635405.570482:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 64 00000100:00100000:1.0:1789635405.570497:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e014380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+18:11221:x1876568411515520:12345-192.168.203.20@tcp:36:truncate.0 00010000:00010000:1.0:1789635405.570559:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635405.570801:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f3d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7403e expref: 18 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635405.570822:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:1.0:1789635405.570826:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789635405.571305:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f3dc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635405.571333:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f3dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635405.571342:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f3dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789635405.571453:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:1.0:1789635405.571476:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c6586179 reply state 000000000c15fea6 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f3dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635405.571489:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f3dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635405.571495:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:1.0:1789635405.571497:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789635405.571499:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789635405.572174:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e014380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+20:11221:x1876568411515520:12345-192.168.203.20@tcp:36:truncate.0 Request processed in 1677us (7061us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1789635405.572183:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 64 00000020:00080000:1.0:1789635405.572188:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789635405.802689:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635405.802831:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411515648 00000100:00100000:2.0:1789635405.802841:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411515648 00000100:00100000:2.0:1789635405.802903:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 65 00000100:00100000:2.0:1789635405.802914:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+20:11235:x1876568411515648:12345-192.168.203.20@tcp:101:stat.0 00010000:00010000:2.0:1789635405.802938:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635405.802958:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40f3e3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74045 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.803054:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f3ea lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.803067:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f3ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.803078:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f3ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.803093:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f3f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.803100:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f3f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.803105:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f3f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.803375:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f3f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.803384:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.803391:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635405.803432:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1789635405.803436:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789635405.803453:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.803477:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.803485:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f3ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.803491:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f3ea lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.803497:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f3ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.803502:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3a00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635405.803506:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f3ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.803513:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f3ea lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.803524:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d0558d1c900) 00010000:00010000:2.0:1789635405.803527:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635405.803532:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f3ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.803538:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f3ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.803550:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f3f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.803556:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f3f1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.803567:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f3f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.803572:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a2600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635405.803585:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f3f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.803592:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f3f1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.803674:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d0544e2e300) 00010000:00010000:2.0:1789635405.803676:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635405.803680:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f3f1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.803685:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f3f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.803716:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40f3e3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74045 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.803730:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f3f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74045 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.803737:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:2.0:1789635405.803739:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789635405.803741:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a3000, rc 0) 00000100:00100000:2.0:1789635405.803903:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+21:11235:x1876568411515648:12345-192.168.203.20@tcp:101:stat.0 Request processed in 990us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635405.803919:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 65 00000100:00100000:3.0:1789635405.913530:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635405.914811:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411515904 00000100:00100000:2.0:1789635405.914825:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411515904 00000100:00100000:2.0:1789635405.914899:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 66 00000100:00100000:2.0:1789635405.914909:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+21:11245:x1876568411515904:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1789635405.914931:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635405.914961:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40f3ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7404c expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635405.915080:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789635405.915174:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40f3ff lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7404c expref: 23 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.915188:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d044766dc00) 00010000:00010000:2.0:1789635405.915191:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789635405.915195:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40f3ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7404c expref: 23 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.915210:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a3400, rc 0) 00000100:00100000:2.0:1789635405.917870:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+22:11245:x1876568411515904:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 2951us (4338us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1789635405.917882:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 66 00000100:00100000:1.0:1789635405.933412:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635405.933554:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411516160 00000100:00100000:2.0:1789635405.933562:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411516160 00000100:00100000:2.0:1789635405.933677:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00100000:2.0:1789635405.933687:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+22:11245:x1876568411516160:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:2.0:1789635405.933911:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+23:11245:x1876568411516160:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 226us (508us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1789635405.933919:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 14 00010000:00010000:2.0:1789635405.987837:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635406.018337:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635406.018426:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411516416 00000100:00100000:1.0:1789635406.018437:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411516416 00000100:00100000:1.0:1789635406.018498:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 67 00000100:00100000:1.0:1789635406.018507:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+23:11251:x1876568411516416:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:1.0:1789635406.018531:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635406.018560:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40f40d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74053 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635406.018734:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f414 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635406.018752:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f3f8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74045 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635406.018762:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f414 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635406.018795:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f3f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74045 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635406.018807:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f3f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74045 expref: 24 pid: 6514 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635406.018820:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6516:1876568427342592:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789635406.019067:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b5eb600 going to sleep for 11 seconds 00000100:00100000:0.0:1789635406.035129:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6516:1876568427342592:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789635406.035158:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f414 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635406.036361:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635406.036919:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411516544 00000100:00100000:1.0:1789635406.036929:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411516544 00010000:00010000:1.0:1789635406.036973:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f3f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74045 expref: 25 pid: 6514 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635406.037024:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 57 00000100:00100000:1.0:1789635406.037033:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b406c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+25:2397:x1876568411516544:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635406.037057:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635406.037069:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f3f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74045 expref: 25 pid: 6514 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635406.037100:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f3f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74045 expref: 25 pid: 6514 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635406.037122:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f3f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74045 expref: 25 pid: 6514 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635406.037134:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:1.0:1789635406.037138:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f414 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635406.037145:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f414 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635406.037150:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f414 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635406.037173:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635406.037222:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b406c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+24:2397:x1876568411516544:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 191us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635406.037228:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 57 00010000:00010000:0.0:1789635406.037534:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f414 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635406.039217:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f414 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635406.039239:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1789635406.039393:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40f40d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74053 expref: 25 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635406.039413:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f414 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74053 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635406.039422:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:0.0:1789635406.039425:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789635406.039429:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e153000, rc 0) 00000100:00100000:0.0:1789635406.039494:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+24:11251:x1876568411516416:12345-192.168.203.20@tcp:101:bash.0 Request processed in 20988us (21167us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1789635406.039502:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 67 00000100:00100000:0.0:1789635406.042710:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635406.042925:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411516800 00000100:00100000:2.0:1789635406.042935:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411516800 00000100:00100000:2.0:1789635406.043028:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 68 00000100:00100000:2.0:1789635406.043040:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+24:11251:x1876568411516800:12345-192.168.203.20@tcp:36:bash.0 00010000:00010000:2.0:1789635406.043279:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f422 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.043296:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f422 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.043308:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f422 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789635406.043352:0:10094:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1789635406.043373:0:10094:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000544c46bb reply state 0000000081bbb26a transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f422 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.043385:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f422 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.043393:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:2.0:1789635406.043396:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789635406.043400:0:10094:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789635406.043510:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+27:11251:x1876568411516800:12345-192.168.203.20@tcp:36:bash.0 Request processed in 471us (808us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1789635406.043517:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 68 00000020:00080000:2.0:1789635406.043535:0:10094:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789635406.049869:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635406.050311:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411516928 00000100:00100000:2.0:1789635406.050321:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411516928 00000100:00100000:2.0:1789635406.050384:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 69 00000100:00100000:2.0:1789635406.050394:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+27:11251:x1876568411516928:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1789635406.050418:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635406.050440:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f429 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7405a expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.050532:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40f430 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.050547:0:9526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f414 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74053 expref: 28 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.050555:0:9526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40f430 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.050648:0:9526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f414 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74053 expref: 28 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.050865:0:9526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f414 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74053 expref: 28 pid: 6516 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635406.050880:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9526:1876568427342720:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789635406.050966:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05513ae180 going to sleep for 11 seconds 00000100:00100000:3.0:1789635406.055058:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635406.055205:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411517056 00000100:00100000:1.0:1789635406.055214:0:7457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411517056 00010000:00010000:1.0:1789635406.055252:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f414 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74053 expref: 29 pid: 6516 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635406.055288:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 58 00000100:00100000:1.0:1789635406.055297:0:7457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543291180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+29:2397:x1876568411517056:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635406.055326:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635406.055333:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f414 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74053 expref: 29 pid: 6516 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635406.055346:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f414 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74053 expref: 29 pid: 6516 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635406.055368:0:7457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:1.0:1789635406.055373:0:7457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40f430 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635406.055383:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40f430 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635406.055391:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40f430 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635406.055409:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635406.055464:0:7457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543291180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+29:2397:x1876568411517056:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 168us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635406.055472:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 58 00010000:00010000:2.0:1789635406.055570:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f414 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74053 expref: 28 pid: 6516 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635406.055633:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9526:1876568427342720:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789635406.055673:0:9526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40f430 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.055682:0:9526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40f430 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.055687:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40f430 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635406.055740:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789635406.055744:0:9526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789635406.055770:0:9526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40f430 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.055799:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f429 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7405a expref: 28 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.055812:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40f430 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7405a expref: 27 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.055819:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:2.0:1789635406.055821:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789635406.055824:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a3e00, rc 0) 00000100:00100000:2.0:1789635406.055850:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+27:11251:x1876568411516928:12345-192.168.203.20@tcp:101:bash.0 Request processed in 5458us (5991us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635406.055856:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 69 00000100:00100000:0.0:1789635406.064277:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635406.064376:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411517312 00000100:00100000:2.0:1789635406.064387:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411517312 00000100:00100000:2.0:1789635406.064447:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00100000:2.0:1789635406.064457:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b745850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+27:11251:x1876568411517312:12345-192.168.203.20@tcp:35:bash.0 00000100:00100000:2.0:1789635406.065001:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b745850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+28:11251:x1876568411517312:12345-192.168.203.20@tcp:35:bash.0 Request processed in 544us (732us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1789635406.065010:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00100000:3.0:1789635406.162815:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635406.163744:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411517568 00000100:00100000:0.0:1789635406.163756:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411517568 00000100:00100000:0.0:1789635406.163835:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 70 00000100:00100000:0.0:1789635406.163847:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+28:11261:x1876568411517568:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1789635406.163869:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635406.163889:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f437 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74061 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635406.163984:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789635406.164101:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f437 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74061 expref: 30 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635406.164116:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d044766dc00) 00010000:00010000:0.0:1789635406.164119:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789635406.164124:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f437 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74061 expref: 30 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635406.164138:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1a400, rc 0) 00000100:00100000:0.0:1789635406.164202:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+29:11261:x1876568411517568:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 358us (1409us total) trans 4294967347 rc 301/301 00000100:00100000:0.0:1789635406.164209:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 70 00000100:00100000:3.0:1789635406.168470:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635406.168893:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411517696 00000100:00100000:2.0:1789635406.168904:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411517696 00000100:00100000:2.0:1789635406.168958:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 71 00000100:00100000:2.0:1789635406.168968:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+29:11261:x1876568411517696:12345-192.168.203.20@tcp:34:lfs.0 00010000:00010000:2.0:1789635406.169041:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f445 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.169057:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f445 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.169069:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f445 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.169084:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f44c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.169092:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f44c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.169099:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f44c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.169177:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f453 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.169203:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f453 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.169211:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f453 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789635406.169257:0:10094:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f453 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.169270:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f445 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.169278:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f445 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.169285:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f445 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.169291:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3a00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635406.169295:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f445 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.169301:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f445 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.169313:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d0558d1c900) 00010000:00010000:2.0:1789635406.169317:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635406.169321:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f445 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.169327:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f445 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.169347:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f44c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.169352:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f44c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.169358:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f44c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.169363:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a2e00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635406.169365:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f44c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.169372:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f44c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.169380:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d0544e2e300) 00010000:00010000:2.0:1789635406.169382:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635406.169385:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f44c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.169391:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f44c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.169405:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f453 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.169411:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f453 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.169417:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f453 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.169428:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3000 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635406.169431:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f453 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.169437:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f453 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.169446:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:2.0:1789635406.169448:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635406.169451:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f453 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.169457:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f453 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635406.169978:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+29:11261:x1876568411517696:12345-192.168.203.20@tcp:34:lfs.0 Request processed in 1008us (1512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635406.169989:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 71 00000100:00100000:1.0:1789635406.179247:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635406.179369:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411517952 00000100:00100000:3.0:1789635406.179379:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411517952 00000100:00100000:3.0:1789635406.179463:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:3.0:1789635406.179490:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+29:11261:x1876568411517952:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:3.0:1789635406.179755:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+30:11261:x1876568411517952:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 267us (516us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1789635406.179771:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:2.0:1789635406.243913:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789635406.243937:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427342848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789635406.244003:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635406.244057:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427342848 00000100:00100000:0.0:1789635406.244065:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427342848 00000100:00100000:0.0:1789635406.244133:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789635406.244157:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1876568427342848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789635406.244195:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789635406.244337:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789635406.249005:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1876568427342848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4843us (4990us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635406.249024:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427342848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635406.249028:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789635406.264499:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635406.264945:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411518208 00000100:00100000:2.0:1789635406.264956:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411518208 00000100:00100000:2.0:1789635406.265070:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 72 00000100:00100000:2.0:1789635406.265081:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+30:11264:x1876568411518208:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1789635406.265105:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635406.265148:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f45a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74068 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.265223:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f461 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.265237:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f461 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.265248:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f461 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.265262:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f468 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.265269:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f468 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.265275:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f468 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.265374:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40f46f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.265384:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40f46f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.265392:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40f46f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635406.265401:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789635406.265469:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f461 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.265488:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f461 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.265494:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f461 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.265500:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a2e00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635406.265504:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f461 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.265511:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f461 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.265523:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d0558d1c900) 00010000:00010000:2.0:1789635406.265526:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635406.265530:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f461 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.266213:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40f461 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.266229:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f468 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.266235:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f468 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.266241:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f468 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.266247:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3a00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635406.266256:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f468 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.266263:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f468 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.266272:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d0544e2e300) 00010000:00010000:2.0:1789635406.266275:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635406.266278:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f468 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.266284:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40f468 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.266330:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f45a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74068 expref: 33 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.266344:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40f46f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74068 expref: 32 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.266351:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:2.0:1789635406.266353:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789635406.266356:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a3400, rc 0) 00000100:00100000:2.0:1789635406.266412:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+32:11264:x1876568411518208:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 1333us (1922us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1789635406.266420:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 72 00000100:00100000:0.0:1789635406.274184:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635406.274227:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635406.274357:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411518464 00000100:00100000:2.0:1789635406.274367:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411518464 00000100:00100000:1.0:1789635406.274404:0:13189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411518336 00000100:00100000:1.0:1789635406.274409:0:13189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411518336 00000100:00100000:2.0:1789635406.274435:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 73 00000100:00100000:2.0:1789635406.274446:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+33:11264:x1876568411518464:12345-192.168.203.20@tcp:54:lfs.0 00000100:00100000:1.0:1789635406.274451:0:13189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:1.0:1789635406.274460:0:13189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+33:2397:x1876568411518336:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635406.274476:0:13189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635406.274497:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40f46f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74068 expref: 33 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635406.274523:0:13189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:2.0:1789635406.274526:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f47d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635406.274529:0:13189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635406.274591:0:13189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+32:2397:x1876568411518336:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 132us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635406.274612:0:13189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 5 00010000:00010000:2.0:1789635406.274975:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f47d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.274987:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f47d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635406.275081:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f47d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635406.275090:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f47d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635406.275097:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f47d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635406.275104:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540030c00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635406.275108:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f47d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635406.275176:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f47d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635406.275188:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:3.0:1789635406.275192:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789635406.275196:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f47d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635406.275203:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f47d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635406.275257:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+31:11264:x1876568411518464:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 812us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635406.275271:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 73 00000100:00100000:0.0:1789635406.285205:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635406.285411:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411518720 00000100:00100000:2.0:1789635406.285421:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411518720 00000100:00100000:2.0:1789635406.285472:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:2.0:1789635406.285480:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+31:11264:x1876568411518720:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:2.0:1789635406.285719:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+32:11264:x1876568411518720:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 238us (521us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1789635406.285726:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:1.0:1789635406.602861:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635406.603785:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411518976 00000100:00100000:2.0:1789635406.603796:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411518976 00000100:00100000:2.0:1789635406.604033:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 74 00000100:00100000:2.0:1789635406.604043:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+32:11282:x1876568411518976:12345-192.168.203.20@tcp:101:cat.0 00010000:00010000:2.0:1789635406.604066:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635406.604085:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f484 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7406f expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.604211:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f48b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.604226:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f48b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.604256:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f48b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635406.604268:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789635406.604388:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f484 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7406f expref: 35 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.604407:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f48b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7406f expref: 34 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.604421:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:2.0:1789635406.604424:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789635406.604427:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0540031800, rc 0) 00000100:00100000:2.0:1789635406.604490:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+34:11282:x1876568411518976:12345-192.168.203.20@tcp:101:cat.0 Request processed in 449us (1640us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1789635406.604498:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 74 00000100:00100000:1.0:1789635406.677793:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635406.678121:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411519104 00000100:00100000:2.0:1789635406.678132:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411519104 00000100:00100000:2.0:1789635406.678242:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 75 00000100:00100000:2.0:1789635406.678254:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+34:11283:x1876568411519104:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1789635406.678279:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635406.678302:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f499 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74076 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.678391:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f4a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.678416:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f4a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.678429:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f4a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635406.678480:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789635406.678483:0:9526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789635406.678502:0:9526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f4a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.678528:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f499 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74076 expref: 36 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.678547:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f4a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74076 expref: 35 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.678556:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d0558d1c900) 00010000:00010000:2.0:1789635406.678559:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789635406.678563:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0540030200, rc 0) 00000100:00100000:2.0:1789635406.678700:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+35:11283:x1876568411519104:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 449us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635406.678707:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 75 00000100:00100000:0.0:1789635406.691097:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635406.694188:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411519488 00000100:00100000:1.0:1789635406.694204:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411519488 00000100:00100000:1.0:1789635406.694286:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:1.0:1789635406.694310:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+35:11283:x1876568411519488:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:1.0:1789635406.694896:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+36:11283:x1876568411519488:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 598us (3806us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1789635406.694905:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:1.0:1789635406.705496:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635406.705592:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411519616 00000100:00100000:3.0:1789635406.705637:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411519616 00000100:00100000:3.0:1789635406.705749:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:3.0:1789635406.705760:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+36:11283:x1876568411519616:12345-192.168.203.20@tcp:103:lfs.0 00010000:00010000:3.0:1789635406.705777:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789635406.705801:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40f430 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7405a expref: 36 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635406.705825:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f48b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7406f expref: 35 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635406.705840:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153e00/0xb0c3a59caa40f326 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74014 expref: 34 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635406.705850:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:3.0:1789635406.705855:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635406.705914:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+33:11283:x1876568411519616:12345-192.168.203.20@tcp:103:lfs.0 Request processed in 155us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635406.705922:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:2.0:1789635406.708897:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635406.709209:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411519744 00000100:00100000:3.0:1789635406.709220:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411519744 00000100:00100000:3.0:1789635406.709283:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 76 00000100:00100000:3.0:1789635406.709293:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+33:11283:x1876568411519744:12345-192.168.203.20@tcp:58:lfs.0 00010000:00010000:3.0:1789635406.709419:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f4a7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635406.709449:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f4a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635406.709460:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f4a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789635406.710155:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789635406.710291:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1789635406.710388:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1789635406.710529:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+33:11283:x1876568411519744:12345-192.168.203.20@tcp:58:lfs.0 Request processed in 1233us (1638us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635406.710538:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 76 00000100:00100000:0.0:1789635406.755042:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635406.755198:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411519872 00000100:00100000:2.0:1789635406.755208:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411519872 00000100:00100000:2.0:1789635406.755267:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 77 00000100:00100000:2.0:1789635406.755277:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+33:11285:x1876568411519872:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1789635406.755311:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635406.755399:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f4ae lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7407d expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.755466:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f4b5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.755481:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f4b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.755492:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f4b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.755507:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f4bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.755514:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f4bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.755521:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f4bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.755789:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f4c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635406.755813:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427342976:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789635406.755819:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f4c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.755825:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f4c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635406.755865:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000100:00100000:0.0:1789635406.755865:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00200000:2.0:1789635406.755874:0:10094:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789635406.755892:0:10094:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f4c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.755972:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f4c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.755981:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f4b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.755988:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f4b5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.755994:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f4b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.756000:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540030a00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635406.756005:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f4b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.756012:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f4b5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.756024:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d0558d1c900) 00010000:00010000:2.0:1789635406.756027:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635406.756030:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f4b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.756036:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f4b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.756048:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f4bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.756065:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f4bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.756072:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f4bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.756077:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540031800 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635406.756081:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f4bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.756087:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f4bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.756095:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d0544e2e300) 00010000:00010000:2.0:1789635406.756097:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635406.756099:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f4bc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.756105:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f4bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.756137:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f4ae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7407d expref: 35 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.756150:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f4c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7407d expref: 34 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635406.756157:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:2.0:1789635406.756160:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789635406.756169:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0540031400, rc 0) 00000100:00100000:2.0:1789635406.756277:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+34:11285:x1876568411519872:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 1001us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635406.756284:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 77 00000100:00100000:3.0:1789635406.757504:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427342976 00000100:00100000:3.0:1789635406.757514:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427342976 00000100:00100000:3.0:1789635406.757865:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789635406.757877:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427342976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789635406.757914:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635406.757986:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427342976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (2120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635406.757993:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789635406.758071:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427342976:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789635407.018447:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789635407.077022:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789635407.077033:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789635407.077082:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789635407.077090:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789635407.077364:0:13797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1876568427343104:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789635407.077450:0:13797:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0558be5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789635407.080011:0:13797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1876568427343104:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789635407.085441:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635407.085649:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411520000 00000100:00100000:2.0:1789635407.085661:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411520000 00000100:00100000:2.0:1789635407.085725:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 78 00000100:00100000:2.0:1789635407.085735:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+34:11296:x1876568411520000:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789635407.085775:0:9526:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789635407.085907:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+34:11296:x1876568411520000:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 163us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635407.085915:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 78 00000100:00080000:3.0:1789635407.086580:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635407.089983:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635407.090075:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411520128 00000100:00100000:0.0:1789635407.090086:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411520128 00000100:00100000:0.0:1789635407.090141:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 79 00000100:00100000:0.0:1789635407.090150:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+34:11296:x1876568411520128:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789635407.090228:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f4ca lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.090245:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f4ca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.090258:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f4ca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.090309:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f4d1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.090317:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f4d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.090342:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f4d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.090367:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ae00/0xb0c3a59caa40f4d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.090376:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ae00/0xb0c3a59caa40f4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.090382:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ae00/0xb0c3a59caa40f4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635407.090427:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789635407.090431:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789635407.090444:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ae00/0xb0c3a59caa40f4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.090454:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f4ca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.090460:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f4ca lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.090466:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f4ca lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.090472:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1b400 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635407.090476:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f4ca lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.090483:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f4ca lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.090500:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d044766d300) 00010000:00010000:0.0:1789635407.090503:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635407.090508:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f4ca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.090515:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f4ca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.090529:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f4d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.090535:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f4d1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.090541:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f4d1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.090546:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1bc00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635407.090548:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f4d1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.090554:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f4d1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.090560:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff8d0447664e00) 00010000:00010000:0.0:1789635407.090579:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635407.090583:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f4d1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.090589:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f4d1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.090924:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ae00/0xb0c3a59caa40f4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.090931:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ae00/0xb0c3a59caa40f4d8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.090937:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ae00/0xb0c3a59caa40f4d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.090942:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1ae00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635407.090945:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ae00/0xb0c3a59caa40f4d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.090951:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ae00/0xb0c3a59caa40f4d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.090959:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:0.0:1789635407.090961:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635407.090964:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ae00/0xb0c3a59caa40f4d8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.090970:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ae00/0xb0c3a59caa40f4d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635407.091923:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+34:11296:x1876568411520128:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 Request processed in 1768us (1943us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635407.091933:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 79 00000100:00100000:1.0:1789635407.095239:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635407.095336:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411520384 00000100:00100000:2.0:1789635407.095347:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411520384 00000100:00100000:2.0:1789635407.095405:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 80 00000100:00100000:2.0:1789635407.095415:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+34:11296:x1876568411520384:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789635407.095437:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635407.095458:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f4df lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74084 expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.095559:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f4e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.095586:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f4e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.095630:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f4e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635407.095642:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789635407.096105:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f4e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.096114:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f4e6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.096121:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f4e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.096128:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540031800 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635407.096132:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f4e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.096139:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f4e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.096150:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:2.0:1789635407.096153:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789635407.096157:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f4e6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.096230:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f4e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.096272:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f4df lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74084 expref: 36 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.096299:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d044766d300) 00010000:00010000:2.0:1789635407.096301:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789635407.096306:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f4df lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74084 expref: 36 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.096316:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0540031c00, rc 0) 00000100:00100000:2.0:1789635407.096429:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+35:11296:x1876568411520384:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 1014us (1267us total) trans 4294967353 rc 301/301 00000100:00100000:2.0:1789635407.096437:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 80 00000100:00100000:1.0:1789635407.104425:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635407.104479:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411520512 00000100:00100000:0.0:1789635407.104489:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411520512 00000100:00100000:0.0:1789635407.104542:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 81 00000100:00100000:0.0:1789635407.104551:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0558969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+35:11296:x1876568411520512:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789635407.104615:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789635407.104719:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0558969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+35:11296:x1876568411520512:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 169us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635407.104739:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 81 00000100:00100000:3.0:1789635407.110311:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635407.113115:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411520768 00000100:00100000:2.0:1789635407.113130:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411520768 00000100:00100000:2.0:1789635407.113213:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 82 00000100:00100000:2.0:1789635407.113304:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+35:11296:x1876568411520768:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789635407.113327:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635407.113330:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789635407.113355:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f4a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74076 expref: 35 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.113376:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d0558d1c900) 00010000:00010000:2.0:1789635407.113381:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789635407.113394:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f4f4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7408b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789635407.113858:0:6515:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:2.0:1789635407.113998:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f4fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.114025:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f4fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.114036:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f4fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.114087:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f4f4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7408b expref: 37 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.114103:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f4fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7408b expref: 36 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.114110:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d0544e2e300) 00010000:00010000:2.0:1789635407.114113:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789635407.114116:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0540031800, rc 0) 00000100:00100000:2.0:1789635407.114184:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+36:11296:x1876568411520768:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 885us (3882us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1789635407.118492:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 82 00000100:00100000:1.0:1789635407.119882:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635407.119998:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411521024 00000100:00100000:2.0:1789635407.120008:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411521024 00000100:00100000:2.0:1789635407.120071:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 83 00000100:00100000:2.0:1789635407.120083:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05446f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+36:11296:x1876568411521024:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789635407.120140:0:10094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635407.120165:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f4fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7408b expref: 36 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.120183:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d0544e2e300) 00010000:00010000:2.0:1789635407.120206:0:10094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789635407.120347:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f509 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.120362:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f509 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.120371:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f509 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.120430:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f510 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x29867ae2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.120439:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f510 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x29867ae2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.120445:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f510 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x29867ae2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.120489:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f509 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.120496:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f509 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.120503:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f509 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.120509:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540030a00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635407.120512:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f509 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.120519:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f509 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.120535:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d0558d1c900) 00010000:00010000:2.0:1789635407.120537:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635407.120541:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f509 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.120546:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f509 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.120556:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f510 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x29867ae2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.120561:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f510 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x29867ae2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.120577:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f510 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x29867ae2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.120582:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540030c00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635407.120584:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f510 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x29867ae2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.120590:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f510 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x29867ae2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.120672:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x29867ae2 (ffff8d0544e2e200) 00010000:00010000:2.0:1789635407.120676:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635407.120678:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f510 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x29867ae2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.120683:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f510 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x29867ae2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635407.121009:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05446f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+35:11296:x1876568411521024:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 927us (1128us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789635407.121018:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 83 00000100:00100000:1.0:1789635407.124508:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635407.129249:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411521152 00000100:00100000:0.0:1789635407.129265:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411521152 00000100:00100000:0.0:1789635407.129351:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 84 00000100:00100000:0.0:1789635407.129361:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+35:11296:x1876568411521152:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789635407.129381:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635407.129404:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ae00/0xb0c3a59caa40f517 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74092 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.129437:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f51e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.129450:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f51e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.129461:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f51e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.129581:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ae00/0xb0c3a59caa40f517 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74092 expref: 37 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.129620:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f51e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74092 expref: 36 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.129629:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d0447664e00) 00010000:00010000:0.0:1789635407.129632:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789635407.129635:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1bc00, rc 0) 00000100:00100000:0.0:1789635407.129693:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+36:11296:x1876568411521152:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 334us (5196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635407.129707:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 84 00000100:00100000:3.0:1789635407.135914:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635407.136064:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411521408 00000100:00100000:1.0:1789635407.136074:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411521408 00000100:00100000:1.0:1789635407.136130:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 85 00000100:00100000:1.0:1789635407.136141:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+36:11296:x1876568411521408:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789635407.136223:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40f525 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635407.136248:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40f525 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635407.136261:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40f525 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789635407.136439:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1789635407.136449:0:9526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 425819852579ns, next at 426819850181ns, rc = 0 00000004:00010000:1.0:1789635407.136502:0:9526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009fff17cc reply state 000000008140d3e2 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40f525 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635407.136516:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40f525 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635407.136524:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d0447664e00) 00010000:00010000:1.0:1789635407.136526:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789635407.136530:0:9526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789635407.136674:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+38:11296:x1876568411521408:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 534us (770us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1789635407.136682:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 85 00000100:00100000:1.0:1789635407.151309:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635407.151413:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411521536 00000100:00100000:0.0:1789635407.151422:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411521536 00000100:00100000:0.0:1789635407.151485:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 86 00000100:00100000:0.0:1789635407.151497:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447af0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+38:11296:x1876568411521536:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789635407.151522:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635407.151543:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f52c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74099 expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.151656:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f52c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74099 expref: 39 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.151671:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f52c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74099 expref: 39 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.151689:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d0447664e00) 00010000:00010000:0.0:1789635407.151693:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789635407.151696:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1b400, rc 0) 00000100:00100000:0.0:1789635407.151743:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447af0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+39:11296:x1876568411521536:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 248us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635407.151749:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 86 00000100:00100000:0.0:1789635407.156068:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635407.156201:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411521664 00000100:00100000:1.0:1789635407.156211:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411521664 00000100:00100000:1.0:1789635407.156263:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:1.0:1789635407.156272:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2395:x1876568411521664:12345-192.168.203.20@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1789635407.156318:0:8431:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 6e1c17f2-a595-4ed0-97c8-b9260d0850ab@192.168.203.20@tcp t0 exp 0000000000000000 cur 425 last 0 00000020:00000080:1.0:1789635407.156350:0:8431:0:(genops.c:1384:class_connect()) connect: client 6e1c17f2-a595-4ed0-97c8-b9260d0850ab, cookie 0xb0c3a59caa40f533 00002000:00100000:1.0:1789635407.156363:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6e1c17f2-a595-4ed0-97c8-b9260d0850ab/ffff8d0447982000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789635407.156387:0:8431:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789635407.156455:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789635407.156485:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8d0447983800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789635407.156557:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2395:x1876568411521664:12345-192.168.203.20@tcp:8:lhsmtool_posix.0 Request processed in 283us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635407.156574:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:3.0:1789635407.160967:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635407.161181:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411521792 00000100:00100000:0.0:1789635407.161190:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411521792 00000100:00080000:3.0:1789635407.161244:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789635407.161268:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 34 00000100:00100000:0.0:1789635407.161281:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543297480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:0:x1876568411521792:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00000001:00080000:3.0:1789635407.163442:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:3.0:1789635407.163454:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e1c17f2-a595-4ed0-97c8-b9260d0850ab 00000100:00100000:0.0:1789635407.163885:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543297480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:0:x1876568411521792:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 2603us (2922us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789635407.163960:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 34 00000100:00100000:3.0:1789635407.171238:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635407.171318:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411522048 00000100:00100000:1.0:1789635407.171328:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411522048 00000100:00100000:1.0:1789635407.171380:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:1.0:1789635407.171390:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+39:11296:x1876568411522048:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789635407.171629:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+40:11296:x1876568411522048:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 240us (403us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1789635407.171637:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:0.0:1789635407.187502:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635407.187572:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411522304 00000100:00100000:2.0:1789635407.187581:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411522304 00000100:00100000:2.0:1789635407.187661:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 87 00000100:00100000:2.0:1789635407.187672:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+40:11296:x1876568411522304:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789635407.187778:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+40:11296:x1876568411522304:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 108us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635407.187786:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 87 00000100:00100000:2.0:1789635407.198374:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635407.198969:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411522432 00000100:00100000:0.0:1789635407.198981:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411522432 00000100:00100000:0.0:1789635407.199275:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 88 00000100:00100000:0.0:1789635407.199288:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+40:11296:x1876568411522432:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789635407.199308:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635407.199333:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a000/0xb0c3a59caa40f53a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab740a0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.199421:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40f541 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.199434:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40f541 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.199446:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40f541 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635407.199485:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789635407.199500:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40f541 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.199519:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a000/0xb0c3a59caa40f53a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740a0 expref: 42 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.199531:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40f541 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740a0 expref: 41 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.199544:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d0447664e00) 00010000:00010000:0.0:1789635407.199546:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789635407.199548:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1a800, rc 0) 00000100:00100000:0.0:1789635407.199641:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+41:11296:x1876568411522432:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 355us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635407.199659:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 88 00000100:00100000:0.0:1789635407.213870:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635407.213964:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411522560 00000100:00100000:1.0:1789635407.213974:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411522560 00000100:00100000:1.0:1789635407.214028:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 35 00000100:00100000:1.0:1789635407.214037:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2397:x1876568411522560:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789635407.214055:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635407.214075:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f59f798e/0xb0c3a59caa40f548 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab740a7 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789635407.214098:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aabab4f, blocks: 0x0 00010000:00010000:1.0:1789635407.214121:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=425s v=(0 0) 00010000:00010000:1.0:1789635407.214126:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635407.214134:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f59f798e/0xb0c3a59caa40f548 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740a7 expref: 6 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635407.214167:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f59f798e/0xb0c3a59caa40f548 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740a7 expref: 6 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635407.214182:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e153600, rc 0) 00000100:00100000:1.0:1789635407.214239:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2397:x1876568411522560:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 203us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635407.214247:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 35 00000100:00100000:1.0:1789635407.220425:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635407.220633:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411522816 00000100:00100000:2.0:1789635407.220655:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411522816 00000100:00100000:2.0:1789635407.220715:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 89 00000100:00100000:2.0:1789635407.220725:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+41:11296:x1876568411522816:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789635407.220834:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+41:11296:x1876568411522816:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 111us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635407.220843:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 89 00000100:00100000:2.0:1789635407.232670:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635407.232991:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411522944 00000100:00100000:3.0:1789635407.233000:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411522944 00000100:00100000:3.0:1789635407.233066:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 36 00000100:00100000:3.0:1789635407.233076:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:11296:x1876568411522944:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789635407.233093:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635407.233113:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c971bec1/0xb0c3a59caa40f54f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab740ae expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.233141:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f59f798e/0xb0c3a59caa40f548 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740a7 expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.233151:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635407.233155:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635407.233160:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c971bec1/0xb0c3a59caa40f54f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740ae expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.233202:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f59f798e/0xb0c3a59caa40f548 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740a7 expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.233216:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f59f798e/0xb0c3a59caa40f548 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740a7 expref: 7 pid: 8431 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635407.233229:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543296300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8432:1876568427343232:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789635407.233312:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0548894480 going to sleep for 11 seconds 00000100:00100000:3.0:1789635407.236044:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543296300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8432:1876568427343232:192.168.203.20@tcp:104: 00010000:00010000:3.0:1789635407.236087:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c971bec1/0xb0c3a59caa40f54f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740ae expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.236107:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056f6e8400, rc 0) 00000100:00100000:3.0:1789635407.236231:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:11296:x1876568411522944:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 3155us (3567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635407.236240:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 36 00000100:00100000:1.0:1789635407.236365:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635407.236931:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411523072 00000100:00100000:3.0:1789635407.236939:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411523072 00010000:00010000:3.0:1789635407.236969:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f59f798e/0xb0c3a59caa40f548 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740a7 expref: 7 pid: 8431 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635407.237020:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00100000:3.0:1789635407.237030:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:2397:x1876568411523072:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635407.237043:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635407.237062:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f59f798e/0xb0c3a59caa40f548 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740a7 expref: 7 pid: 8431 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.237076:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f59f798e/0xb0c3a59caa40f548 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740a7 expref: 7 pid: 8431 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.237100:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f59f798e/0xb0c3a59caa40f548 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740a7 expref: 7 pid: 8431 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.237112:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635407.237122:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635407.237130:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c971bec1/0xb0c3a59caa40f54f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740ae expref: 6 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.237141:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c971bec1/0xb0c3a59caa40f54f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740ae expref: 6 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.237173:0:6499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c971bec1/0xb0c3a59caa40f54f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740ae expref: 6 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635407.237188:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543296300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6499:1876568427343360:192.168.203.20@tcp:105: 00000100:00100000:3.0:1789635407.237244:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0548894480 going to sleep for 11 seconds 00000100:00100000:3.0:1789635407.243173:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543296300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6499:1876568427343360:192.168.203.20@tcp:105: 00010000:00010000:3.0:1789635407.243200:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635407.243255:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2397:x1876568411523072:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 6225us (6889us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635407.243266:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00100000:1.0:1789635407.250875:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635407.250973:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411523200 00000100:00100000:3.0:1789635407.250984:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411523200 00002000:00100000:3.0:1789635407.251094:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8d04467bad80 x1876568411523200/t0(0) o4->6e1c17f2-a595-4ed0-97c8-b9260d0850ab@192.168.203.20@tcp:28/0 lens 504/0 e 0 to 0 dl 1789635418 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789635407.251108:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d04467bad80 with x1876568411523200 ext(0->8) 00002000:00010000:3.0:1789635407.251114:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d04467bad80 00000100:00100000:3.0:1789635407.251188:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:3.0:1789635407.251199:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2397:x1876568411523200:12345-192.168.203.20@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789635407.252014:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:2397:x1876568411523200:12345-192.168.203.20@tcp:4:lhsmtool_posix.0 Request processed in 812us (1143us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789635407.252024:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 0 00002000:00100000:3.0:1789635407.252033:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8d04467bad80 x1876568411523200/t4294967303(0) o4->6e1c17f2-a595-4ed0-97c8-b9260d0850ab@192.168.203.20@tcp:28/0 lens 504/448 e 0 to 0 dl 1789635418 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789635407.252044:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d04467bad80 with x1876568411523200 ext(0->8) 00002000:00010000:3.0:1789635407.252048:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d04467bad80 00000100:00100000:2.0:1789635407.261221:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635407.261586:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411523328 00000100:00100000:0.0:1789635407.261618:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411523328 00000100:00100000:0.0:1789635407.262078:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 90 00000100:00100000:0.0:1789635407.262089:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+41:11296:x1876568411523328:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789635407.265108:0:6493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:3.0:1789635407.265125:0:6493:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00010000:00010000:2.0:1789635407.265142:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f3b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.265156:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f3b9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.265178:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f3b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.265186:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1a200 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635407.265203:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f3b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.265213:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f3b9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.265231:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:2.0:1789635407.265235:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635407.265240:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f3b9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.265248:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f3b9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.265272:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f3dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.265278:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f3dc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.265296:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f3dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.265302:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152e00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635407.265306:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f3dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.265324:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f3dc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.265333:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:2.0:1789635407.265336:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635407.265339:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f3dc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.265344:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f3dc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.265357:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f422 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.265362:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f422 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.265368:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f422 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.265374:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a2600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635407.265377:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f422 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.265384:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f422 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.265394:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:2.0:1789635407.265397:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635407.265400:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f422 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.265415:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40f422 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.265427:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40f525 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.265433:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40f525 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.265439:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40f525 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.265444:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152400 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635407.265447:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40f525 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.265453:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40f525 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.265462:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d0447664e00) 00010000:00010000:2.0:1789635407.265464:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789635407.265467:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40f525 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.265473:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40f525 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635407.265767:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789635407.265795:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427343488:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789635407.265863:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635407.265946:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427343488 00000100:00100000:2.0:1789635407.265955:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427343488 00000100:00100000:2.0:1789635407.266032:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789635407.266042:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427343488:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789635407.266174:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789635407.266178:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789635407 00002000:00010000:2.0:1789635407.266181:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789635407.266184:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789635407 -> 1789635407 00002000:00010000:2.0:1789635407.266186:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00080000:0.0:1789635407.266236:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789635407.266250:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1876568427343488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 208us (386us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789635407.266259:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:2.0:1789635407.266331:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d0447b5f100/2, rc 0, transno 4294967304 00000100:00100000:2.0:1789635407.266338:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427343488:0@lo:2:osp-syn-1-0.0 00000020:00080000:3.0:1789635407.269713:0:6493:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1789635407.269876:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1789635407.269889:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1789635407.273395:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+14:11296:x1876568411523328:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 Request processed in 11301us (12176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635407.273406:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 90 00000100:00100000:2.0:1789635407.278469:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635407.278545:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411523456 00000100:00100000:3.0:1789635407.278554:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411523456 00000100:00100000:3.0:1789635407.278826:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 38 00000100:00100000:3.0:1789635407.278838:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04478ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:2399:x1876568411523456:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1789635407.280488:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:3.0:1789635407.280501:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:2.0:1789635407.280872:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04478ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2399:x1876568411523456:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 Request processed in 2030us (2407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635407.280885:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 38 00000100:00100000:2.0:1789635407.285550:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635407.285644:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411523712 00000100:00100000:3.0:1789635407.285653:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411523712 00000100:00100000:3.0:1789635407.285705:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 91 00000100:00100000:3.0:1789635407.285715:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+14:11296:x1876568411523712:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789635407.285765:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635407.285791:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40f541 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740a0 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.285807:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d0447664e00) 00010000:00010000:3.0:1789635407.285819:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789635407.285846:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8600/0xb0c3a59caa40f556 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.285859:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8600/0xb0c3a59caa40f556 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.285870:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8600/0xb0c3a59caa40f556 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789635407.285978:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003bf519d5 reply state 000000005c867bdf transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8600/0xb0c3a59caa40f556 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.285990:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8600/0xb0c3a59caa40f556 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.285997:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d0447664e00) 00010000:00010000:3.0:1789635407.285999:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789635407.286002:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789635407.286102:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+15:11296:x1876568411523712:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 388us (557us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1789635407.286110:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 91 00000100:00100000:0.0:1789635407.294696:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635407.294775:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411523840 00000100:00100000:1.0:1789635407.294784:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411523840 00000100:00100000:1.0:1789635407.294836:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 39 00000100:00100000:1.0:1789635407.294846:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2398:x1876568411523840:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789635407.294990:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789635407.294994:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1789635407 -> 1789635406 00002000:00010000:1.0:1789635407.294996:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789635404 00002000:00010000:1.0:1789635407.294999:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789635407 -> 1789635406 00002000:00010000:1.0:1789635407.295001:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1789635407.295051:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:2398:x1876568411523840:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 206us (364us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789635407.295058:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 39 00000100:00100000:3.0:1789635407.301670:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635407.301917:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411524096 00000100:00100000:0.0:1789635407.301927:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411524096 00000100:00100000:0.0:1789635407.302078:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 92 00000100:00100000:0.0:1789635407.302090:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+15:11296:x1876568411524096:12345-192.168.203.20@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789635407.302158:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f55d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.302181:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f51e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74092 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.302198:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f55d lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.302237:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f51e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74092 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.302250:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f51e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74092 expref: 15 pid: 6516 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635407.302264:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ada680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6515:1876568427343616:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789635407.302336:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446df56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635407.305937:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ada680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6515:1876568427343616:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789635407.305965:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f55d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635407.318440:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635407.322105:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411524224 00000100:00100000:2.0:1789635407.322118:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411524224 00010000:00010000:2.0:1789635407.322157:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f51e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74092 expref: 16 pid: 6516 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635407.322192:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:2.0:1789635407.322201:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448598380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+16:2397:x1876568411524224:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635407.322214:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635407.322234:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f51e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74092 expref: 16 pid: 6516 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.322258:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f51e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74092 expref: 16 pid: 6516 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.322294:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f51e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74092 expref: 16 pid: 6516 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.322309:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d0447664e00) 00010000:00010000:2.0:1789635407.322314:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f55d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.322324:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f55d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.322332:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f55d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.322356:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635407.322411:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448598380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+15:2397:x1876568411524224:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 210us (3978us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635407.322419:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 60 00010000:00010000:2.0:1789635407.331579:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f55d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.331615:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f55d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.331673:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f55d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.333078:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f55d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.333086:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f55d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.333093:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1b000 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635407.333098:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f55d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.333108:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f55d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.333126:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d0447664e00) 00010000:00010000:2.0:1789635407.333128:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789635407.333133:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f55d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.333139:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f55d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635407.333974:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+14:11296:x1876568411524096:12345-192.168.203.20@tcp:55:lhsmtool_posix.0 Request processed in 31879us (32316us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789635407.333987:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 92 00000100:00100000:1.0:1789635407.355061:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635407.359353:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411524352 00000100:00100000:2.0:1789635407.359368:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411524352 00000100:00100000:2.0:1789635407.359429:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00100000:2.0:1789635407.359439:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:2399:x1876568411524352:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789635407.359490:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c5e66dd5/0xb0c3a59caa40f564 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.359518:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c971bec1/0xb0c3a59caa40f54f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740ae expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.359527:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789635407.359531:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789635407.359541:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5e66dd5/0xb0c3a59caa40f564 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.359586:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c971bec1/0xb0c3a59caa40f54f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740ae expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.360998:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c971bec1/0xb0c3a59caa40f54f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740ae expref: 7 pid: 8432 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635407.361020:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447918380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8432:1876568427343744:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789635407.361112:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0548dc6000 going to sleep for 11 seconds 00000100:00100000:2.0:1789635407.373570:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635407.377394:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411524480 00000100:00100000:3.0:1789635407.377409:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411524480 00010000:00010000:3.0:1789635407.377455:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c971bec1/0xb0c3a59caa40f54f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740ae expref: 8 pid: 8432 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635407.377506:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 61 00000100:00100000:3.0:1789635407.377515:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044791ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:2397:x1876568411524480:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635407.377539:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635407.377558:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c971bec1/0xb0c3a59caa40f54f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740ae expref: 8 pid: 8432 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.377581:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c971bec1/0xb0c3a59caa40f54f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740ae expref: 8 pid: 8432 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.377632:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789635407.377637:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789635407.377647:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5e66dd5/0xb0c3a59caa40f564 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.377656:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5e66dd5/0xb0c3a59caa40f564 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.377733:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635407.378001:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044791ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:2397:x1876568411524480:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 486us (4447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635407.378009:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 61 00010000:00010000:0.0:1789635407.385375:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c971bec1/0xb0c3a59caa40f54f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740ae expref: 7 pid: 8432 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635407.385399:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447918380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8432:1876568427343744:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789635407.385425:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c5e66dd5/0xb0c3a59caa40f564 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635407.385506:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c5e66dd5/0xb0c3a59caa40f564 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635407.385516:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5e66dd5/0xb0c3a59caa40f564 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635407.385545:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c5e66dd5/0xb0c3a59caa40f564 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635407.385553:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5e66dd5/0xb0c3a59caa40f564 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635407.385572:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5e66dd5/0xb0c3a59caa40f564 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635407.385581:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540030200 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:1.0:1789635407.385585:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5e66dd5/0xb0c3a59caa40f564 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635407.385636:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5e66dd5/0xb0c3a59caa40f564 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635407.386116:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5e66dd5/0xb0c3a59caa40f564 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635407.386138:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5e66dd5/0xb0c3a59caa40f564 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635407.386325:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2399:x1876568411524352:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 Request processed in 26884us (31268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635407.386335:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00100000:2.0:1789635407.403478:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635407.403538:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411524736 00000100:00100000:0.0:1789635407.403548:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411524736 00000100:00100000:0.0:1789635407.403658:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 93 00000100:00100000:0.0:1789635407.403668:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+14:11296:x1876568411524736:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789635407.403759:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f56b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.403775:0:9526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f3b2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74037 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.403794:0:9526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f56b lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.403828:0:9526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f3b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74037 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.403840:0:9526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f3b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74037 expref: 14 pid: 6514 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635407.403852:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9526:1876568427343872:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789635407.403939:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446df5480 going to sleep for 11 seconds 00000100:00100000:3.0:1789635407.414719:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635407.414759:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411524864 00000100:00100000:3.0:1789635407.414769:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411524864 00010000:00010000:3.0:1789635407.414805:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f3b2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74037 expref: 15 pid: 6514 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635407.414837:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 62 00000100:00100000:3.0:1789635407.414846:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b405850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+15:2397:x1876568411524864:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635407.414865:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635407.414872:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f3b2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74037 expref: 15 pid: 6514 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.414885:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f3b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74037 expref: 15 pid: 6514 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.414907:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:3.0:1789635407.414912:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f56b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.414921:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f56b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.414930:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f56b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.414948:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635407.414994:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b405850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+15:2397:x1876568411524864:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 148us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635407.415001:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 62 00010000:00010000:0.0:1789635407.417295:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f3b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74037 expref: 14 pid: 6514 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635407.417318:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9526:1876568427343872:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789635407.417343:0:9526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f56b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635407.417475:0:9526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f56b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635407.417484:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f56b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635407.417713:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f572 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635407.417726:0:9526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f52c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74099 expref: 14 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635407.417735:0:9526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f572 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635407.417768:0:9526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f52c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74099 expref: 14 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635407.418031:0:9526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f52c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74099 expref: 14 pid: 10094 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635407.418048:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044782a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9526:1876568427344000:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789635407.418131:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446c1a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635407.422417:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635407.422474:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044782a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9526:1876568427344000:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789635407.422504:0:9526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f572 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635407.422999:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411524992 00000100:00100000:2.0:1789635407.423007:0:7457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411524992 00010000:00010000:2.0:1789635407.423041:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f52c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74099 expref: 15 pid: 10094 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635407.423069:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00100000:2.0:1789635407.423078:0:7457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448598380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+15:2396:x1876568411524992:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635407.423101:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635407.423109:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f52c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74099 expref: 15 pid: 10094 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.423122:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f52c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74099 expref: 15 pid: 10094 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.423142:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f52c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74099 expref: 15 pid: 10094 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.423156:0:7457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d0447664e00) 00010000:00010000:2.0:1789635407.423161:0:7457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f572 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.423170:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f572 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.423177:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f572 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.423243:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635407.423290:0:7457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448598380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+14:2396:x1876568411524992:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 212us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635407.423297:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 63 00010000:00010000:0.0:1789635407.427954:0:9526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f572 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.427970:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f572 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789635407.428073:0:9526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:0.0:1789635407.428184:0:9526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:0.0:1789635407.428218:0:9526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:0.0:1789635407.428298:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9526:1876568427344128:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789635407.428358:0:9526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635407.428457:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446df5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789635407.430343:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427344128 00000100:00100000:3.0:1789635407.430355:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427344128 00000100:00100000:0.0:1789635407.430475:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789635407.430485:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9526:x1876568427344128:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789635407.430631:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9526:x1876568427344128:12345-0@lo:1000:mdt00_003.0 Request processed in 136us (2261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635407.430638:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789635407.430700:0:9526:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1789635407.430706:0:9526:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d0447b5f100, transno 4294967304 00000100:00100000:0.0:1789635407.430721:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9526:1876568427344128:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1789635407.430866:0:9526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:0.0:1789635407.430941:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9526:1876568427344256:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789635407.430977:0:9526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635407.430998:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446df50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635407.431070:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427344256 00000100:00100000:0.0:1789635407.431075:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427344256 00000100:00100000:0.0:1789635407.431098:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789635407.431116:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9526:x1876568427344256:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789635407.431205:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9526:x1876568427344256:12345-0@lo:1000:mdt00_003.0 Request processed in 90us (227us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789635407.431212:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789635407.431244:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9526:1876568427344256:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1789635407.431276:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f572 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.431286:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f572 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.431294:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f572 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.431300:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e153000 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635407.431305:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f572 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.431312:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f572 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.431326:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d0447664e00) 00010000:00010000:0.0:1789635407.431329:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789635407.431334:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f572 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.431340:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40f572 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.431368:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f4a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.431379:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f4a7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.431385:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f4a7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.431390:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d054139c000 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635407.431393:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f4a7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.431398:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f4a7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.431406:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:0.0:1789635407.431408:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789635407.431412:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f4a7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.431418:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f4a7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.431440:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f579 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.431453:0:9526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f4c3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7407d expref: 17 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.431462:0:9526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f579 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.431486:0:9526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f4c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7407d expref: 17 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.431505:0:9526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f4c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7407d expref: 17 pid: 10094 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635407.431516:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0446c3ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9526:1876568427344384:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789635407.431584:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446df50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635407.438519:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0446c3ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9526:1876568427344384:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789635407.438551:0:9526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f579 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635407.469590:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635407.475520:0:13189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411525120 00000100:00100000:0.0:1789635407.475533:0:13189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411525120 00010000:00010000:0.0:1789635407.475588:0:13189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f4c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7407d expref: 18 pid: 10094 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635407.476079:0:13189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 64 00000100:00100000:0.0:1789635407.476091:0:13189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+18:2396:x1876568411525120:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789635407.476106:0:13189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635407.476113:0:13189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f4c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7407d expref: 18 pid: 10094 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.476128:0:13189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f4c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7407d expref: 18 pid: 10094 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.476149:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f4c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7407d expref: 18 pid: 10094 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.476176:0:13189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:0.0:1789635407.476181:0:13189:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f579 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.476190:0:13189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f579 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.476199:0:13189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f579 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.476236:0:13189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635407.476295:0:13189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+17:2396:x1876568411525120:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 206us (6714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635407.476303:0:13189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 64 00010000:00010000:3.0:1789635407.478402:0:9526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f579 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.478418:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f579 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.479986:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f579 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.479996:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f579 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.480004:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f579 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.480010:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1bc00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635407.480014:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f579 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.480022:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f579 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.480038:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:3.0:1789635407.480040:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635407.480045:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f579 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.480051:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f579 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.480065:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f56b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.480071:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f56b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.480077:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f56b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.480089:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1b000 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635407.480092:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f56b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.480098:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f56b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.480106:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466cac00) 00010000:00010000:3.0:1789635407.480108:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789635407.480111:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f56b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.480117:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f56b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635407.481345:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+16:11296:x1876568411524736:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 77671us (77868us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1789635407.481358:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 93 00000020:00080000:3.0:1789635407.481365:0:9526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789635407.481923:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789635407.481928:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789635407.481948:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789635407.481955:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789635407.487165:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635407.487234:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411525376 00000100:00100000:0.0:1789635407.487244:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411525376 00000100:00100000:0.0:1789635407.487303:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:0.0:1789635407.487313:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+16:11296:x1876568411525376:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789635407.487545:0:6518:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789635407.487614:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:0.0:1789635407.487647:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40f580 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.487671:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40f580 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.487744:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40f580 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.487948:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40f580 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.487957:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40f580 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.487962:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40f580 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.487980:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789635407.488061:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+18:11296:x1876568411525376:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 748us (901us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1789635407.488069:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 20 00000020:00080000:0.0:1789635407.488074:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789635407.488096:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635407.488102:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40f580 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.488110:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1ba00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:0.0:1789635407.488114:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40f580 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.488123:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40f580 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.488160:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d0447664e00) 00010000:00010000:0.0:1789635407.488164:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789635407.488168:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40f580 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.488185:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40f580 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.488197:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635407.488199:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635407.488201:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789635407.706119:0:14213:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789635407.706129:0:14213:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789635407.706152:0:14213:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789635407.706159:0:14213:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789635407.920935:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635407.920965:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411525632 00000100:00100000:3.0:1789635407.920973:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411525632 00000100:00100000:3.0:1789635407.921016:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 94 00000100:00100000:3.0:1789635407.921025:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+18:11306:x1876568411525632:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789635407.921055:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635407.921073:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f587 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab740b5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.921164:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f58e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.921177:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f58e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.921188:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f58e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635407.921197:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789635407.921275:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f587 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740b5 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.921291:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f58e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740b5 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.921299:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d0558d1c900) 00010000:00010000:3.0:1789635407.921302:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789635407.921305:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056f6e8800, rc 0) 00000100:00100000:3.0:1789635407.921349:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+20:11306:x1876568411525632:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 326us (423us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1789635407.921356:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 94 00000100:00100000:1.0:1789635407.924240:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635407.927308:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411525760 00000100:00100000:2.0:1789635407.927324:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411525760 00000100:00100000:2.0:1789635407.927439:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 95 00000100:00100000:2.0:1789635407.927451:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+20:11306:x1876568411525760:12345-192.168.203.20@tcp:34:lfs.0 00010000:00010000:2.0:1789635407.927541:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f59c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.927569:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f59c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.927581:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f59c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.927623:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f5a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.927632:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.927645:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.927713:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f5aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.927720:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f5aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.927727:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f5aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789635407.927775:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f5aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.927787:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f59c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.927803:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f59c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.927810:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f59c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.927816:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540030a00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635407.927820:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f59c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.927828:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f59c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.927839:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d0558d1c900) 00010000:00010000:2.0:1789635407.927841:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635407.927845:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f59c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.927851:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f59c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.927863:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.927870:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f5a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.927876:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f5a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.927881:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540030c00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635407.927888:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f5a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.927894:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f5a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.927901:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d0544e2e200) 00010000:00010000:2.0:1789635407.927903:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635407.927905:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f5a3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.927911:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f5a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.927924:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f5aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.927930:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f5aa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.927936:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f5aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.927941:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540031800 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635407.927943:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f5aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.927949:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f5aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.927955:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d0544e2e300) 00010000:00010000:2.0:1789635407.927957:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635407.927962:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f5aa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.927968:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f5aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635407.928040:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+20:11306:x1876568411525760:12345-192.168.203.20@tcp:34:lfs.0 Request processed in 591us (3808us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635407.928047:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 95 00000100:00100000:3.0:1789635408.000355:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635408.000435:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411526016 00000100:00100000:1.0:1789635408.000447:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411526016 00000100:00100000:1.0:1789635408.000511:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 96 00000100:00100000:1.0:1789635408.000522:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+20:11309:x1876568411526016:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789635408.000542:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635408.000572:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40f5b1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab740bc expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.000782:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f5b8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.000798:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f5b8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.000810:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f5b8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.000827:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40f5bf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.000835:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40f5bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.000841:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40f5bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.000958:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f5c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.000968:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f5c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.000975:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f5c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635408.000984:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789635408.001058:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f5b8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.001065:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f5b8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.001072:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f5b8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.001078:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152e00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635408.001083:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f5b8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.001091:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f5b8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.001105:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d0558d1c900) 00010000:00010000:1.0:1789635408.001108:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635408.001113:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f5b8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.001129:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f5b8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.001142:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40f5bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.001147:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40f5bf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.001153:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40f5bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.001157:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e153a00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635408.001160:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40f5bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.001166:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40f5bf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.001175:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d04466ca300) 00010000:00010000:1.0:1789635408.001178:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635408.001181:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40f5bf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.001186:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40f5bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.001226:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40f5b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740bc expref: 23 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.001240:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f5c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740bc expref: 22 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.001253:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466ca100) 00010000:00010000:1.0:1789635408.001256:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789635408.001258:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e153600, rc 0) 00000100:00100000:1.0:1789635408.001325:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+22:11309:x1876568411526016:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 805us (980us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1789635408.001333:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 96 00000100:00100000:0.0:1789635408.030491:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635408.049504:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411526144 00010000:00010000:2.0:1789635408.049630:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635408.049750:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411526144 00000100:00100000:3.0:1789635408.049836:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 97 00000100:00100000:3.0:1789635408.049846:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+22:11309:x1876568411526144:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:3.0:1789635408.049910:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f5d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.049927:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f5d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.049938:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f5d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.049971:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f5d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.049978:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f5d4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.049984:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f5d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.049990:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056f6e9a00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635408.049994:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f5d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.050002:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f5d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.050014:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466ca100) 00010000:00010000:3.0:1789635408.050017:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789635408.050022:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f5d4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.050228:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f5d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635408.050335:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+22:11309:x1876568411526144:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 489us (19851us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635408.050343:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 97 00000100:00100000:1.0:1789635408.064702:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635408.064746:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411526400 00000100:00100000:2.0:1789635408.064756:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411526400 00000100:00100000:2.0:1789635408.064823:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:2.0:1789635408.064833:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b747450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+22:11309:x1876568411526400:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:2.0:1789635408.065153:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b747450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+23:11309:x1876568411526400:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 319us (456us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1789635408.065161:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:3.0:1789635408.150208:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635408.150891:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411526656 00000100:00100000:2.0:1789635408.150902:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411526656 00000100:00100000:2.0:1789635408.151431:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 98 00000100:00100000:2.0:1789635408.151442:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+23:10834:x1876568411526656:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1789635408.151466:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635408.151486:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f5db lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab740c3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.151665:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f5e2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.151680:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f5c6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740bc expref: 24 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.151705:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f5e2 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.151743:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f5c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740bc expref: 24 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.151757:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f5c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740bc expref: 24 pid: 9526 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635408.151772:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044791ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6515:1876568427344512:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789635408.151855:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05540dd180 going to sleep for 11 seconds 00000100:00100000:2.0:1789635408.159972:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044791ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6515:1876568427344512:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789635408.160004:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f5e2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635408.161045:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635408.161434:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411526784 00000100:00100000:2.0:1789635408.161443:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411526784 00010000:00010000:2.0:1789635408.161482:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f5c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740bc expref: 25 pid: 9526 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635408.161531:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 65 00000100:00100000:2.0:1789635408.161541:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+25:2397:x1876568411526784:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635408.161567:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635408.161575:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f5c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740bc expref: 25 pid: 9526 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.161644:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f5c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740bc expref: 25 pid: 9526 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.161665:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f5c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740bc expref: 25 pid: 9526 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.161680:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466ca100) 00010000:00010000:2.0:1789635408.161684:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f5e2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.161692:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f5e2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.161699:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f5e2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.161732:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635408.161783:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+24:2397:x1876568411526784:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 242us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635408.161790:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 65 00010000:00010000:3.0:1789635408.162282:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f5e2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.162293:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f5e2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635408.162312:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789635408.162442:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f5db lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740c3 expref: 25 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.162460:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f5e2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740c3 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.162468:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466ca100) 00010000:00010000:3.0:1789635408.162471:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789635408.162474:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0540030a00, rc 0) 00000100:00100000:3.0:1789635408.162517:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+24:10834:x1876568411526656:12345-192.168.203.20@tcp:101:bash.0 Request processed in 11077us (12328us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1789635408.162525:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 98 00000100:00100000:3.0:1789635408.169723:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635408.169855:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411526912 00000100:00100000:1.0:1789635408.169865:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411526912 00000100:00100000:1.0:1789635408.169924:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 99 00000100:00100000:1.0:1789635408.169933:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+24:10834:x1876568411526912:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:1.0:1789635408.169955:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635408.169972:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40f5f0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab740ca expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.170002:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f5f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.170015:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.170026:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.170147:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40f5f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740ca expref: 26 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.170176:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f5f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740ca expref: 25 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.170184:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466ca100) 00010000:00010000:1.0:1789635408.170187:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789635408.170191:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e152e00, rc 0) 00000100:00100000:1.0:1789635408.170251:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+25:10834:x1876568411526912:12345-192.168.203.20@tcp:101:bash.0 Request processed in 318us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635408.170259:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 99 00000100:00100000:0.0:1789635408.179171:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635408.179273:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411527168 00000100:00100000:3.0:1789635408.179284:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411527168 00000100:00100000:3.0:1789635408.179346:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 100 00000100:00100000:3.0:1789635408.179356:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+25:10834:x1876568411527168:12345-192.168.203.20@tcp:36:bash.0 00010000:00010000:3.0:1789635408.179593:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f5fe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.179656:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f5fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.179668:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f5fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789635408.179712:0:10094:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:3.0:1789635408.179735:0:10094:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000b192b2d reply state 0000000029df3f90 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f5fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.179747:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f5fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.179754:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466ca100) 00010000:00010000:3.0:1789635408.179757:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789635408.179760:0:10094:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789635408.179798:0:10094:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:3.0:1789635408.179888:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+29:10834:x1876568411527168:12345-192.168.203.20@tcp:36:bash.0 Request processed in 533us (762us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1789635408.179895:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 100 00000020:00080000:3.0:1789635408.179900:0:10094:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789635408.187649:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635408.188052:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411527296 00000100:00100000:3.0:1789635408.188062:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411527296 00000100:00100000:3.0:1789635408.188125:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 101 00000100:00100000:3.0:1789635408.188149:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+29:10834:x1876568411527296:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:3.0:1789635408.188172:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635408.188194:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9000/0xb0c3a59caa40f605 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab740d1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.188249:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9000/0xb0c3a59caa40f605 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740d1 expref: 30 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.188264:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9000/0xb0c3a59caa40f605 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740d1 expref: 30 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.188281:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466ca100) 00010000:00010000:3.0:1789635408.188284:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789635408.188287:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056f6e9000, rc 0) 00000100:00100000:3.0:1789635408.188351:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+30:10834:x1876568411527296:12345-192.168.203.20@tcp:101:bash.0 Request processed in 204us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635408.188359:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 101 00000100:00100000:0.0:1789635408.196269:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635408.196376:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411527424 00000100:00100000:1.0:1789635408.196386:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411527424 00000100:00100000:1.0:1789635408.196450:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 41 00000100:00100000:1.0:1789635408.196460:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:10834:x1876568411527424:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:1.0:1789635408.196478:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635408.196500:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070c933e6/0xb0c3a59caa40f60c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab740d8 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789635408.196525:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aabab4e, atime: 0x6aabab4c, ctime: 0x6aabab4e, blocks: 0x8 00010000:00010000:1.0:1789635408.196545:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=426s v=(0 0) 00010000:00010000:1.0:1789635408.196550:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635408.196568:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070c933e6/0xb0c3a59caa40f60c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740d8 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.196585:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000070c933e6/0xb0c3a59caa40f60c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740d8 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.196662:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e153a00, rc 0) 00000100:00100000:1.0:1789635408.196710:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:10834:x1876568411527424:12345-192.168.203.20@tcp:101:bash.0 Request processed in 252us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635408.196717:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 41 00000100:00100000:0.0:1789635408.202097:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635408.202932:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411527552 00000100:00100000:3.0:1789635408.202942:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411527552 00002000:00010000:3.0:1789635408.202986:0:8435:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:3.0:1789635408.202991:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0447b5c000 with x1876568411527552 ext(0->18446744073709551615) 00002000:00010000:3.0:1789635408.203003:0:8435:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d0447b5c000. 00000100:00100000:3.0:1789635408.203041:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:3.0:1789635408.203051:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:2396:x1876568411527552:12345-192.168.203.20@tcp:10:bash.0 00002000:00010000:3.0:1789635408.203305:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1789635408.203308:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1789635406 -> 1789635408 00002000:00010000:3.0:1789635408.203311:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1789635404 -> 1789635404 00002000:00010000:3.0:1789635408.203323:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789635406 -> 1789635408 00002000:00010000:3.0:1789635408.203325:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1789635408.203520:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:2396:x1876568411527552:12345-192.168.203.20@tcp:10:bash.0 Request processed in 469us (1431us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789635408.203529:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 1 00002000:00010000:3.0:1789635408.203534:0:8435:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:3.0:1789635408.203536:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0447b5c000 with x1876568411527552 ext(0->18446744073709551615) 00002000:00010000:3.0:1789635408.203541:0:8435:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d0447b5c000. 00000100:00100000:2.0:1789635408.294975:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427344640:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789635408.295046:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635408.295647:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427344640 00000100:00100000:3.0:1789635408.295657:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427344640 00000100:00100000:3.0:1789635408.295712:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789635408.295723:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044791ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427344640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789635408.295758:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789635408.295811:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044791ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427344640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635408.295819:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789635408.295910:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427344640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789635408.296678:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789635408.296692:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427344768:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789635408.296736:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635408.297443:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427344768 00000100:00100000:3.0:1789635408.297452:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427344768 00000100:00100000:3.0:1789635408.297501:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789635408.297510:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427344768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789635408.297541:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1789635408.297649:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427344768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635408.297656:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789635408.298158:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427344768:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789635408.316036:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635408.316068:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635408.316150:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411527680 00000100:00100000:3.0:1789635408.316159:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411527680 00000100:00100000:3.0:1789635408.316205:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 392 00000100:00100000:3.0:1789635408.316223:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2398:x1876568411527680:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635408.316294:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2398:x1876568411527680:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 71us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635408.316301:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 392 00000100:00100000:0.0:1789635408.316775:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635408.316813:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635408.316964:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411527936 00000100:00100000:2.0:1789635408.316970:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411527936 00000100:00100000:0.0:1789635408.316986:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635408.317018:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 120 00000100:00100000:2.0:1789635408.317026:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:2398:x1876568411527936:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635408.317077:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:2398:x1876568411527936:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 53us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635408.317085:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 120 00000100:00080000:2.0:1789635408.317103:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789635408.317737:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411527808 00000100:00100000:1.0:1789635408.317737:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411528192 00000100:00100000:3.0:1789635408.317744:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411527808 00000100:00100000:1.0:1789635408.317744:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411528192 00000100:00100000:3.0:1789635408.317829:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411528064 00000100:00100000:3.0:1789635408.317833:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411528064 00000100:00100000:2.0:1789635408.317859:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 330 00000100:00100000:2.0:1789635408.317870:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411527808:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635408.317917:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411527808:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 48us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635408.317923:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 330 00000100:00080000:0.0:1789635408.318086:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789635408.318090:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789635408.318185:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 331 00000100:00100000:1.0:1789635408.318194:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411528192:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789635408.318234:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411528192:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 42us (1470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635408.318240:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 331 00000100:00100000:3.0:1789635408.318781:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 332 00000100:00100000:3.0:1789635408.318790:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2399:x1876568411528064:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635408.318868:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2399:x1876568411528064:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 79us (1881us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635408.318875:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 332 00000100:00100000:2.0:1789635408.336744:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635408.338251:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411528320 00000100:00100000:1.0:1789635408.338264:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411528320 00000100:00100000:1.0:1789635408.338365:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 102 00000100:00100000:1.0:1789635408.338375:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+30:11323:x1876568411528320:12345-192.168.203.20@tcp:34:lfs.0 00010000:00010000:1.0:1789635408.338440:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40f613 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.338466:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40f613 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.338479:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40f613 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.338509:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153e00/0xb0c3a59caa40f61a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.338517:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153e00/0xb0c3a59caa40f61a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.338523:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153e00/0xb0c3a59caa40f61a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.338635:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f621 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.338649:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f621 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.338656:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f621 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789635408.338699:0:9526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f621 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.338708:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40f613 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.338713:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40f613 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.338719:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40f613 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.338725:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152800 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635408.338728:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40f613 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.338740:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40f613 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.338752:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d0558d1c900) 00010000:00010000:1.0:1789635408.338754:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635408.338758:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40f613 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.338776:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40f613 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.338788:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153e00/0xb0c3a59caa40f61a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.338794:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153e00/0xb0c3a59caa40f61a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.338799:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153e00/0xb0c3a59caa40f61a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.338804:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e153e00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635408.338806:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153e00/0xb0c3a59caa40f61a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.338821:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153e00/0xb0c3a59caa40f61a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.338829:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d04466cab00) 00010000:00010000:1.0:1789635408.338831:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635408.338834:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153e00/0xb0c3a59caa40f61a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.338851:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153e00/0xb0c3a59caa40f61a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.338865:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f621 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.338870:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f621 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.338876:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f621 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.338881:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e153600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635408.338884:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f621 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.338889:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f621 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.339387:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466ca100) 00010000:00010000:1.0:1789635408.339392:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635408.339396:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f621 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635408.339402:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f621 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635408.339495:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+30:11323:x1876568411528320:12345-192.168.203.20@tcp:34:lfs.0 Request processed in 1118us (2757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635408.339504:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 102 00000100:00100000:1.0:1789635408.434562:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635408.435179:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411528576 00000100:00100000:3.0:1789635408.435202:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411528576 00000100:00100000:3.0:1789635408.435271:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 103 00000100:00100000:3.0:1789635408.435282:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+30:11327:x1876568411528576:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789635408.435302:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635408.435321:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8400/0xb0c3a59caa40f628 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab740df expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.435430:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f62f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.435445:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f62f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.435456:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f62f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.435477:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f636 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.435485:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f636 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.435491:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f636 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.435651:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffc00/0xb0c3a59caa40f63d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.435662:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffc00/0xb0c3a59caa40f63d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.435669:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffc00/0xb0c3a59caa40f63d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635408.435680:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789635408.436272:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f62f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.436282:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f62f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.436290:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f62f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.436297:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d054139c000 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635408.436301:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f62f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.436319:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f62f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.436331:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d0558d1c900) 00010000:00010000:3.0:1789635408.436334:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635408.436339:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f62f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.436345:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c000/0xb0c3a59caa40f62f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.436358:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f636 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.436364:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f636 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.436371:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f636 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.436376:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d054139c600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635408.436379:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f636 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.438204:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f636 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.438221:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d044764bc00) 00010000:00010000:3.0:1789635408.438224:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635408.438228:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f636 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.438253:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139c600/0xb0c3a59caa40f636 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.438318:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8400/0xb0c3a59caa40f628 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740df expref: 33 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.438332:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffc00/0xb0c3a59caa40f63d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740df expref: 32 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.438339:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466ca100) 00010000:00010000:3.0:1789635408.438342:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789635408.438344:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05488ffc00, rc 0) 00000100:00100000:3.0:1789635408.439336:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+32:11327:x1876568411528576:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 4048us (4783us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1789635408.439347:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 103 00000100:00100000:2.0:1789635408.446466:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635408.446905:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411528704 00000100:00100000:3.0:1789635408.446916:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411528704 00000100:00100000:2.0:1789635408.447098:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 104 00000100:00100000:2.0:1789635408.447108:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+32:11327:x1876568411528704:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:2.0:1789635408.447172:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f64b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.447189:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f5e2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740c3 expref: 32 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.447198:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f64b lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.447235:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f5e2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740c3 expref: 32 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.447248:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f5e2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740c3 expref: 32 pid: 6515 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635408.447274:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05489c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6516:1876568427344896:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789635408.447351:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05540dd180 going to sleep for 11 seconds 00000100:00100000:0.0:1789635408.460882:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05489c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6516:1876568427344896:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789635408.460910:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f64b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635408.465935:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635408.466127:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411528960 00000100:00100000:0.0:1789635408.466137:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411528960 00000100:00100000:0.0:1789635408.466196:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:0.0:1789635408.466224:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05489ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+33:6163:x1876568411528960:12345-192.168.203.20@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789635408.466498:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05489ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+34:6163:x1876568411528960:12345-192.168.203.20@tcp:35:ldlm_bl.0 Request processed in 278us (573us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1789635408.466506:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:2.0:1789635408.471448:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635408.472657:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411529088 00000100:00100000:3.0:1789635408.472670:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411529088 00010000:00010000:3.0:1789635408.472716:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f5e2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740c3 expref: 34 pid: 6515 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635408.472761:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 66 00000100:00100000:3.0:1789635408.472770:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05489c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+34:2397:x1876568411529088:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635408.472795:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635408.472802:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f5e2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740c3 expref: 34 pid: 6515 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.472834:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f5e2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740c3 expref: 34 pid: 6515 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.472856:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f5e2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740c3 expref: 34 pid: 6515 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.472874:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466ca100) 00010000:00010000:3.0:1789635408.472879:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f64b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.472888:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f64b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.472896:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f64b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.472930:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635408.472991:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05489c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+33:2397:x1876568411529088:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 221us (1552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635408.473003:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 66 00010000:00010000:2.0:1789635408.474076:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f64b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.474089:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f64b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.474131:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f64b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.474138:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f64b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.474146:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f64b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.474151:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540031c00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635408.474155:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f64b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.474162:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f64b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.474174:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466ca100) 00010000:00010000:2.0:1789635408.474177:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789635408.474180:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f64b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.474198:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f64b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635408.474268:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+32:11327:x1876568411528704:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 27159us (27881us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635408.474276:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 104 00000100:00100000:2.0:1789635408.484367:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635408.485140:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411529344 00000100:00100000:0.0:1789635408.485150:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411529344 00000100:00100000:0.0:1789635408.485214:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:0.0:1789635408.485224:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05489ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+32:11327:x1876568411529344:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:0.0:1789635408.485428:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05489ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+33:11327:x1876568411529344:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 205us (1070us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1789635408.485436:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:1.0:1789635408.617666:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635408.622549:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411529600 00000100:00100000:2.0:1789635408.622577:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411529600 00000100:00100000:3.0:1789635408.627222:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 105 00000100:00100000:3.0:1789635408.627238:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044782a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+33:11338:x1876568411529600:12345-192.168.203.20@tcp:101:cat.0 00010000:00010000:3.0:1789635408.627262:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635408.627283:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f652 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab740e6 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.627352:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f659 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.627377:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f659 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.627404:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f659 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.627420:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe000/0xb0c3a59caa40f660 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.627428:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe000/0xb0c3a59caa40f660 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.627435:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe000/0xb0c3a59caa40f660 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.627538:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fee00/0xb0c3a59caa40f667 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.627547:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fee00/0xb0c3a59caa40f667 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.627566:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fee00/0xb0c3a59caa40f667 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635408.627575:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:3.0:1789635408.627682:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f659 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.627690:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f659 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.627706:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f659 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.627720:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488fe400 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635408.627724:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f659 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.627732:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f659 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.627744:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d0558d1c900) 00010000:00010000:3.0:1789635408.627747:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635408.627751:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f659 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.627757:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f659 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.627780:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe000/0xb0c3a59caa40f660 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.627786:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe000/0xb0c3a59caa40f660 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.627791:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe000/0xb0c3a59caa40f660 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.627796:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488fe000 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635408.627798:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe000/0xb0c3a59caa40f660 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.627803:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe000/0xb0c3a59caa40f660 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.627819:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d044764bc00) 00010000:00010000:3.0:1789635408.627822:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635408.627824:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe000/0xb0c3a59caa40f660 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.627829:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe000/0xb0c3a59caa40f660 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.627879:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f652 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740e6 expref: 36 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.627904:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fee00/0xb0c3a59caa40f667 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740e6 expref: 35 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.627911:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466ca100) 00010000:00010000:3.0:1789635408.627913:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789635408.627915:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05488fee00, rc 0) 00000100:00100000:3.0:1789635408.627981:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044782a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+35:11338:x1876568411529600:12345-192.168.203.20@tcp:101:cat.0 Request processed in 747us (10325us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1789635408.627988:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 105 00000100:00100000:1.0:1789635408.654355:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635408.654511:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411529856 00000100:00100000:0.0:1789635408.654521:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411529856 00000100:00100000:0.0:1789635408.654675:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:0.0:1789635408.654697:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044844bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+35:11338:x1876568411529856:12345-192.168.203.20@tcp:35:cat.0 00000100:00100000:0.0:1789635408.654999:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044844bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+36:11338:x1876568411529856:12345-192.168.203.20@tcp:35:cat.0 Request processed in 315us (653us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1789635408.655007:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:2.0:1789635408.708738:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635408.708875:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411530112 00000100:00100000:3.0:1789635408.708893:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411530112 00000100:00100000:3.0:1789635408.709014:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 106 00000100:00100000:3.0:1789635408.709024:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05489c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+36:11339:x1876568411530112:12345-192.168.203.20@tcp:36:rm.0 00010000:00010000:3.0:1789635408.709080:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1789635408.709104:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9000/0xb0c3a59caa40f605 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740d1 expref: 36 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.709561:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fee00/0xb0c3a59caa40f667 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740e6 expref: 35 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.709578:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffc00/0xb0c3a59caa40f63d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740df expref: 34 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.709590:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f5f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740ca expref: 33 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.711089:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466ca100) 00010000:00010000:3.0:1789635408.711096:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789635408.711124:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f675 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.711138:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f675 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.711160:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f675 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.711176:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe000/0xb0c3a59caa40f67c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.711183:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe000/0xb0c3a59caa40f67c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.711189:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe000/0xb0c3a59caa40f67c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.711273:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f683 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.711282:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f683 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.711289:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f683 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789635408.711527:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:3.0:1789635408.711538:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 427394940812ns, next at 428394938222ns, rc = 0 00010000:00010000:3.0:1789635408.711590:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff200/0xb0c3a59caa40f68a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.711627:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff200/0xb0c3a59caa40f68a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.711635:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff200/0xb0c3a59caa40f68a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.711643:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff200/0xb0c3a59caa40f68a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.711649:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff200/0xb0c3a59caa40f68a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.711654:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff200/0xb0c3a59caa40f68a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.711666:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789635408.711684:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f683 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.711696:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f683 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.711702:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f683 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.711707:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488fe400 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635408.711711:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f683 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.711718:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f683 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.711729:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466ca100) 00010000:00010000:3.0:1789635408.711731:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789635408.711735:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f683 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.711740:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f683 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.711755:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f675 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.711772:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f675 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.711778:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f675 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.711782:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488fe200 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635408.711791:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f675 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.711797:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f675 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.711805:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d0558d1c900) 00010000:00010000:3.0:1789635408.711807:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635408.711810:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f675 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.711815:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f675 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789635408.711825:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b54d3654 reply state 000000001402fa6a transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe000/0xb0c3a59caa40f67c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.711835:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe000/0xb0c3a59caa40f67c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.711841:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d044764bc00) 00010000:00010000:3.0:1789635408.711843:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789635408.711846:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789635408.713795:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635408.713806:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff200/0xb0c3a59caa40f68a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635408.713817:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488ff200 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:0.0:1789635408.713821:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff200/0xb0c3a59caa40f68a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635408.713856:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff200/0xb0c3a59caa40f68a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635408.713872:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466ca100) 00010000:00010000:0.0:1789635408.713875:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789635408.713878:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff200/0xb0c3a59caa40f68a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635408.713883:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff200/0xb0c3a59caa40f68a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635408.713920:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635408.713923:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635408.713925:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635408.714588:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05489c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+34:11339:x1876568411530112:12345-192.168.203.20@tcp:36:rm.0 Request processed in 5559us (5853us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1789635408.714624:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 106 00000100:00100000:1.0:1789635408.830989:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635408.831089:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411530368 00000100:00100000:2.0:1789635408.831100:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411530368 00000100:00100000:2.0:1789635408.831347:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 107 00000100:00100000:2.0:1789635408.831359:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+34:11345:x1876568411530368:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1789635408.831382:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635408.831401:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f691 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab740ed expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.831523:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f698 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.831538:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f698 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.831548:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f698 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.831572:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f69f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.831587:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f69f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.831628:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f69f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789635408.833472:0:6516:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1789635408.833661:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f6a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.833676:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.833699:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.833735:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f698 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.835411:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f698 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.835423:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f698 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.835430:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540030c00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635408.835435:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f698 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.835445:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f698 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.835483:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d0558d1c900) 00010000:00010000:2.0:1789635408.835486:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635408.835492:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f698 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.835499:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f698 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789635408.835518:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000010c31cf5 reply state 00000000210028bd transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f69f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.835531:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f69f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.835538:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d044764bc00) 00010000:00010000:2.0:1789635408.835540:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789635408.835544:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789635408.835643:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f691 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740ed expref: 37 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.835660:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f6a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740ed expref: 36 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.835668:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d0544e2e300) 00010000:00010000:2.0:1789635408.835670:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789635408.835672:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0540031c00, rc 0) 00000100:00100000:2.0:1789635408.835833:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+37:11345:x1876568411530368:12345-192.168.203.20@tcp:101:bash.0 Request processed in 4476us (4853us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1789635408.835841:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 107 00000100:00100000:1.0:1789635408.846543:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635408.846865:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411530496 00000100:00100000:2.0:1789635408.846876:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411530496 00000100:00100000:2.0:1789635408.846937:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 42 00000100:00100000:2.0:1789635408.846948:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:2399:x1876568411530496:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1789635408.846967:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635408.846988:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a2551d/0xb0c3a59caa40f6b4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab740f4 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789635408.847014:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789635408.847035:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=427s v=(0 0) 00010000:00010000:2.0:1789635408.847039:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635408.847048:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a2551d/0xb0c3a59caa40f6b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740f4 expref: 8 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.847069:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a2551d/0xb0c3a59caa40f6b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740f4 expref: 8 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.847081:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0540031400, rc 0) 00000100:00100000:2.0:1789635408.847244:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:2399:x1876568411530496:12345-192.168.203.20@tcp:101:bash.0 Request processed in 296us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635408.847251:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 42 00000100:00100000:0.0:1789635408.876269:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635408.878805:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411530624 00000100:00100000:2.0:1789635408.878820:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411530624 00000100:00100000:2.0:1789635408.878899:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 43 00000100:00100000:2.0:1789635408.878909:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:11345:x1876568411530624:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1789635408.878927:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635408.878957:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a224277/0xb0c3a59caa40f6bb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab740fb expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.878990:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a2551d/0xb0c3a59caa40f6b4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740f4 expref: 9 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.878999:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635408.879003:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635408.879009:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a224277/0xb0c3a59caa40f6bb lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740fb expref: 9 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.879059:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000079a2551d/0xb0c3a59caa40f6b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740f4 expref: 9 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635408.879074:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000079a2551d/0xb0c3a59caa40f6b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740f4 expref: 9 pid: 8431 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635408.879087:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05489c8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1876568427345024:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789635408.879653:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d054604a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635408.888693:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05489c8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1876568427345024:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789635408.888730:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a224277/0xb0c3a59caa40f6bb lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740fb expref: 9 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635408.889715:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00010000:00010000:2.0:1789635408.889858:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0540030c00, rc 0) 00000100:00100000:2.0:1789635408.889920:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+9:11345:x1876568411530624:12345-192.168.203.20@tcp:101:bash.0 Request processed in 11012us (13661us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635408.889923:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411530752 00000100:00100000:3.0:1789635408.889942:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411530752 00000100:00100000:2.0:1789635408.889945:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 43 00010000:00010000:3.0:1789635408.889971:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000079a2551d/0xb0c3a59caa40f6b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740f4 expref: 9 pid: 8431 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635408.890016:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 67 00000100:00100000:3.0:1789635408.890024:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+9:2396:x1876568411530752:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635408.890038:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635408.890058:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000079a2551d/0xb0c3a59caa40f6b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740f4 expref: 9 pid: 8431 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.890071:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000079a2551d/0xb0c3a59caa40f6b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740f4 expref: 9 pid: 8431 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.890094:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a2551d/0xb0c3a59caa40f6b4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740f4 expref: 9 pid: 8431 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.890108:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635408.890113:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635408.890120:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a224277/0xb0c3a59caa40f6bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740fb expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.890130:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a224277/0xb0c3a59caa40f6bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740fb expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635408.890163:0:6499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007a224277/0xb0c3a59caa40f6bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740fb expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635408.890177:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448599880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6499:1876568427345152:192.168.203.20@tcp:105: 00000100:00100000:3.0:1789635408.890230:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446c53900 going to sleep for 11 seconds 00000100:00100000:3.0:1789635408.900140:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448599880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6499:1876568427345152:192.168.203.20@tcp:105: 00010000:00010000:3.0:1789635408.900165:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635408.900212:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:2396:x1876568411530752:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 10188us (10501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635408.900223:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 67 00000100:00100000:1.0:1789635408.900662:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635408.901271:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411531008 00000100:00100000:2.0:1789635408.901280:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411531008 00000100:00100000:2.0:1789635408.901330:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:2.0:1789635408.901339:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+37:11345:x1876568411531008:12345-192.168.203.20@tcp:35:bash.0 00000100:00100000:2.0:1789635408.904300:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+38:11345:x1876568411531008:12345-192.168.203.20@tcp:35:bash.0 Request processed in 2950us (3628us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1789635408.904316:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 25 00010000:00010000:0.0:1789635409.060158:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635409.300706:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635409.301355:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411531136 00000100:00100000:3.0:1789635409.302790:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411531136 00000100:00100000:3.0:1789635409.302954:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 108 00000100:00100000:3.0:1789635409.302965:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+38:11361:x1876568411531136:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789635409.302989:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635409.303018:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f6c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74102 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.303079:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f6c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.303092:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.303104:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635409.303155:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789635409.303159:0:9526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789635409.303176:0:9526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.303199:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f6c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74102 expref: 40 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.303229:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f6c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74102 expref: 39 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.303248:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d0558d1c900) 00010000:00010000:3.0:1789635409.303251:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789635409.303255:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05488fe400, rc 0) 00000100:00100000:3.0:1789635409.303321:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+39:11361:x1876568411531136:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 358us (2624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635409.303328:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 108 00000100:00080000:0.0:1789635409.311950:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635409.317045:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635409.317199:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411531392 00000100:00100000:3.0:1789635409.317208:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411531392 00000100:00100000:3.0:1789635409.317295:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 109 00000100:00100000:3.0:1789635409.317306:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+39:11361:x1876568411531392:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789635409.317325:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635409.317344:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f6d0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74109 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.317449:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffc00/0xb0c3a59caa40f6d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.317463:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffc00/0xb0c3a59caa40f6d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.317474:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffc00/0xb0c3a59caa40f6d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635409.317484:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789635409.317641:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f6d0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74109 expref: 42 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.317660:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffc00/0xb0c3a59caa40f6d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74109 expref: 41 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.317668:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d0544e2e300) 00010000:00010000:3.0:1789635409.317672:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789635409.317675:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05488ffc00, rc 0) 00000100:00100000:3.0:1789635409.317794:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+41:11361:x1876568411531392:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 490us (757us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1789635409.317802:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 109 00000100:00100000:2.0:1789635409.324654:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635409.324753:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635409.324831:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411531776 00000100:00100000:1.0:1789635409.324841:0:7457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411531776 00000100:00100000:1.0:1789635409.324909:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:1.0:1789635409.324919:0:7457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05489c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+41:2397:x1876568411531776:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635409.324933:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635409.324958:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffc00/0xb0c3a59caa40f6d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74109 expref: 41 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635409.324974:0:7457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d0544e2e300) 00010000:00010000:1.0:1789635409.324979:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635409.325034:0:7457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05489c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+40:2397:x1876568411531776:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 117us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635409.325042:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:0.0:1789635409.326557:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411531648 00000100:00100000:0.0:1789635409.326569:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411531648 00000100:00100000:0.0:1789635409.326637:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 110 00000100:00100000:0.0:1789635409.326647:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05489c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+40:11361:x1876568411531648:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1789635409.326668:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635409.326687:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b200/0xb0c3a59caa40f6e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74110 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.326973:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a000/0xb0c3a59caa40f6ec lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.327004:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a000/0xb0c3a59caa40f6ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.327014:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a000/0xb0c3a59caa40f6ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635409.327027:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789635409.327191:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b200/0xb0c3a59caa40f6e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74110 expref: 43 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.327210:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a000/0xb0c3a59caa40f6ec lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74110 expref: 42 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.327217:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d0544e2e300) 00010000:00010000:0.0:1789635409.327220:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789635409.327223:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1a000, rc 0) 00000100:00100000:0.0:1789635409.327286:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05489c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+42:11361:x1876568411531648:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 640us (2641us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1789635409.327293:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 110 00000100:00100000:2.0:1789635409.335053:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635409.335124:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411531904 00000100:00100000:1.0:1789635409.335133:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411531904 00000100:00100000:1.0:1789635409.335194:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 44 00000100:00100000:1.0:1789635409.335204:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0558848e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:2396:x1876568411531904:12345-192.168.203.20@tcp:1:lfs.0 00010000:00010000:1.0:1789635409.335247:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f59f798e/0xb0c3a59caa40f6fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635409.335276:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a224277/0xb0c3a59caa40f6bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740fb expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635409.335284:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789635409.335288:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789635409.335293:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f59f798e/0xb0c3a59caa40f6fa lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635409.335326:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007a224277/0xb0c3a59caa40f6bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740fb expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635409.335335:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007a224277/0xb0c3a59caa40f6bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740fb expref: 8 pid: 8430 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635409.335346:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bfdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1876568427345280:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789635409.335408:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446c1a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635409.339339:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635409.339446:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bfdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1876568427345280:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789635409.339473:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f59f798e/0xb0c3a59caa40f6fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635409.339586:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411532032 00000100:00100000:3.0:1789635409.339688:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411532032 00002000:00100000:2.0:1789635409.344514:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8d0550bfea00 x1876568411532032/t0(0) o4->6e1c17f2-a595-4ed0-97c8-b9260d0850ab@192.168.203.20@tcp:30/0 lens 504/0 e 0 to 0 dl 1789635420 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789635409.344526:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0550bfea00 with x1876568411532032 ext(0->8) 00010000:00010000:2.0:1789635409.344535:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000007a224277/0xb0c3a59caa40f6bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740fb expref: 9 pid: 8430 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635409.344561:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000007a224277/0xb0c3a59caa40f6bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740fb expref: 9 pid: 8430 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789635409.344590:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d0550bfea00 00000100:00100000:2.0:1789635409.344666:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:2.0:1789635409.344677:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+9:2396:x1876568411532032:12345-192.168.203.20@tcp:4:lfs.0 00000001:00080000:1.0:1789635409.359673:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1789635409.359689:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:2.0:1789635409.359960:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+9:2396:x1876568411532032:12345-192.168.203.20@tcp:4:lfs.0 Request processed in 15280us (20625us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789635409.359973:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 1 00002000:00100000:2.0:1789635409.359986:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8d0550bfea00 x1876568411532032/t4294967303(0) o4->6e1c17f2-a595-4ed0-97c8-b9260d0850ab@192.168.203.20@tcp:30/0 lens 504/448 e 0 to 0 dl 1789635420 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789635409.359997:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0550bfea00 with x1876568411532032 ext(0->8) 00010000:00010000:2.0:1789635409.360007:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000007a224277/0xb0c3a59caa40f6bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740fb expref: 9 pid: 8430 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635409.360027:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000007a224277/0xb0c3a59caa40f6bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740fb expref: 9 pid: 8430 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789635409.360035:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d0550bfea00 00000100:00100000:2.0:1789635409.378861:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635409.378979:0:13189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411532160 00000100:00100000:0.0:1789635409.378988:0:13189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411532160 00010000:00010000:0.0:1789635409.379032:0:13189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007a224277/0xb0c3a59caa40f6bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740fb expref: 9 pid: 8430 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635409.379249:0:13189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 68 00000100:00100000:0.0:1789635409.379259:0:13189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b407450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+9:2396:x1876568411532160:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789635409.379276:0:13189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789635409.379302:0:13189:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789635409.379305:0:13189:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789635409 00002000:00010000:0.0:1789635409.379307:0:13189:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789635409 00002000:00010000:0.0:1789635409.379310:0:13189:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1789635409 00002000:00010000:0.0:1789635409.379312:0:13189:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789635409.379318:0:13189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007a224277/0xb0c3a59caa40f6bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740fb expref: 9 pid: 8430 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.379331:0:13189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007a224277/0xb0c3a59caa40f6bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740fb expref: 9 pid: 8430 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.379355:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a224277/0xb0c3a59caa40f6bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740fb expref: 9 pid: 8430 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.379371:0:13189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789635409.379386:0:13189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789635409.379392:0:13189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f59f798e/0xb0c3a59caa40f6fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.379402:0:13189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f59f798e/0xb0c3a59caa40f6fa lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.380053:0:13189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789635409.380057:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f59f798e/0xb0c3a59caa40f6fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635409.380071:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f59f798e/0xb0c3a59caa40f6fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635409.380109:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f59f798e/0xb0c3a59caa40f6fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635409.380119:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f59f798e/0xb0c3a59caa40f6fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635409.380127:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f59f798e/0xb0c3a59caa40f6fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635409.380135:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e153600 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:1.0:1789635409.380139:0:8431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f59f798e/0xb0c3a59caa40f6fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635409.380146:0:13189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b407450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:2396:x1876568411532160:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 886us (1292us total) trans 0 rc 0/0 00010000:00010000:1.0:1789635409.380153:0:8431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f59f798e/0xb0c3a59caa40f6fa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635409.380160:0:13189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 68 00010000:00010000:1.0:1789635409.380175:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f59f798e/0xb0c3a59caa40f6fa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635409.380183:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f59f798e/0xb0c3a59caa40f6fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635409.380238:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0558848e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:2396:x1876568411531904:12345-192.168.203.20@tcp:1:lfs.0 Request processed in 45035us (45191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635409.380246:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 44 00000100:00100000:3.0:1789635409.386752:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635409.386877:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411532416 00000100:00100000:2.0:1789635409.386888:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411532416 00000100:00100000:2.0:1789635409.386947:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 26 00000100:00100000:2.0:1789635409.386958:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b744850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+42:11361:x1876568411532416:12345-192.168.203.20@tcp:35:lfs.0 00000004:00010000:2.0:1789635409.387023:0:6518:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a000/0xb0c3a59caa40f6ec lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74110 expref: 42 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789635409.387214:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1789635409.387244:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1789635409.387717:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1789635409.387757:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f701 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635409.387771:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f6a6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740ed expref: 46 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635409.387780:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f701 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635409.387815:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f6a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740ed expref: 46 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635409.387830:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f6a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740ed expref: 46 pid: 6516 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635409.387844:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0558848000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6518:1876568427345408:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789635409.387919:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549c0f000 going to sleep for 11 seconds 00000100:00100000:2.0:1789635409.397954:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0558848000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6518:1876568427345408:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789635409.397984:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f701 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635409.400437:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635409.400545:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411532544 00000100:00100000:0.0:1789635409.400578:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411532544 00010000:00010000:0.0:1789635409.400659:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f6a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740ed expref: 47 pid: 6516 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635409.400699:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 69 00000100:00100000:0.0:1789635409.400709:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448599880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+47:2396:x1876568411532544:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789635409.400724:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635409.400731:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f6a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740ed expref: 47 pid: 6516 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.400745:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f6a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740ed expref: 47 pid: 6516 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.400767:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f6a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740ed expref: 47 pid: 6516 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.400784:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d0544e2e300) 00010000:00010000:0.0:1789635409.400790:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f701 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.400799:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f701 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.400806:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f701 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.400839:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635409.400886:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448599880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+46:2396:x1876568411532544:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 178us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635409.400903:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 69 00010000:00010000:2.0:1789635409.401133:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f701 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635409.401143:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f701 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789635409.401247:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:2.0:1789635409.401347:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1789635409.401488:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0558848000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6518:1876568427345536:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789635409.402540:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635409.402586:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d054604a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635409.407830:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427345536 00000100:00100000:0.0:1789635409.407844:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427345536 00000100:00100000:0.0:1789635409.407920:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789635409.407930:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0558849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6518:x1876568427345536:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789635409.408058:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0558849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6518:x1876568427345536:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 129us (5520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635409.408065:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00080000:1.0:1789635409.411954:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789635409.412425:0:6518:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:2.0:1789635409.412433:0:6518:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:2.0:1789635409.412468:0:6518:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d0541218e00, transno 4294967302 00000100:00100000:2.0:1789635409.412494:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0558848000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6518:1876568427345536:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789635409.412684:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1789635409.412759:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0558848000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6518:1876568427345664:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789635409.412816:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635409.412856:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446ce03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635409.412936:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427345664 00000100:00100000:1.0:1789635409.412944:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427345664 00000100:00100000:1.0:1789635409.412993:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789635409.413003:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d055884b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6518:x1876568427345664:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789635409.413153:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d055884b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6518:x1876568427345664:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 151us (336us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789635409.413159:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789635409.414272:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0558848000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6518:1876568427345664:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789635409.414334:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:2.0:1789635409.414375:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f701 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635409.414395:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f701 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635409.414403:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f701 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635409.414410:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540030a00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635409.414415:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f701 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635409.414439:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f701 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635409.414456:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d0544e2e300) 00010000:00010000:2.0:1789635409.414459:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789635409.414463:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f701 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635409.414469:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f701 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789635409.414572:0:6518:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789635409.414660:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1789635409.414670:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 428098073605ns, next at 429098071412ns, rc = 0 00000001:00080000:2.0:1789635409.414677:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:2.0:1789635409.414699:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d0544e2e300) 00010000:00010000:2.0:1789635409.414702:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789635409.414708:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a000/0xb0c3a59caa40f6ec lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74110 expref: 50 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635409.414813:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b744850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+49:11361:x1876568411532416:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 27856us (28069us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1789635409.414821:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 26 00000020:00080000:2.0:1789635409.414826:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789635409.436297:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635409.436400:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411532672 00000100:00100000:1.0:1789635409.436409:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411532672 00000100:00100000:1.0:1789635409.436468:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 111 00000100:00100000:1.0:1789635409.436478:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+49:11361:x1876568411532672:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789635409.436503:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635409.436524:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153e00/0xb0c3a59caa40f708 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74117 expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635409.436591:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153e00/0xb0c3a59caa40f708 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74117 expref: 50 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635409.436641:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153e00/0xb0c3a59caa40f708 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74117 expref: 50 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635409.436658:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d04466cab00) 00010000:00010000:1.0:1789635409.436661:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789635409.436665:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e153e00, rc 0) 00000100:00100000:1.0:1789635409.436716:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+50:11361:x1876568411532672:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 239us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635409.436723:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 111 00000100:00100000:3.0:1789635409.452035:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635409.452134:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411532928 00000100:00100000:0.0:1789635409.452145:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411532928 00000100:00100000:0.0:1789635409.452206:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:0.0:1789635409.452216:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+50:11361:x1876568411532928:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:0.0:1789635409.452449:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+51:11361:x1876568411532928:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 235us (424us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1789635409.452456:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:2.0:1789635409.663649:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635409.664025:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411533056 00000100:00100000:3.0:1789635409.664036:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411533056 00000100:00100000:3.0:1789635409.664168:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 112 00000100:00100000:3.0:1789635409.664178:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0558849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+51:11371:x1876568411533056:12345-192.168.203.20@tcp:34:lfs.0 00010000:00010000:3.0:1789635409.664257:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f70f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.664274:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f70f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.664284:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f70f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.664309:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fee00/0xb0c3a59caa40f716 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.664317:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fee00/0xb0c3a59caa40f716 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.664325:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fee00/0xb0c3a59caa40f716 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.664462:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe600/0xb0c3a59caa40f71d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.664471:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe600/0xb0c3a59caa40f71d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.664478:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe600/0xb0c3a59caa40f71d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789635409.664522:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe600/0xb0c3a59caa40f71d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.664534:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f70f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.664540:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f70f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.664556:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f70f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.664562:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488fe200 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635409.664566:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f70f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.664581:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f70f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.664624:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d0558d1c900) 00010000:00010000:3.0:1789635409.664628:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635409.664634:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f70f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.664641:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f70f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.664656:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fee00/0xb0c3a59caa40f716 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.664663:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fee00/0xb0c3a59caa40f716 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.664668:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fee00/0xb0c3a59caa40f716 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.664674:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488fee00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635409.664676:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fee00/0xb0c3a59caa40f716 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.664693:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fee00/0xb0c3a59caa40f716 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.664701:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d044764bc00) 00010000:00010000:3.0:1789635409.664703:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635409.664706:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fee00/0xb0c3a59caa40f716 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.664720:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fee00/0xb0c3a59caa40f716 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.664730:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe600/0xb0c3a59caa40f71d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.664735:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe600/0xb0c3a59caa40f71d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.664740:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe600/0xb0c3a59caa40f71d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.664745:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488fe600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635409.664748:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe600/0xb0c3a59caa40f71d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.664754:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe600/0xb0c3a59caa40f71d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.664761:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d04466cab00) 00010000:00010000:3.0:1789635409.664763:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635409.664766:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe600/0xb0c3a59caa40f71d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.664771:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe600/0xb0c3a59caa40f71d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635409.666227:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0558849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+51:11371:x1876568411533056:12345-192.168.203.20@tcp:34:lfs.0 Request processed in 2041us (2577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635409.666240:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 112 00000100:00100000:3.0:1789635409.778384:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635409.779700:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411533312 00000100:00100000:0.0:1789635409.779713:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411533312 00000100:00100000:0.0:1789635409.779781:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 113 00000100:00100000:0.0:1789635409.779791:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+51:11374:x1876568411533312:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1789635409.779811:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635409.779832:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40f724 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7411e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.779898:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f72b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.779922:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f72b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.779931:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f72b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.779939:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f732 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.779943:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f732 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.779947:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f732 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.780047:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f739 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.780053:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f739 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.780057:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f739 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635409.780063:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789635409.780121:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f72b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.780126:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f72b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.780130:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f72b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.780139:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1a600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635409.780142:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f72b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.780147:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f72b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.780156:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d0558d1c900) 00010000:00010000:0.0:1789635409.780158:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635409.780160:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f72b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.780164:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f72b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.780173:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f732 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.780176:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f732 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.780180:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f732 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.780183:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1b000 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635409.780184:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f732 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.780187:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f732 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.780197:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d044764bc00) 00010000:00010000:0.0:1789635409.780199:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635409.780201:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f732 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.780205:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f732 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.780229:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40f724 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7411e expref: 54 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.780237:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f739 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7411e expref: 53 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635409.780242:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d04466cab00) 00010000:00010000:0.0:1789635409.780243:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789635409.780246:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1bc00, rc 0) 00000100:00100000:0.0:1789635409.780310:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+53:11374:x1876568411533312:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 521us (1934us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1789635409.780317:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 113 00000100:00100000:0.0:1789635409.792875:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635409.795878:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411533440 00000100:00100000:3.0:1789635409.795893:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411533440 00000100:00100000:3.0:1789635409.795979:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 114 00000100:00100000:3.0:1789635409.795991:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+53:11374:x1876568411533440:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:3.0:1789635409.796055:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe600/0xb0c3a59caa40f747 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.796071:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe600/0xb0c3a59caa40f747 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.796092:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe600/0xb0c3a59caa40f747 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.796124:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe600/0xb0c3a59caa40f747 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.796130:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe600/0xb0c3a59caa40f747 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.796136:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe600/0xb0c3a59caa40f747 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.796142:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488fe600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635409.796146:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe600/0xb0c3a59caa40f747 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.796152:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe600/0xb0c3a59caa40f747 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.796162:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d04466cab00) 00010000:00010000:3.0:1789635409.796165:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789635409.796182:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe600/0xb0c3a59caa40f747 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.796187:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe600/0xb0c3a59caa40f747 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635409.796527:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+53:11374:x1876568411533440:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 537us (3656us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635409.796534:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 114 00000100:00100000:2.0:1789635409.816754:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635409.824927:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411533696 00000100:00100000:0.0:1789635409.824941:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411533696 00000100:00100000:1.0:1789635409.825222:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:1.0:1789635409.825233:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d055884aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+53:11374:x1876568411533696:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:1.0:1789635409.825486:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d055884aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+54:11374:x1876568411533696:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 254us (8739us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1789635409.825494:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:2.0:1789635409.974038:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635409.974991:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411533952 00000100:00100000:3.0:1789635409.975002:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411533952 00000100:00100000:3.0:1789635409.975072:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 115 00000100:00100000:3.0:1789635409.975092:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d055884ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+54:11384:x1876568411533952:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:3.0:1789635409.975115:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635409.975118:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789635409.975257:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f6c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74102 expref: 54 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.975278:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d0558d1c900) 00010000:00010000:3.0:1789635409.975282:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789635409.975295:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe600/0xb0c3a59caa40f74e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74125 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.975396:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fee00/0xb0c3a59caa40f755 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.975409:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fee00/0xb0c3a59caa40f755 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.975420:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fee00/0xb0c3a59caa40f755 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635409.975445:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789635409.975560:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe600/0xb0c3a59caa40f74e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74125 expref: 56 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.975574:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fee00/0xb0c3a59caa40f755 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74125 expref: 55 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635409.975581:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d04466cab00) 00010000:00010000:3.0:1789635409.975584:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789635409.975586:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05488fee00, rc 0) 00000100:00100000:2.0:1789635409.978540:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d055884ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+55:11384:x1876568411533952:12345-192.168.203.20@tcp:101:bash.0 Request processed in 3447us (4498us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1789635409.978574:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 115 00000100:00100000:0.0:1789635409.992355:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635409.992990:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411534080 00000100:00100000:1.0:1789635409.993000:0:7457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411534080 00000100:00100000:1.0:1789635409.993071:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:1.0:1789635409.993091:0:7457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+55:2398:x1876568411534080:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635409.993106:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635409.993141:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fee00/0xb0c3a59caa40f755 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74125 expref: 55 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635409.993162:0:7457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d04466cab00) 00010000:00010000:1.0:1789635409.993167:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635409.993228:0:7457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+54:2398:x1876568411534080:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 148us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635409.993236:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:1.0:1789635410.006512:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635410.006647:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411534208 00000100:00100000:0.0:1789635410.006657:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411534208 00000100:00100000:0.0:1789635410.006707:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 116 00000100:00100000:0.0:1789635410.006717:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+54:11384:x1876568411534208:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:0.0:1789635410.006760:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635410.006779:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f763 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7412c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.006811:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f76a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.006824:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f76a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.006836:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f76a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.006941:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f763 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7412c expref: 56 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.006960:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f76a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7412c expref: 55 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.006969:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d04466cab00) 00010000:00010000:0.0:1789635410.006971:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789635410.006975:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1a600, rc 0) 00000100:00100000:0.0:1789635410.007039:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+55:11384:x1876568411534208:12345-192.168.203.20@tcp:101:bash.0 Request processed in 323us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635410.007045:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 116 00000100:00100000:3.0:1789635410.022891:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635410.025735:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411534464 00000100:00100000:0.0:1789635410.025749:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411534464 00000100:00100000:0.0:1789635410.025876:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 117 00000100:00100000:0.0:1789635410.025887:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+55:11384:x1876568411534464:12345-192.168.203.20@tcp:36:bash.0 00010000:00010000:0.0:1789635410.025967:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635410.025992:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f739 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7411e expref: 55 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.026014:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d04466cab00) 00010000:00010000:0.0:1789635410.026019:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789635410.026471:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f771 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.026487:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f771 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.026497:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f771 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789635410.026537:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:0.0:1789635410.026575:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004ff0bfc7 reply state 00000000db1b2b0f transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f771 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.026587:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f771 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.026594:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d04466cab00) 00010000:00010000:0.0:1789635410.026864:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789635410.026868:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789635410.026968:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+57:11384:x1876568411534464:12345-192.168.203.20@tcp:36:bash.0 Request processed in 1082us (4084us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1789635410.026976:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 117 00000020:00080000:0.0:1789635410.026982:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789635410.031959:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635410.032054:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411534592 00000100:00100000:2.0:1789635410.032064:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411534592 00000100:00100000:2.0:1789635410.032241:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 118 00000100:00100000:2.0:1789635410.032254:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+57:11384:x1876568411534592:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1789635410.032280:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635410.032300:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f778 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74133 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.032386:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f77f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.032401:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f77f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.032412:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f77f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635410.032441:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789635410.032445:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789635410.032463:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f77f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.032487:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f778 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74133 expref: 59 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.032504:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f77f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74133 expref: 58 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.032526:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d04466cab00) 00010000:00010000:2.0:1789635410.032529:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789635410.032532:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0540030c00, rc 0) 00000100:00100000:2.0:1789635410.032748:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+58:11384:x1876568411534592:12345-192.168.203.20@tcp:101:bash.0 Request processed in 496us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635410.032755:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 118 00000100:00100000:3.0:1789635410.036397:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635410.036589:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411534848 00000100:00100000:0.0:1789635410.036816:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411534848 00000100:00100000:2.0:1789635410.036930:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:2.0:1789635410.036940:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+58:11384:x1876568411534848:12345-192.168.203.20@tcp:35:bash.0 00000100:00100000:2.0:1789635410.037332:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+59:11384:x1876568411534848:12345-192.168.203.20@tcp:35:bash.0 Request processed in 393us (943us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1789635410.037339:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 29 00010000:00010000:2.0:1789635410.084369:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789635410.150814:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789635410.164123:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635410.164214:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411534976 00000100:00100000:1.0:1789635410.164225:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411534976 00000100:00100000:1.0:1789635410.164282:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 119 00000100:00100000:1.0:1789635410.164293:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0558848a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+59:11390:x1876568411534976:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789635410.164314:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635410.164333:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40f786 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7413a expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.164425:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40f78d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.164439:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40f78d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.164448:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40f78d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635410.164502:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789635410.164505:0:9526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789635410.164524:0:9526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40f78d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.164556:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40f786 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7413a expref: 61 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.164574:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40f78d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7413a expref: 60 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.164583:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d0558d1c900) 00010000:00010000:1.0:1789635410.164585:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789635410.164589:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e152a00, rc 0) 00000100:00100000:1.0:1789635410.164769:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0558848a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+60:11390:x1876568411534976:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 477us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635410.164777:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 119 00000100:00100000:0.0:1789635410.169867:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635410.170146:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411535104 00000100:00100000:3.0:1789635410.170156:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411535104 00000100:00100000:3.0:1789635410.170269:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 120 00000100:00100000:3.0:1789635410.170281:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+60:11390:x1876568411535104:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789635410.170302:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635410.170323:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe600/0xb0c3a59caa40f794 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74141 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.170399:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f79b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.170414:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f79b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.170426:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f79b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.170457:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f7a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.170466:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f7a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.170473:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f7a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.170550:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe800/0xb0c3a59caa40f7a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.170560:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe800/0xb0c3a59caa40f7a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.170567:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe800/0xb0c3a59caa40f7a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635410.170649:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789635410.170653:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789635410.170670:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe800/0xb0c3a59caa40f7a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.172361:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe800/0xb0c3a59caa40f7a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.172385:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f79b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.172392:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f79b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.172421:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f79b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.172427:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488fe400 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635410.172431:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f79b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.172438:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f79b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.172453:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d0558d1c900) 00010000:00010000:3.0:1789635410.172456:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635410.172460:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f79b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.172466:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f79b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.172483:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f7a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.172488:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f7a2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.172493:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f7a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.172498:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488fe200 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635410.172500:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f7a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.172517:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f7a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.172525:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d044764bc00) 00010000:00010000:3.0:1789635410.172528:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635410.172530:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f7a2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.172535:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe200/0xb0c3a59caa40f7a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.172583:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe600/0xb0c3a59caa40f794 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74141 expref: 62 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.172643:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe800/0xb0c3a59caa40f7a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74141 expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.172650:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d04466cab00) 00010000:00010000:3.0:1789635410.172652:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789635410.172655:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05488fe800, rc 0) 00000100:00100000:3.0:1789635410.174844:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+61:11390:x1876568411535104:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 4555us (4977us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635410.174855:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 120 00000100:00100000:2.0:1789635410.187335:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635410.187461:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411535360 00000100:00100000:0.0:1789635410.187471:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411535360 00000100:00100000:0.0:1789635410.187528:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 121 00000100:00100000:0.0:1789635410.187548:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d055884b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+61:11390:x1876568411535360:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1789635410.187566:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635410.187586:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ac00/0xb0c3a59caa40f7b0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74148 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.187745:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f7b7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.187760:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f77f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74133 expref: 62 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.187769:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe800/0xb0c3a59caa40f7a9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74141 expref: 62 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.187777:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f7b7 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.187809:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe800/0xb0c3a59caa40f7a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74141 expref: 62 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.187821:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe800/0xb0c3a59caa40f7a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74141 expref: 62 pid: 6515 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635410.187853:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bfb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6516:1876568427345792:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789635410.188030:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f77f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74133 expref: 62 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.188040:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f77f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74133 expref: 62 pid: 6514 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635410.188048:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bf9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6516:1876568427345920:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789635410.188074:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446df5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789635410.204716:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bfb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6516:1876568427345792:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789635410.204731:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bf9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6516:1876568427345920:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789635410.204756:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f7b7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635410.206664:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635410.207050:0:13189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411535488 00000100:00100000:1.0:1789635410.207060:0:13189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411535488 00010000:00010000:1.0:1789635410.207126:0:13189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe800/0xb0c3a59caa40f7a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74141 expref: 63 pid: 6515 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635410.207164:0:13189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 70 00000100:00100000:1.0:1789635410.207175:0:13189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+63:2399:x1876568411535488:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635410.207189:0:13189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635410.207196:0:13189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe800/0xb0c3a59caa40f7a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74141 expref: 63 pid: 6515 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.207208:0:13189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe800/0xb0c3a59caa40f7a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74141 expref: 63 pid: 6515 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.207230:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe800/0xb0c3a59caa40f7a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74141 expref: 63 pid: 6515 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.207247:0:13189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d04466cab00) 00010000:00010000:1.0:1789635410.207253:0:13189:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f7b7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.207261:0:13189:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f7b7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.207268:0:13189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635410.207416:0:13189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+62:2399:x1876568411535488:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 243us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635410.207424:0:13189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 70 00000100:00100000:0.0:1789635410.213445:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635410.215657:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411535616 00000100:00100000:3.0:1789635410.215672:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411535616 00010000:00010000:3.0:1789635410.215910:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f77f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74133 expref: 62 pid: 6514 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635410.215982:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 71 00000100:00100000:3.0:1789635410.215992:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+62:2397:x1876568411535616:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635410.216007:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635410.216013:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f77f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74133 expref: 62 pid: 6514 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.216025:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f77f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74133 expref: 62 pid: 6514 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.216046:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f77f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74133 expref: 62 pid: 6514 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.216063:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d04466cab00) 00010000:00010000:3.0:1789635410.216068:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f7b7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.216078:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f7b7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.216086:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f7b7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.216117:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635410.216181:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+61:2397:x1876568411535616:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 190us (2746us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635410.216189:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 71 00010000:00010000:0.0:1789635410.217054:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f7b7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.217065:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f7b7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635410.217083:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789635410.217192:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ac00/0xb0c3a59caa40f7b0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74148 expref: 62 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.217226:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f7b7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74148 expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.217233:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d04466cab00) 00010000:00010000:0.0:1789635410.217236:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789635410.217238:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1b400, rc 0) 00000100:00100000:0.0:1789635410.217275:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d055884b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+61:11390:x1876568411535360:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 29739us (29951us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1789635410.217282:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 121 00000100:00100000:0.0:1789635410.224204:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635410.224281:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411535872 00000100:00100000:2.0:1789635410.224291:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411535872 00000100:00100000:2.0:1789635410.224357:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:2.0:1789635410.224367:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+61:11390:x1876568411535872:12345-192.168.203.20@tcp:103:lfs.0 00010000:00010000:2.0:1789635410.224382:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635410.224405:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153e00/0xb0c3a59caa40f708 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74117 expref: 61 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.224423:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d04466cab00) 00010000:00010000:2.0:1789635410.224428:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635410.224562:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+60:11390:x1876568411535872:12345-192.168.203.20@tcp:103:lfs.0 Request processed in 196us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635410.224570:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:3.0:1789635410.228314:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635410.228414:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411536000 00000100:00100000:0.0:1789635410.228424:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411536000 00000100:00100000:0.0:1789635410.228486:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 122 00000100:00100000:0.0:1789635410.228495:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+60:11390:x1876568411536000:12345-192.168.203.20@tcp:58:lfs.0 00010000:00010000:0.0:1789635410.228644:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f7c5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.228661:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f7c5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.228672:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f7c5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789635410.229015:0:10094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1789635410.229101:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+60:11390:x1876568411536000:12345-192.168.203.20@tcp:58:lfs.0 Request processed in 606us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635410.229109:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 122 00000100:00100000:3.0:1789635410.232972:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635410.233207:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411536128 00000100:00100000:0.0:1789635410.233217:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411536128 00000100:00100000:0.0:1789635410.233279:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 123 00000100:00100000:0.0:1789635410.233289:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+60:11390:x1876568411536128:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1789635410.233310:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635410.233329:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ac00/0xb0c3a59caa40f7cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7414f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.233388:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f7c5 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.233400:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ac00/0xb0c3a59caa40f7cc lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7414f expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.233419:0:6515:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f7c5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.233431:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ac00/0xb0c3a59caa40f7cc lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7414f expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.233443:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d04466cab00) 00010000:00010000:0.0:1789635410.233446:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789635410.233450:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ac00/0xb0c3a59caa40f7cc lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7414f expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.233457:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1ac00, rc 0) 00000100:00100000:0.0:1789635410.233519:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+61:11390:x1876568411536128:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 232us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635410.233525:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 123 00000100:00100000:3.0:1789635410.342129:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427346176:0@lo:400:kworker.0 00000100:00100000:3.0:1789635410.342202:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635410.342241:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427346688:0@lo:400:kworker.0 00000100:00100000:3.0:1789635410.342268:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635410.342285:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427347200:0@lo:400:kworker.0 00000100:00100000:3.0:1789635410.342309:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635410.342326:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427347712:0@lo:400:kworker.0 00000100:00100000:3.0:1789635410.342345:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635410.342364:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789635410.342370:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427346304:0@lo:400:kworker.0 00000100:00100000:3.0:1789635410.342388:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635410.342401:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427346816:0@lo:400:kworker.0 00000100:00100000:3.0:1789635410.342418:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635410.342431:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427347328:0@lo:400:kworker.0 00000100:00100000:3.0:1789635410.342447:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635410.342476:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427346176 00000100:00100000:3.0:1789635410.342483:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427346176 00000100:00100000:3.0:1789635410.342525:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1789635410.342534:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3640:x1876568427346176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635410.342615:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3640:x1876568427346176:12345-0@lo:400:kworker.0 Request processed in 60us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635410.342623:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1789635410.342992:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427346048:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789635410.343024:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635410.343043:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427346560:0@lo:400:kworker.0 00000100:00100000:0.0:1789635410.343063:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635410.343076:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427347072:0@lo:400:kworker.0 00000100:00100000:0.0:1789635410.343094:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635410.343110:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550661500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427347584:0@lo:400:kworker.0 00000100:00100000:0.0:1789635410.343126:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635410.343142:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789635410.343148:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427346432:0@lo:400:kworker.0 00000100:00100000:0.0:1789635410.343168:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635410.343184:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427346944:0@lo:400:kworker.0 00000100:00100000:0.0:1789635410.343204:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635410.343217:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1876568427347456:0@lo:400:kworker.0 00000100:00100000:0.0:1789635410.343236:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635410.343260:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427346048 00000100:00100000:0.0:1789635410.343264:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427346048 00000100:00100000:0.0:1789635410.343298:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789635410.343307:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427346048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789635410.343331:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635410.343366:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427346048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635410.343373:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789635410.343420:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427346048:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789635410.343446:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427346688 00000100:00100000:0.0:1789635410.343459:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427346688 00000100:00100000:0.0:1789635410.343480:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427346304 00000100:00100000:0.0:1789635410.343482:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427346304 00000100:00100000:0.0:1789635410.343493:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427346816 00000100:00100000:0.0:1789635410.343494:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427346816 00000100:00100000:0.0:1789635410.343505:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427347328 00000100:00100000:0.0:1789635410.343508:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427347328 00000100:00100000:0.0:1789635410.343523:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427346944 00000100:00100000:0.0:1789635410.343525:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427346944 00000100:00100000:0.0:1789635410.343537:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427347456 00000100:00100000:0.0:1789635410.343550:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427347456 00000100:00100000:0.0:1789635410.343566:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1789635410.343572:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427346688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635410.343645:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427346688:12345-0@lo:400:kworker.0 Request processed in 63us (1366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635410.343652:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1789635410.343666:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1789635410.343672:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427346304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635410.343700:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427346304:12345-0@lo:400:kworker.0 Request processed in 29us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635410.343705:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1789635410.343717:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1789635410.343724:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427346816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635410.343751:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427346816:12345-0@lo:400:kworker.0 Request processed in 28us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635410.343757:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1789635410.343768:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1789635410.343773:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427347328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635410.343807:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427347328:12345-0@lo:400:kworker.0 Request processed in 34us (1359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635410.343813:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1789635410.343823:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1789635410.343829:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876568427346944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635410.343856:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876568427346944:12345-0@lo:400:kworker.0 Request processed in 28us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635410.343862:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1789635410.343873:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1789635410.343878:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876568427347456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635410.343902:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876568427347456:12345-0@lo:400:kworker.0 Request processed in 24us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635410.343907:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00010000:00080000:0.0:1789635410.343933:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0543291880 x1876568427346944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635410.343944:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427346944:0@lo:400:kworker.0 00010000:00080000:0.0:1789635410.343954:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d05759c9180 x1876568427347456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635410.343961:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1876568427347456:0@lo:400:kworker.0 00000100:00100000:0.0:1789635410.344020:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427347200 00000100:00100000:0.0:1789635410.344024:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427347200 00000100:00100000:0.0:1789635410.344045:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427347712 00000100:00100000:0.0:1789635410.344048:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427347712 00000100:00100000:0.0:1789635410.344060:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427347072 00000100:00100000:0.0:1789635410.344063:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427347072 00000100:00100000:0.0:1789635410.344086:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427347584 00000100:00100000:0.0:1789635410.344089:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427347584 00000100:00100000:0.0:1789635410.344102:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789635410.344109:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550663800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1876568427347200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635410.344139:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550663800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1876568427347200:12345-0@lo:400:kworker.0 Request processed in 31us (1829us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635410.344144:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789635410.344157:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789635410.344162:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550660e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1876568427347712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635410.344188:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550660e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1876568427347712:12345-0@lo:400:kworker.0 Request processed in 27us (1843us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635410.344194:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789635410.344206:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789635410.344212:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427347072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635410.344257:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427347072:12345-0@lo:400:kworker.0 Request processed in 45us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635410.344263:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789635410.344274:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789635410.344281:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427347584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635410.344305:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427347584:12345-0@lo:400:kworker.0 Request processed in 26us (1178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635410.344311:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789635410.344334:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427347072:0@lo:400:kworker.0 00000100:00100000:0.0:1789635410.344343:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550661500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427347584:0@lo:400:kworker.0 00000100:00100000:0.0:1789635410.344387:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427346304:0@lo:400:kworker.0 00000100:00100000:0.0:1789635410.344405:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427346816:0@lo:400:kworker.0 00000100:00100000:0.0:1789635410.344413:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427347328:0@lo:400:kworker.0 00000100:00100000:0.0:1789635410.344421:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427346176:0@lo:400:kworker.0 00000100:00100000:0.0:1789635410.344429:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427346688:0@lo:400:kworker.0 00000100:00100000:0.0:1789635410.344438:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427347200:0@lo:400:kworker.0 00000100:00100000:0.0:1789635410.344446:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427347712:0@lo:400:kworker.0 00000100:00100000:0.0:1789635410.344484:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427346560 00000100:00100000:0.0:1789635410.344488:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427346560 00000100:00100000:0.0:1789635410.344508:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427346432 00000100:00100000:0.0:1789635410.344511:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427346432 00000100:00100000:0.0:1789635410.344523:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789635410.344529:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427346560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635410.344579:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427346560:12345-0@lo:400:kworker.0 Request processed in 50us (1514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635410.344585:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789635410.344614:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789635410.344621:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427346432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635410.344647:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427346432:12345-0@lo:400:kworker.0 Request processed in 27us (1477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635410.344652:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789635410.344673:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427346432:0@lo:400:kworker.0 00000100:00100000:0.0:1789635410.344681:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427346560:0@lo:400:kworker.0 00000004:00080000:1.0:1789635410.345083:0:9895:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 429028485755ns, next at 430028483369ns, rc = 0 00000100:00080000:1.0:1789635410.345105:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789635410.345117:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789635410.345119:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789635410.345121:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789635410.346940:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427347840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789635410.347008:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635410.347150:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427347840 00000100:00100000:2.0:1789635410.347158:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427347840 00000100:00100000:2.0:1789635410.347210:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789635410.347219:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550661f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1876568427347840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789635410.347242:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635410.347298:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550661f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1876568427347840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635410.347306:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789635410.347526:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427347840:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1789635410.531903:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789635410.531912:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789635410.531950:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1789635410.531960:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789635410.532105:0:13797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0558849c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1876568427347968:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789635410.532207:0:13797:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446ce09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635410.539507:0:13797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0558849c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1876568427347968:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789635410.552524:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635410.552647:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411536256 00000100:00100000:0.0:1789635410.552659:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411536256 00000100:00100000:0.0:1789635410.552735:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 124 00000100:00100000:0.0:1789635410.552758:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0558849c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+61:11393:x1876568411536256:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789635410.552795:0:6515:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789635410.552921:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0558849c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+61:11393:x1876568411536256:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 165us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635410.552929:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 124 00000100:00100000:3.0:1789635410.557942:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635410.560969:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411536384 00000100:00100000:0.0:1789635410.560985:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411536384 00000100:00100000:0.0:1789635410.561066:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 125 00000100:00100000:0.0:1789635410.561077:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+61:11393:x1876568411536384:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789635410.561161:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40f7d3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.561178:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40f7d3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.561191:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40f7d3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.561209:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f7da lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.561216:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f7da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.561222:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f7da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.561263:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a000/0xb0c3a59caa40f7e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.561272:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a000/0xb0c3a59caa40f7e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.561279:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a000/0xb0c3a59caa40f7e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635410.561337:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789635410.561342:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789635410.561355:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a000/0xb0c3a59caa40f7e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.561365:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40f7d3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.561371:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40f7d3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.561377:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40f7d3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.561723:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1ba00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635410.561728:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40f7d3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.561737:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40f7d3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.561749:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d044766d300) 00010000:00010000:0.0:1789635410.561758:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635410.561764:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40f7d3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.561770:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40f7d3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.562006:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f7da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.562012:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f7da lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.562018:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f7da lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.562023:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1a200 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635410.562026:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f7da lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.562031:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f7da lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.562039:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff8d0447667600) 00010000:00010000:0.0:1789635410.562042:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635410.562045:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f7da lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.562050:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f7da lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.562065:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a000/0xb0c3a59caa40f7e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.562076:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a000/0xb0c3a59caa40f7e1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.562082:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a000/0xb0c3a59caa40f7e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.562087:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1a000 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635410.562091:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a000/0xb0c3a59caa40f7e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.562096:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a000/0xb0c3a59caa40f7e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.562104:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d04466cab00) 00010000:00010000:0.0:1789635410.562106:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635410.562109:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a000/0xb0c3a59caa40f7e1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.562114:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a000/0xb0c3a59caa40f7e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635410.562708:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+61:11393:x1876568411536384:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 Request processed in 1627us (4769us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635410.562717:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 125 00000100:00100000:1.0:1789635410.579877:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635410.580531:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411536640 00000100:00100000:2.0:1789635410.580552:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411536640 00000100:00100000:2.0:1789635410.580875:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 126 00000100:00100000:2.0:1789635410.580886:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+61:11393:x1876568411536640:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789635410.580924:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635410.580944:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f7e8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74156 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.581095:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f7ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.581111:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f7ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.581129:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f7ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635410.581145:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789635410.581237:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f7ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.581246:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f7ef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.581271:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f7ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.581276:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540031c00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635410.581280:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f7ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.581287:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f7ef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.581794:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d04466cab00) 00010000:00010000:2.0:1789635410.581798:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789635410.581805:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f7ef lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.581823:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f7ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.581869:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f7e8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74156 expref: 63 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.581880:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d044766d300) 00010000:00010000:2.0:1789635410.581882:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789635410.581886:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f7e8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74156 expref: 63 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.581897:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0540030200, rc 0) 00000100:00100000:2.0:1789635410.582027:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+62:11393:x1876568411536640:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 1143us (2165us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1789635410.582035:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 126 00000100:00100000:3.0:1789635410.603194:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635410.603409:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411536768 00000100:00100000:2.0:1789635410.603420:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411536768 00000100:00100000:2.0:1789635410.603479:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 127 00000100:00100000:2.0:1789635410.603489:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+62:11393:x1876568411536768:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789635410.603524:0:10094:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789635410.603848:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+62:11393:x1876568411536768:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 359us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635410.603856:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 127 00000100:00100000:3.0:1789635410.609713:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635410.609952:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411537024 00000100:00100000:0.0:1789635410.609963:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411537024 00000100:00100000:0.0:1789635410.610030:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 128 00000100:00100000:0.0:1789635410.610041:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+62:11393:x1876568411537024:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789635410.610060:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635410.610077:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789635410.610102:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40f78d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7413a expref: 62 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.610130:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d0558d1c900) 00010000:00010000:0.0:1789635410.610135:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789635410.610148:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a000/0xb0c3a59caa40f7fd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7415d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789635410.610498:0:6516:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1789635410.612403:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f804 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.612422:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f804 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.612434:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f804 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.612494:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a000/0xb0c3a59caa40f7fd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7415d expref: 64 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.612512:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f804 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7415d expref: 63 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.612521:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d0447667600) 00010000:00010000:0.0:1789635410.612524:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789635410.612527:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1a200, rc 0) 00000100:00100000:0.0:1789635410.612714:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+63:11393:x1876568411537024:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 2672us (3121us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1789635410.612739:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 128 00000100:00100000:1.0:1789635410.627206:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635410.627409:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411537280 00000100:00100000:2.0:1789635410.627420:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411537280 00000100:00100000:2.0:1789635410.627485:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 129 00000100:00100000:2.0:1789635410.627511:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+63:11393:x1876568411537280:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789635410.627583:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635410.627665:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f804 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7415d expref: 63 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.627696:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d0447667600) 00010000:00010000:2.0:1789635410.627707:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789635410.627728:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f812 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.627742:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f812 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.627753:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f812 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.627767:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f819 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x305ab2d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.627775:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f819 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x305ab2d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.627781:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f819 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x305ab2d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.627825:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f812 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.627838:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f812 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.627855:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f812 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.627861:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540030200 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635410.627865:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f812 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.627873:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f812 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.627882:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d0558d1c900) 00010000:00010000:2.0:1789635410.627885:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635410.627889:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f812 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.627896:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f812 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.627907:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f819 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x305ab2d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.627914:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f819 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x305ab2d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.627920:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f819 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x305ab2d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.627925:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540031c00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635410.627928:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f819 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x305ab2d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.627945:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f819 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x305ab2d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.627953:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x305ab2d2 (ffff8d0544e2e300) 00010000:00010000:2.0:1789635410.627956:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635410.627959:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f819 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x305ab2d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.627964:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f819 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x305ab2d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635410.628046:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+62:11393:x1876568411537280:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 537us (855us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789635410.628054:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 129 00000100:00100000:3.0:1789635410.632439:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635410.632639:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411537408 00000100:00100000:2.0:1789635410.632647:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411537408 00000100:00100000:2.0:1789635410.632700:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 130 00000100:00100000:2.0:1789635410.632707:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+62:11393:x1876568411537408:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789635410.632725:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635410.632742:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f820 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74164 expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.632771:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f827 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.632781:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f827 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.632789:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f827 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.632886:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f820 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74164 expref: 64 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.632901:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f827 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74164 expref: 63 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.632908:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d0544e2ec00) 00010000:00010000:2.0:1789635410.632911:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789635410.632913:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0540031400, rc 0) 00000100:00100000:2.0:1789635410.632964:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+63:11393:x1876568411537408:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 258us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635410.632969:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 130 00000100:00100000:0.0:1789635410.637252:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635410.637460:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411537664 00000100:00100000:2.0:1789635410.637470:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411537664 00000100:00100000:2.0:1789635410.637831:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 131 00000100:00100000:2.0:1789635410.637839:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+63:11393:x1876568411537664:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789635410.637916:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f82e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.637932:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f82e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.637942:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f82e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789635410.638088:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:2.0:1789635410.638256:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f5a38ed reply state 00000000b75c9474 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f82e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.638281:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f82e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.638289:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d0544e2ec00) 00010000:00010000:2.0:1789635410.638292:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789635410.638295:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789635410.638429:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+65:11393:x1876568411537664:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 589us (1185us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1789635410.638437:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 131 00000100:00100000:1.0:1789635410.641261:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635410.641310:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411537792 00000100:00100000:3.0:1789635410.641319:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411537792 00000100:00100000:3.0:1789635410.641364:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 132 00000100:00100000:3.0:1789635410.641375:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+65:11393:x1876568411537792:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789635410.641397:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635410.641414:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe600/0xb0c3a59caa40f835 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7416b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.641457:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe600/0xb0c3a59caa40f835 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7416b expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.641466:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe600/0xb0c3a59caa40f835 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7416b expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.641478:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d0544e2ec00) 00010000:00010000:3.0:1789635410.641480:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789635410.641483:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05488fe600, rc 0) 00000100:00100000:3.0:1789635410.641544:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+66:11393:x1876568411537792:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 163us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635410.641551:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 132 00000100:00100000:3.0:1789635410.654255:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635410.655576:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411537920 00000100:00100000:0.0:1789635410.655588:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411537920 00000100:00100000:0.0:1789635410.655734:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 45 00000100:00100000:0.0:1789635410.655745:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:2397:x1876568411537920:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789635410.655955:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+9:2397:x1876568411537920:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 212us (1709us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789635410.655963:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 45 00000100:00080000:1.0:1789635410.659527:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789635410.660665:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635410.660782:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411538176 00000100:00100000:1.0:1789635410.660792:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411538176 00000100:00100000:1.0:1789635410.660859:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:1.0:1789635410.660870:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+66:11393:x1876568411538176:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789635410.663416:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+67:11393:x1876568411538176:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 238us (448us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1789635410.663433:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:2.0:1789635410.677635:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635410.678189:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411538432 00000100:00100000:0.0:1789635410.678199:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411538432 00000100:00100000:0.0:1789635410.678264:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 133 00000100:00100000:0.0:1789635410.678274:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d055884a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+67:11393:x1876568411538432:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789635410.678386:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d055884a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+67:11393:x1876568411538432:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 114us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635410.678393:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 133 00000100:00100000:0.0:1789635410.684430:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635410.686466:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411538560 00000100:00100000:2.0:1789635410.686491:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411538560 00000100:00100000:2.0:1789635410.686568:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 134 00000100:00100000:2.0:1789635410.686579:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+67:11393:x1876568411538560:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789635410.686613:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635410.686635:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f83c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74172 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.686715:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f843 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.686730:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f843 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.686741:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f843 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635410.686784:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789635410.686818:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f843 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.686844:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f83c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74172 expref: 69 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.688079:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f843 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74172 expref: 68 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.688090:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d0544e2ec00) 00010000:00010000:2.0:1789635410.688093:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789635410.688096:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0540030200, rc 0) 00000100:00100000:2.0:1789635410.688169:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+68:11393:x1876568411538560:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 1590us (3746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635410.688177:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 134 00000100:00100000:3.0:1789635410.695154:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635410.696099:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411538688 00000100:00100000:1.0:1789635410.696120:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411538688 00000100:00100000:1.0:1789635410.696184:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 46 00000100:00100000:1.0:1789635410.696196:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+9:2396:x1876568411538688:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789635410.696215:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635410.696235:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000094f8377/0xb0c3a59caa40f84a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74179 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789635410.696270:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aabab52, blocks: 0x0 00010000:00010000:1.0:1789635410.696288:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=429s v=(0 0) 00010000:00010000:1.0:1789635410.696293:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635410.696302:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000094f8377/0xb0c3a59caa40f84a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74179 expref: 10 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.696364:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000094f8377/0xb0c3a59caa40f84a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74179 expref: 10 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.696376:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e152800, rc 0) 00000100:00100000:1.0:1789635410.696434:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+10:2396:x1876568411538688:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 240us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635410.696440:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 46 00000100:00100000:1.0:1789635410.711815:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635410.711981:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411538944 00000100:00100000:3.0:1789635410.711991:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411538944 00000100:00100000:3.0:1789635410.712088:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 135 00000100:00100000:3.0:1789635410.712099:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+68:11393:x1876568411538944:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789635410.712276:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+68:11393:x1876568411538944:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 179us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635410.712285:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 135 00000100:00100000:0.0:1789635410.717482:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635410.717852:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411539072 00000100:00100000:1.0:1789635410.717862:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411539072 00000100:00100000:1.0:1789635410.717965:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 47 00000100:00100000:1.0:1789635410.717976:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+10:11393:x1876568411539072:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789635410.717994:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635410.718017:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f59f798e/0xb0c3a59caa40f851 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74180 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.718048:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000094f8377/0xb0c3a59caa40f84a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74179 expref: 11 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.718058:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635410.718062:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635410.718067:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f59f798e/0xb0c3a59caa40f851 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74180 expref: 11 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.718233:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000094f8377/0xb0c3a59caa40f84a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74179 expref: 11 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.718248:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000094f8377/0xb0c3a59caa40f84a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74179 expref: 11 pid: 8431 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635410.718264:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bfd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8432:1876568427348096:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789635410.732409:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446c1a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635410.738920:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635410.739118:0:13189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411539200 00000100:00100000:1.0:1789635410.739127:0:13189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411539200 00010000:00010000:1.0:1789635410.739191:0:13189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000094f8377/0xb0c3a59caa40f84a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74179 expref: 12 pid: 8431 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635410.739230:0:13189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 72 00000100:00100000:1.0:1789635410.739240:0:13189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550662300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+12:2396:x1876568411539200:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635410.739254:0:13189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635410.739276:0:13189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000094f8377/0xb0c3a59caa40f84a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74179 expref: 12 pid: 8431 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.739291:0:13189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000094f8377/0xb0c3a59caa40f84a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74179 expref: 12 pid: 8431 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.739317:0:13189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635410.739322:0:13189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635410.739338:0:13189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f59f798e/0xb0c3a59caa40f851 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74180 expref: 12 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.739349:0:13189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f59f798e/0xb0c3a59caa40f851 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74180 expref: 12 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.739389:0:13189:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f59f798e/0xb0c3a59caa40f851 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74180 expref: 12 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635410.739404:0:13189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bfd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:13189:1876568427348224:192.168.203.20@tcp:105: 00000100:00100000:1.0:1789635410.739486:0:13189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057ae003c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789635410.740816:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000094f8377/0xb0c3a59caa40f84a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74179 expref: 12 pid: 8431 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635410.740836:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bfd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8432:1876568427348096:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789635410.740864:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f59f798e/0xb0c3a59caa40f851 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74180 expref: 11 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.740891:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e153600, rc 0) 00000100:00100000:0.0:1789635410.740945:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+11:11393:x1876568411539072:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 22972us (23472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635410.740953:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 47 00000100:00100000:1.0:1789635410.743054:0:13189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bfd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:13189:1876568427348224:192.168.203.20@tcp:105: 00010000:00010000:1.0:1789635410.743080:0:13189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635410.743126:0:13189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550662300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+10:2396:x1876568411539200:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 3888us (4215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635410.743134:0:13189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 72 00000100:00100000:1.0:1789635410.748988:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635410.749063:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411539328 00000100:00100000:3.0:1789635410.749072:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411539328 00002000:00100000:3.0:1789635410.749111:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8d0550bfd500 x1876568411539328/t0(0) o4->6e1c17f2-a595-4ed0-97c8-b9260d0850ab@192.168.203.20@tcp:31/0 lens 504/0 e 0 to 0 dl 1789635421 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789635410.749119:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0550bfd500 with x1876568411539328 ext(0->12) 00002000:00010000:3.0:1789635410.749124:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d0550bfd500 00000100:00100000:0.0:1789635410.749295:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:0.0:1789635410.749309:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+10:2397:x1876568411539328:12345-192.168.203.20@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789635410.750553:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+12:2397:x1876568411539328:12345-192.168.203.20@tcp:4:lhsmtool_posix.0 Request processed in 1242us (1566us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789635410.750568:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 2 00002000:00100000:0.0:1789635410.750577:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8d0550bfd500 x1876568411539328/t4294967309(0) o4->6e1c17f2-a595-4ed0-97c8-b9260d0850ab@192.168.203.20@tcp:31/0 lens 504/448 e 0 to 0 dl 1789635421 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789635410.750586:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0550bfd500 with x1876568411539328 ext(0->12) 00002000:00010000:0.0:1789635410.750882:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d0550bfd500 00000100:00100000:2.0:1789635410.753101:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635410.753319:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411539456 00000100:00100000:1.0:1789635410.753328:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411539456 00000100:00100000:1.0:1789635410.753434:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 136 00000100:00100000:1.0:1789635410.753445:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0558848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+68:11393:x1876568411539456:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789635410.759637:0:6493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00010000:00010000:1.0:1789635410.759646:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8600/0xb0c3a59caa40f556 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.759657:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8600/0xb0c3a59caa40f556 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789635410.759664:0:6493:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:2.0:1789635410.759688:0:6493:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00010000:00010000:1.0:1789635410.759690:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8600/0xb0c3a59caa40f556 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.759697:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056f6e8600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635410.759701:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8600/0xb0c3a59caa40f556 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.759710:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8600/0xb0c3a59caa40f556 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789635410.759725:0:6493:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d0446ce0780 refcount 2 committed 0 result 0 batchid 3 00010000:00010000:1.0:1789635410.759726:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d0447664e00) 00000020:00080000:2.0:1789635410.759728:0:6493:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d0447821600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d0446ce0000 00010000:00010000:1.0:1789635410.759730:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:2.0:1789635410.759732:0:6493:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d0447821400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d054296c400 00010000:00010000:1.0:1789635410.759734:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8600/0xb0c3a59caa40f556 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.759740:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8600/0xb0c3a59caa40f556 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789635410.759754:0:6493:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00010000:00010000:1.0:1789635410.759766:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f5fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.759772:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f5fe lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.759777:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f5fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789635410.759779:0:6493:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d0446df5e40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1789635410.759782:0:6493:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d04477a4200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d0446df5c00 00010000:00010000:1.0:1789635410.759783:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056f6e9a00 already unused, calling callback (ffffffffc1b494f0) 00000020:00080000:2.0:1789635410.759786:0:6493:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d04477a4e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d044757ae00 00010000:00010000:1.0:1789635410.759786:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f5fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.759801:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f5fe lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.759809:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d04466ca100) 00010000:00010000:1.0:1789635410.759812:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:2.0:1789635410.759813:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00010000:00010000:1.0:1789635410.759815:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f5fe lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.759821:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e9a00/0xb0c3a59caa40f5fe lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.759836:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe000/0xb0c3a59caa40f67c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.759842:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe000/0xb0c3a59caa40f67c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.759848:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe000/0xb0c3a59caa40f67c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.759852:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488fe000 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635410.759855:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe000/0xb0c3a59caa40f67c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.759860:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe000/0xb0c3a59caa40f67c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.759867:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d044764bc00) 00010000:00010000:1.0:1789635410.759869:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635410.759872:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe000/0xb0c3a59caa40f67c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.759884:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe000/0xb0c3a59caa40f67c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789635410.759887:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:1.0:1789635410.759895:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f69f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.759901:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f69f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635410.760074:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789635410.760091:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427348352:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789635410.760156:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635410.760202:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427348352 00000100:00100000:0.0:1789635410.760210:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427348352 00000100:00100000:0.0:1789635410.760256:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789635410.760265:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1876568427348352:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789635410.760289:0:8431:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:0.0:1789635410.760312:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000360dcadc/0xb0c3a59caa40f858 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.760344:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000070c933e6/0xb0c3a59caa40f60c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740d8 expref: 11 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.760352:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1789635410.760357:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789635410.760361:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000360dcadc/0xb0c3a59caa40f858 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.760388:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000070c933e6/0xb0c3a59caa40f60c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740d8 expref: 11 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.760401:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000070c933e6/0xb0c3a59caa40f60c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740d8 expref: 11 pid: 8431 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635410.760413:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541325880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8431:1876568427348480:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789635410.760466:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f69f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635410.760469:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446df5480 going to sleep for 11 seconds 00010000:00010000:1.0:1789635410.760473:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540031800 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635410.760476:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f69f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.760483:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f69f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.760492:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d044764bc00) 00010000:00010000:1.0:1789635410.760495:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635410.760497:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f69f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.760503:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f69f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.760519:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f771 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.760526:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f771 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.760547:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f771 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.760551:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1b000 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635410.760554:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f771 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.760560:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f771 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.760567:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d04466cab00) 00010000:00010000:1.0:1789635410.760569:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635410.760572:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f771 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.760578:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40f771 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635410.760583:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0558848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+18:11393:x1876568411539456:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 Request processed in 7140us (7490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635410.760591:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 136 00010000:00010000:1.0:1789635410.760627:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f82e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.760633:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f82e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.760639:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f82e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.760644:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540030c00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635410.760647:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f82e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.760661:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f82e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.760670:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d0544e2ec00) 00010000:00010000:1.0:1789635410.760672:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789635410.760675:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f82e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.760691:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f82e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635410.761169:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789635410.761181:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427348608:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789635410.761219:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635410.761502:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427348608 00000100:00100000:3.0:1789635410.761509:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427348608 00000100:00100000:3.0:1789635410.761555:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789635410.761563:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d055884a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3642:x1876568427348608:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789635410.761585:0:10116:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:3.0:1789635410.761650:0:10116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aabab51, atime: 0x6aabab51, ctime: 0x6aabab51, blocks: 0x8 00010000:00010000:3.0:1789635410.761657:0:10116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021d82e89/0xb0c3a59caa40f85f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.761666:0:10116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1789635410.761669:0:10116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635410.761674:0:10116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021d82e89/0xb0c3a59caa40f85f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.761703:0:10116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021d82e89/0xb0c3a59caa40f85f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.761713:0:10116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021d82e89/0xb0c3a59caa40f85f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.761720:0:10116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021d82e89/0xb0c3a59caa40f85f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.761735:0:10116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789635410.762357:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635410.762365:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021d82e89/0xb0c3a59caa40f85f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.762373:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488fe200 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635410.762377:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021d82e89/0xb0c3a59caa40f85f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.762385:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021d82e89/0xb0c3a59caa40f85f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.762400:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021d82e89/0xb0c3a59caa40f85f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.762406:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021d82e89/0xb0c3a59caa40f85f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.762423:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635410.762425:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635410.762427:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635410.762531:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d055884a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3642:x1876568427348608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 967us (1309us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789635410.762548:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:2.0:1789635410.762804:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d0550660380/2, rc 0, transno 4294967305 00000100:00100000:2.0:1789635410.762811:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427348608:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789635410.765995:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635410.766055:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635410.766171:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541325880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8431:1876568427348480:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789635410.766201:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000360dcadc/0xb0c3a59caa40f858 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635410.766243:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411539584 00000100:00100000:1.0:1789635410.766252:0:7457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411539584 00000100:00100000:3.0:1789635410.766287:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411539712 00000100:00100000:3.0:1789635410.766292:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411539712 00010000:00010000:1.0:1789635410.766298:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000070c933e6/0xb0c3a59caa40f60c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740d8 expref: 13 pid: 8431 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635410.766365:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 50 00000100:00100000:1.0:1789635410.766365:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 73 00000100:00100000:1.0:1789635410.766374:0:7457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b404850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+13:2396:x1876568411539584:12345-192.168.203.20@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789635410.766375:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0558849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+13:2396:x1876568411539712:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1789635410.766389:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635410.766396:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000070c933e6/0xb0c3a59caa40f60c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740d8 expref: 13 pid: 8431 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.766409:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000070c933e6/0xb0c3a59caa40f60c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740d8 expref: 13 pid: 8431 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.766431:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070c933e6/0xb0c3a59caa40f60c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740d8 expref: 13 pid: 8431 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.766459:0:7457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789635410.766464:0:7457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789635410.766469:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000360dcadc/0xb0c3a59caa40f858 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.766478:0:7457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000360dcadc/0xb0c3a59caa40f858 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.766501:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635410.766567:0:7457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b404850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+12:2396:x1876568411539584:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 193us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635410.766575:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 73 00010000:00010000:0.0:1789635410.766992:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000360dcadc/0xb0c3a59caa40f858 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.767008:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000360dcadc/0xb0c3a59caa40f858 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.767018:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000360dcadc/0xb0c3a59caa40f858 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.767025:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000360dcadc/0xb0c3a59caa40f858 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.767089:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789635410.767283:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635410.767290:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000360dcadc/0xb0c3a59caa40f858 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.767298:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1ae00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:3.0:1789635410.767302:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000360dcadc/0xb0c3a59caa40f858 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.767322:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000360dcadc/0xb0c3a59caa40f858 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.767336:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000360dcadc/0xb0c3a59caa40f858 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.767343:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000360dcadc/0xb0c3a59caa40f858 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.767361:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635410.767363:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635410.767365:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635410.769234:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3643:x1876568427348352:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8955us (9061us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789635410.769245:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000004:00080000:2.0:1789635410.769368:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d04467ba680/2, rc 0, transno 4294967310 00000100:00100000:2.0:1789635410.769379:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427348352:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1789635410.779280:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1789635410.779323:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:0.0:1789635410.779524:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0558849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2396:x1876568411539712:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 Request processed in 13145us (13461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635410.779545:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 50 00000100:00100000:2.0:1789635410.790037:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635410.790402:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411539968 00000100:00100000:0.0:1789635410.790413:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411539968 00000100:00100000:0.0:1789635410.790478:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 137 00000100:00100000:0.0:1789635410.790491:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0558849500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+16:11393:x1876568411539968:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789635410.790563:0:10094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635410.790643:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f843 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74172 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.790665:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d0544e2ec00) 00010000:00010000:0.0:1789635410.790683:0:10094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789635410.790714:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1aa00/0xb0c3a59caa40f866 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.790728:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1aa00/0xb0c3a59caa40f866 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.790738:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1aa00/0xb0c3a59caa40f866 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789635410.791105:0:10094:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000078a0276e reply state 000000005c8a317d transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1aa00/0xb0c3a59caa40f866 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.791118:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1aa00/0xb0c3a59caa40f866 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.791125:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d0544e2ec00) 00010000:00010000:0.0:1789635410.791128:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789635410.791130:0:10094:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789635410.791239:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0558849500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+17:11393:x1876568411539968:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 751us (1210us total) trans 4294967403 rc 0/0 00000100:00100000:0.0:1789635410.791247:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 137 00000100:00100000:1.0:1789635410.794759:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635410.795161:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411540096 00000100:00100000:3.0:1789635410.795171:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411540096 00000100:00100000:3.0:1789635410.795229:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00100000:3.0:1789635410.795239:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2396:x1876568411540096:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789635410.800422:0:10116:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789635410.800430:0:10116:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789635410 00002000:00010000:0.0:1789635410.800433:0:10116:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789635409 00002000:00010000:0.0:1789635410.800436:0:10116:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1789635410 -> 1789635410 00002000:00010000:0.0:1789635410.800438:0:10116:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1789635410.800897:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:2396:x1876568411540096:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 5652us (6140us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789635410.800909:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00100000:2.0:1789635410.808848:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635410.808967:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411540352 00000100:00100000:3.0:1789635410.808977:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411540352 00000100:00100000:3.0:1789635410.809070:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 138 00000100:00100000:3.0:1789635410.809081:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0558848700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+17:11393:x1876568411540352:12345-192.168.203.20@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789635410.809212:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f86d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.809239:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f827 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74164 expref: 17 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.809262:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f86d lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.809378:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f827 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74164 expref: 17 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.809391:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f827 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74164 expref: 17 pid: 10094 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635410.809406:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550662680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6514:1876568427348736:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789635410.809488:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446c53840 going to sleep for 11 seconds 00000100:00100000:3.0:1789635410.814393:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550662680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6514:1876568427348736:192.168.203.20@tcp:104: 00010000:00010000:3.0:1789635410.814425:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f86d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635410.815065:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635410.816212:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411540480 00000100:00100000:3.0:1789635410.816223:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411540480 00010000:00010000:3.0:1789635410.818414:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f827 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74164 expref: 18 pid: 10094 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635410.819145:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 74 00000100:00100000:2.0:1789635410.819167:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d055884bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+18:2396:x1876568411540480:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635410.819186:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635410.819195:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f827 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74164 expref: 18 pid: 10094 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.819210:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f827 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74164 expref: 18 pid: 10094 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.819232:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f827 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74164 expref: 18 pid: 10094 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.819261:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d0544e2ec00) 00010000:00010000:2.0:1789635410.819266:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f86d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.819278:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f86d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.819285:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f86d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.819411:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635410.819481:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d055884bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+17:2396:x1876568411540480:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 325us (4418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635410.819489:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 74 00010000:00010000:3.0:1789635410.820330:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f86d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.820341:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f86d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.820380:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f86d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.820396:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f86d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.820403:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f86d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.820409:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488fe400 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635410.820413:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f86d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.820420:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f86d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.820432:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d0544e2ec00) 00010000:00010000:3.0:1789635410.820435:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789635410.820439:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f86d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.820445:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f86d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635410.820516:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0558848700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+16:11393:x1876568411540352:12345-192.168.203.20@tcp:55:lhsmtool_posix.0 Request processed in 11426us (11667us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789635410.820525:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 138 00000100:00100000:2.0:1789635410.839429:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635410.844994:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411540608 00000100:00100000:0.0:1789635410.845009:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411540608 00000100:00100000:0.0:1789635410.845087:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 52 00000100:00100000:0.0:1789635410.845098:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d055884b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:2396:x1876568411540608:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789635410.845153:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000056339109/0xb0c3a59caa40f874 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.845173:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f59f798e/0xb0c3a59caa40f851 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74180 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.845182:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635410.845186:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789635410.845191:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056339109/0xb0c3a59caa40f874 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.845227:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f59f798e/0xb0c3a59caa40f851 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74180 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.845241:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f59f798e/0xb0c3a59caa40f851 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74180 expref: 7 pid: 8432 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635410.845255:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541325880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8431:1876568427348864:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789635410.845349:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446df5000 going to sleep for 11 seconds 00000100:00100000:0.0:1789635410.850736:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541325880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8431:1876568427348864:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789635410.850766:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000056339109/0xb0c3a59caa40f874 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635410.854136:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635410.854399:0:13189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411540736 00000100:00100000:1.0:1789635410.854410:0:13189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411540736 00010000:00010000:1.0:1789635410.854453:0:13189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f59f798e/0xb0c3a59caa40f851 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74180 expref: 8 pid: 8432 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635410.854496:0:13189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 75 00000100:00100000:1.0:1789635410.854505:0:13189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0558848e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:2397:x1876568411540736:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635410.854520:0:13189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635410.854551:0:13189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f59f798e/0xb0c3a59caa40f851 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74180 expref: 8 pid: 8432 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.854567:0:13189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f59f798e/0xb0c3a59caa40f851 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74180 expref: 8 pid: 8432 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.854655:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f59f798e/0xb0c3a59caa40f851 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74180 expref: 8 pid: 8432 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.854672:0:13189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789635410.854676:0:13189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789635410.854682:0:13189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000056339109/0xb0c3a59caa40f874 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.854692:0:13189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056339109/0xb0c3a59caa40f874 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.854716:0:13189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635410.854780:0:13189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0558848e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:2397:x1876568411540736:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 276us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635410.854789:0:13189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 75 00010000:00010000:0.0:1789635410.854900:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000056339109/0xb0c3a59caa40f874 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.854987:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056339109/0xb0c3a59caa40f874 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.855009:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000056339109/0xb0c3a59caa40f874 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.855017:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056339109/0xb0c3a59caa40f874 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.855024:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056339109/0xb0c3a59caa40f874 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.855032:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1b600 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:0.0:1789635410.855036:0:8431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056339109/0xb0c3a59caa40f874 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.855044:0:8431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056339109/0xb0c3a59caa40f874 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.855057:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056339109/0xb0c3a59caa40f874 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.855077:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056339109/0xb0c3a59caa40f874 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635410.855128:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d055884b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2396:x1876568411540608:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 Request processed in 10032us (16224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635410.855136:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 52 00000100:00100000:2.0:1789635410.858077:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635410.858196:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411540992 00000100:00100000:0.0:1789635410.858206:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411540992 00000100:00100000:0.0:1789635410.858266:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 139 00000100:00100000:0.0:1789635410.858276:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448449f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+16:11393:x1876568411540992:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789635410.858349:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f87b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.858365:0:9526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f76a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7412c expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.858375:0:9526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f87b lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.858408:0:9526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f76a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7412c expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.858421:0:9526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f76a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7412c expref: 16 pid: 6516 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635410.858434:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541325880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9526:1876568427348992:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789635410.858574:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446df5000 going to sleep for 11 seconds 00000100:00100000:0.0:1789635410.872667:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541325880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9526:1876568427348992:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789635410.872697:0:9526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f87b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635410.878911:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635410.879004:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411541120 00000100:00100000:1.0:1789635410.879013:0:7457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411541120 00010000:00010000:1.0:1789635410.879055:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f76a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7412c expref: 17 pid: 6516 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635410.879098:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 76 00000100:00100000:1.0:1789635410.879109:0:7457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044844bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+17:2396:x1876568411541120:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635410.879124:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635410.879130:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f76a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7412c expref: 17 pid: 6516 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.879168:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f76a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7412c expref: 17 pid: 6516 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.879242:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f76a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7412c expref: 17 pid: 6516 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.879259:0:7457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d04466cab00) 00010000:00010000:1.0:1789635410.879264:0:7457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ac00/0xb0c3a59caa40f7cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7414f expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.879274:0:7457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f87b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.879281:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f87b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.879288:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f87b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.879350:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635410.879412:0:7457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044844bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+16:2396:x1876568411541120:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 304us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635410.879420:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 76 00010000:00010000:0.0:1789635410.881359:0:9526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f87b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.881375:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f87b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.881560:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f882 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.881577:0:9526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe600/0xb0c3a59caa40f835 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7416b expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.881587:0:9526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f882 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.881641:0:9526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe600/0xb0c3a59caa40f835 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7416b expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.881656:0:9526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe600/0xb0c3a59caa40f835 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7416b expref: 16 pid: 6514 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635410.881670:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541325880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9526:1876568427349120:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789635410.881750:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446df56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635410.893941:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635410.894249:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411541248 00000100:00100000:2.0:1789635410.894259:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411541248 00010000:00010000:2.0:1789635410.894300:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe600/0xb0c3a59caa40f835 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7416b expref: 17 pid: 6514 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635410.894363:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 77 00000100:00100000:2.0:1789635410.894373:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550662680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+17:2397:x1876568411541248:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635410.894389:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635410.894396:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe600/0xb0c3a59caa40f835 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7416b expref: 17 pid: 6514 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.894409:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe600/0xb0c3a59caa40f835 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7416b expref: 17 pid: 6514 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.894431:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d0544e2ec00) 00010000:00010000:2.0:1789635410.894437:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f882 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.894446:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f882 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.894470:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f882 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.894489:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635410.894553:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550662680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+17:2397:x1876568411541248:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 181us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635410.894560:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 77 00010000:00010000:0.0:1789635410.896321:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe600/0xb0c3a59caa40f835 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7416b expref: 16 pid: 6514 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635410.896364:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541325880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9526:1876568427349120:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789635410.896387:0:9526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f882 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.896395:0:9526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f882 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.896401:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f882 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789635410.896516:0:9526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1789635410.896692:0:9526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1789635410.896736:0:9526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1789635410.896878:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541325880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9526:1876568427349248:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789635410.896936:0:9526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635410.896973:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427349248 00000100:00100000:0.0:1789635410.896979:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427349248 00000100:00100000:0.0:1789635410.897016:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789635410.897025:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:9526:x1876568427349248:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789635410.897098:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:9526:x1876568427349248:12345-0@lo:1000:mdt00_003.0 Request processed in 74us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635410.897105:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789635410.897137:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446df50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635410.897150:0:9526:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1789635410.897154:0:9526:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1789635410.897170:0:9526:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8d04467ba680 x1876568427348352/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789635426 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635410.897191:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541325880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9526:1876568427349248:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1789635410.897274:0:9526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:0.0:1789635410.897309:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541325880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9526:1876568427349376:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789635410.897337:0:9526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635410.897350:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446df5000 going to sleep for 11 seconds 00000100:00100000:1.0:1789635410.899058:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427349376 00000100:00100000:1.0:1789635410.899069:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427349376 00000100:00100000:1.0:1789635410.899134:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789635410.899145:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05446f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9526:x1876568427349376:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789635410.899525:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05446f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:9526:x1876568427349376:12345-0@lo:1000:mdt00_003.0 Request processed in 381us (2185us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1789635410.899532:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789635410.900908:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541325880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9526:1876568427349376:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1789635410.900960:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f882 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.900988:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f882 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.900995:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f882 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.901001:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1b600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635410.901006:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f882 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.901013:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f882 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.901030:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d0544e2ec00) 00010000:00010000:3.0:1789635410.901034:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789635410.901039:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f882 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.901044:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f882 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.901070:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f7c5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.901076:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f7c5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.901082:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f7c5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.901086:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1bc00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635410.901096:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f7c5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.901101:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f7c5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.901108:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d04466cab00) 00010000:00010000:3.0:1789635410.901111:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789635410.901116:0:9526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ac00/0xb0c3a59caa40f7cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7414f expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.901559:0:9526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ac00/0xb0c3a59caa40f7cc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7414f expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.901571:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ac00/0xb0c3a59caa40f7cc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7414f expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635410.901953:0:9526:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ac00/0xb0c3a59caa40f7cc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7414f expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635410.901970:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550661180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9526:1876568427349504:192.168.203.20@tcp:105: 00000100:00100000:1.0:1789635410.903924:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446c53840 going to sleep for 11 seconds 00000100:00100000:3.0:1789635410.929295:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635410.929582:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550661180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9526:1876568427349504:192.168.203.20@tcp:105: 00010000:00010000:1.0:1789635410.929653:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f7c5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.929665:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f7c5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.929700:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f889 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.929713:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f889 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.929724:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f889 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.929735:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f889 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.929741:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f889 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.929747:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f889 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.929753:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e153600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635410.929756:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f889 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.929780:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f889 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.929792:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d04466cab00) 00010000:00010000:1.0:1789635410.929795:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635410.929799:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f889 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.929804:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f889 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.929834:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f87b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.929839:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f87b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.929845:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f87b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.929850:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1a400 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635410.929852:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f87b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.929858:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f87b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.929866:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d04466cab00) 00010000:00010000:1.0:1789635410.929868:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789635410.929871:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f87b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635410.929888:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f87b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635410.930053:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448449f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+19:11393:x1876568411540992:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 71777us (71983us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1789635410.930063:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 139 00000020:00080000:1.0:1789635410.930069:0:9526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789635410.930924:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789635410.930930:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1789635410.931262:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411541376 00000100:00100000:2.0:1789635410.931271:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411541376 00000100:00100000:2.0:1789635410.931330:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 31 00000100:00100000:2.0:1789635410.931341:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550662300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+19:11390:x1876568411541376:12345-192.168.203.20@tcp:49:lfs.0 00000100:00100000:2.0:1789635410.931467:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550662300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+19:11390:x1876568411541376:12345-192.168.203.20@tcp:49:lfs.0 Request processed in 128us (2182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635410.931475:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 31 00000040:00080000:3.0:1789635410.934058:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789635410.934078:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789635410.967012:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635410.967069:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635410.967173:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411541632 00000100:00100000:0.0:1789635410.967184:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411541632 00000100:00100000:0.0:1789635410.967243:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 32 00000100:00100000:0.0:1789635410.967255:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b747c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+19:11393:x1876568411541632:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789635410.967547:0:6518:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789635410.967580:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:0.0:1789635410.967653:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f890 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.967670:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f890 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.967681:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f890 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.967689:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f890 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.967695:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f890 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.967702:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f890 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635410.967740:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789635410.967847:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b747c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+21:11393:x1876568411541632:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 594us (844us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1789635410.967861:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 32 00000020:00080000:0.0:1789635410.967866:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789635410.968286:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635410.968293:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f890 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.968300:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1a600 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635410.968304:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f890 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.968312:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f890 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.968325:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d0544e2ec00) 00010000:00010000:2.0:1789635410.968336:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789635410.968341:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f890 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.968359:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f890 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635410.968373:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635410.968374:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635410.968376:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635410.969317:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411541888 00000100:00100000:3.0:1789635410.969327:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411541888 00000100:00100000:3.0:1789635410.969555:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 140 00000100:00100000:3.0:1789635410.969576:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04477a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+21:11390:x1876568411541888:12345-192.168.203.20@tcp:58:lfs.0 00000040:00080000:3.0:1789635410.969765:0:10094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1789635410.969963:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04477a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+21:11390:x1876568411541888:12345-192.168.203.20@tcp:58:lfs.0 Request processed in 388us (2892us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635410.969971:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 140 00000100:00100000:0.0:1789635411.031051:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635411.031283:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411542016 00000100:00100000:3.0:1789635411.031304:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411542016 00000100:00100000:3.0:1789635411.031384:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 141 00000100:00100000:3.0:1789635411.031395:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d055884aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+21:11395:x1876568411542016:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789635411.031420:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635411.031441:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffa00/0xb0c3a59caa40f897 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74187 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635411.031504:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f89e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635411.031519:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f89e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635411.031530:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f89e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635411.031553:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa40f8a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635411.031560:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa40f8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635411.031566:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa40f8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635411.031700:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fec00/0xb0c3a59caa40f8ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635411.031712:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f7b7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74148 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635411.031720:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fec00/0xb0c3a59caa40f8ac lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635411.031754:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f7b7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74148 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635411.032901:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f7b7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74148 expref: 22 pid: 6516 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635411.032920:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550663800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6514:1876568427349632:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789635411.033081:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446c53840 going to sleep for 11 seconds 00000100:00080000:1.0:1789635411.033163:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635411.038531:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550663800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6514:1876568427349632:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789635411.038569:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fec00/0xb0c3a59caa40f8ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635411.045164:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635411.047341:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411542272 00000100:00100000:0.0:1789635411.047363:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411542272 00000100:00100000:0.0:1789635411.047433:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:0.0:1789635411.047443:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+23:11391:x1876568411542272:12345-192.168.203.20@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789635411.047888:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+24:11391:x1876568411542272:12345-192.168.203.20@tcp:35:ldlm_bl.0 Request processed in 445us (2732us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1789635411.047896:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:0.0:1789635411.055333:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635411.055654:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411542400 00000100:00100000:2.0:1789635411.055664:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411542400 00010000:00010000:2.0:1789635411.055705:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f7b7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74148 expref: 24 pid: 6516 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635411.055750:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 78 00000100:00100000:2.0:1789635411.055760:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447974a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+24:2397:x1876568411542400:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635411.055774:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635411.055781:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f7b7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74148 expref: 24 pid: 6516 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635411.055794:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f7b7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74148 expref: 24 pid: 6516 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635411.055829:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f7b7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74148 expref: 24 pid: 6516 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635411.055847:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d04466cab00) 00010000:00010000:2.0:1789635411.055866:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fec00/0xb0c3a59caa40f8ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635411.055876:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fec00/0xb0c3a59caa40f8ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635411.055883:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fec00/0xb0c3a59caa40f8ac lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635411.055918:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635411.055975:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447974a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+23:2397:x1876568411542400:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 216us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635411.055982:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 78 00010000:00010000:0.0:1789635411.056479:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fec00/0xb0c3a59caa40f8ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635411.056489:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fec00/0xb0c3a59caa40f8ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635411.056550:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789635411.056555:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789635411.056576:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fec00/0xb0c3a59caa40f8ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635411.056591:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fec00/0xb0c3a59caa40f8ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635411.056655:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f89e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635411.056661:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f89e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635411.056668:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f89e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635411.056675:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488fe400 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635411.056678:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f89e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635411.056685:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f89e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635411.056695:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d0558d1c900) 00010000:00010000:0.0:1789635411.056698:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635411.056702:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f89e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635411.056708:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40f89e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635411.056721:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa40f8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635411.056727:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa40f8a5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635411.056732:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa40f8a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635411.056743:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488ff000 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635411.056746:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa40f8a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635411.056753:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa40f8a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635411.056761:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d05446d0e00) 00010000:00010000:0.0:1789635411.056763:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635411.056766:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa40f8a5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635411.056771:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa40f8a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635411.056824:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffa00/0xb0c3a59caa40f897 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74187 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635411.056839:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fec00/0xb0c3a59caa40f8ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74187 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635411.056846:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d04466cab00) 00010000:00010000:0.0:1789635411.056848:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789635411.056851:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05488fec00, rc 0) 00000100:00100000:0.0:1789635411.056895:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d055884aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+22:11395:x1876568411542016:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 25502us (25854us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635411.056902:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 141 00010000:00010000:2.0:1789635411.114103:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635411.364526:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427349760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635411.364786:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635411.366077:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427349760 00000100:00100000:1.0:1789635411.366097:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427349760 00000100:00080000:0.0:1789635411.366271:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789635411.366329:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789635411.366340:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05412adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1876568427349760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789635411.366367:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635411.366430:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05412adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1876568427349760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (1645us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635411.366436:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789635411.366518:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427349760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789635411.877157:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789635411.877180:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427349888:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789635411.877244:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635411.877660:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427349888 00000100:00100000:3.0:1789635411.877669:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427349888 00000100:00100000:3.0:1789635411.877725:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789635411.877735:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427349888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789635411.877773:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635411.877824:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427349888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635411.877831:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789635411.878012:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427349888:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1789635411.953086:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789635411.953096:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789635411.953119:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789635411.953126:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789635411.957012:0:13797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044765a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1876568427350016:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789635411.957108:0:13797:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0551531e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789635411.965554:0:13797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044765a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1876568427350016:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789635411.984503:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635411.984552:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411542528 00000100:00100000:1.0:1789635411.984562:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411542528 00000100:00100000:1.0:1789635411.985221:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 142 00000100:00100000:1.0:1789635411.985234:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+22:11406:x1876568411542528:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789635411.985279:0:9526:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789635411.985399:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+22:11406:x1876568411542528:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 167us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635411.985406:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 142 00000100:00100000:3.0:1789635411.996028:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635411.996243:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411542784 00000100:00100000:2.0:1789635411.996253:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411542784 00000100:00100000:2.0:1789635411.996329:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 143 00000100:00100000:2.0:1789635411.996340:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+22:11406:x1876568411542784:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789635411.996372:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635411.996391:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f8b3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7418e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635411.996493:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f8ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635411.996508:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f8ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635411.996522:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f8ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635411.996544:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789635411.996854:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f8b3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7418e expref: 25 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635411.996872:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f8ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7418e expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635411.996881:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d04466cab00) 00010000:00010000:2.0:1789635411.996883:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789635411.996886:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0540030a00, rc 0) 00000100:00100000:2.0:1789635411.996949:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+24:11406:x1876568411542784:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 611us (930us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1789635411.996956:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 143 00000100:00100000:1.0:1789635412.018821:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635412.018863:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635412.018902:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411542912 00000100:00100000:1.0:1789635412.018910:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411542912 00000100:00100000:1.0:1789635412.018989:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:1.0:1789635412.018999:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+24:2396:x1876568411542912:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635412.019015:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635412.019039:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f8ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7418e expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635412.019059:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d04466cab00) 00010000:00010000:1.0:1789635412.019064:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635412.019116:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+23:2396:x1876568411542912:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 118us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635412.019124:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:1.0:1789635412.019952:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411543168 00000100:00100000:1.0:1789635412.019961:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411543168 00000100:00100000:1.0:1789635412.020062:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 144 00000100:00100000:1.0:1789635412.020070:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+23:11406:x1876568411543168:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789635412.020134:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f8c8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635412.020149:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f8c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635412.020160:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f8c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635412.020336:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f8c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635412.020344:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f8c8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635412.020361:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f8c8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635412.020367:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e153600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635412.020372:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f8c8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635412.020380:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f8c8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635412.020389:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d04466cab00) 00010000:00010000:1.0:1789635412.020392:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789635412.020396:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f8c8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635412.020402:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f8c8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635412.020497:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+24:11406:x1876568411543168:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 427us (1632us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1789635412.020505:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 144 00000040:00080000:3.0:1789635412.021172:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789635412.021178:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789635412.021724:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789635412.021733:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789635412.028413:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635412.028482:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411543424 00000100:00100000:2.0:1789635412.028492:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411543424 00000100:00100000:2.0:1789635412.028559:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 34 00000100:00100000:2.0:1789635412.028583:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+24:11406:x1876568411543424:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789635412.028852:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+25:11406:x1876568411543424:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 271us (448us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1789635412.028860:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 34 00010000:00010000:1.0:1789635412.134348:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789635412.242544:0:14264:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789635412.242555:0:14264:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789635412.244199:0:14264:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789635412.244207:0:14264:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789635412.539000:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635412.539283:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411543680 00000100:00100000:1.0:1789635412.539293:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411543680 00000100:00100000:1.0:1789635412.539436:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 145 00000100:00100000:1.0:1789635412.539447:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+25:11419:x1876568411543680:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789635412.539470:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635412.539499:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f8cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74195 expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635412.539687:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153e00/0xb0c3a59caa40f8d6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635412.539701:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153e00/0xb0c3a59caa40f8d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635412.539713:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153e00/0xb0c3a59caa40f8d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635412.539724:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789635412.539819:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40f8cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74195 expref: 28 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635412.539835:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153e00/0xb0c3a59caa40f8d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74195 expref: 27 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635412.539842:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d04466cab00) 00010000:00010000:1.0:1789635412.539845:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789635412.539849:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e153e00, rc 0) 00000100:00100000:1.0:1789635412.539917:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+27:11419:x1876568411543680:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 473us (927us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1789635412.539924:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 145 00000100:00100000:3.0:1789635412.544419:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635412.561955:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411543808 00000100:00100000:2.0:1789635412.561972:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411543808 00000100:00100000:2.0:1789635412.562058:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 146 00000100:00100000:2.0:1789635412.562069:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+27:11419:x1876568411543808:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:2.0:1789635412.562144:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f8e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635412.562161:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f8e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635412.562172:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f8e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635412.562205:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f8e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635412.562212:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f8e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635412.562219:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f8e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635412.562242:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540031400 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635412.562246:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f8e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635412.562253:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f8e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635412.562266:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d04466cab00) 00010000:00010000:2.0:1789635412.562268:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789635412.562273:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f8e4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635412.562278:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f8e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635412.564975:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+27:11419:x1876568411543808:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 2899us (20558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635412.565111:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 146 00000100:00100000:3.0:1789635412.722816:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635412.723057:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411543936 00000100:00100000:0.0:1789635412.723069:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411543936 00000100:00100000:0.0:1789635412.723151:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:0.0:1789635412.723164:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550663800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2396:x1876568411543936:12345-192.168.203.20@tcp:101:cat.0 00010000:00010000:0.0:1789635412.723183:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635412.723205:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8876d51/0xb0c3a59caa40f8eb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7419c expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789635412.723230:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aabab52, atime: 0x6aabab51, ctime: 0x6aabab52, blocks: 0x8 00010000:00010000:0.0:1789635412.723249:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1789635412.723254:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635412.723264:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8876d51/0xb0c3a59caa40f8eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7419c expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635412.723282:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b8876d51/0xb0c3a59caa40f8eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7419c expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635412.723295:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1a000, rc 0) 00000100:00100000:0.0:1789635412.723366:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550663800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:2396:x1876568411543936:12345-192.168.203.20@tcp:101:cat.0 Request processed in 206us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635412.723373:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00080000:1.0:1789635412.727030:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789635412.743761:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635412.743888:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411544064 00000100:00100000:2.0:1789635412.743899:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411544064 00002000:00100000:2.0:1789635412.743948:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8d05412aca80 x1876568411544064/t0(0) o3->6e1c17f2-a595-4ed0-97c8-b9260d0850ab@192.168.203.20@tcp:33/0 lens 488/0 e 0 to 0 dl 1789635423 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789635412.743959:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d05412aca80 with x1876568411544064 ext(0->4095) 00002000:00010000:2.0:1789635412.743965:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d05412aca80 00000100:00100000:2.0:1789635412.743998:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:2.0:1789635412.744008:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05412aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:2397:x1876568411544064:12345-192.168.203.20@tcp:3:cat.0 00000100:00100000:2.0:1789635412.744224:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05412aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:2397:x1876568411544064:12345-192.168.203.20@tcp:3:cat.0 Request processed in 217us (473us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789635412.744238:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 3 00002000:00100000:2.0:1789635412.744246:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8d05412aca80 x1876568411544064/t0(0) o3->6e1c17f2-a595-4ed0-97c8-b9260d0850ab@192.168.203.20@tcp:33/0 lens 488/4536 e 0 to 0 dl 1789635423 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789635412.744253:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d05412aca80 with x1876568411544064 ext(0->4095) 00002000:00010000:2.0:1789635412.744256:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d05412aca80 00010000:00010000:2.0:1789635413.156112:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635413.414491:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789635413.414523:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05412af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427350144:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789635413.414649:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635413.415031:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427350144 00000100:00100000:0.0:1789635413.415053:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427350144 00000100:00100000:0.0:1789635413.415120:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789635413.415131:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427350144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789635413.415190:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789635413.415251:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427350144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635413.415258:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789635413.415456:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05412af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427350144:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789635413.421581:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789635413.421629:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550662300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427350272:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789635413.421704:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635413.423634:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427350272 00000100:00100000:0.0:1789635413.423647:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427350272 00000100:00100000:0.0:1789635413.423717:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1789635413.423728:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427350272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789635413.423775:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789635413.423858:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427350272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (2154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635413.423865:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789635413.424127:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550662300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427350272:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789635413.464316:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635413.464377:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635413.464413:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635413.464448:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635413.464471:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635413.464474:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411544448 00000100:00100000:0.0:1789635413.464484:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411544448 00000100:00100000:3.0:1789635413.464499:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635413.464537:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411544576 00000100:00100000:3.0:1789635413.464542:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411544576 00000100:00100000:0.0:1789635413.464559:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411544704 00000100:00100000:0.0:1789635413.464564:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411544704 00000100:00100000:3.0:1789635413.464585:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 125 00000100:00100000:0.0:1789635413.464588:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411544320 00000100:00100000:0.0:1789635413.464592:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411544320 00000100:00100000:0.0:1789635413.464645:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411544832 00000100:00100000:0.0:1789635413.464648:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411544832 00000100:00100000:0.0:1789635413.464664:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 339 00000100:00100000:0.0:1789635413.464671:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411544448:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635413.464689:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04478eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:2398:x1876568411544576:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635413.464784:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 340 00000100:00100000:2.0:1789635413.464793:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550662300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411544704:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635413.464851:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411544448:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 180us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635413.464859:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 339 00000100:00100000:0.0:1789635413.464899:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 341 00000100:00100000:0.0:1789635413.464907:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04478ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+27:2398:x1876568411544320:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789635413.465160:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411544192 00000100:00100000:1.0:1789635413.465165:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411544192 00000100:00100000:1.0:1789635413.465200:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 394 00000100:00100000:1.0:1789635413.465207:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2398:x1876568411544192:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635413.471217:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04478eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:2398:x1876568411544576:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 6611us (6734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635413.471232:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 125 00000100:00100000:3.0:1789635413.471414:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 342 00000100:00100000:3.0:1789635413.471429:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04478ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411544832:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635413.471572:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04478ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411544832:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 148us (7072us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635413.471579:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 342 00000100:00080000:3.0:1789635413.472149:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789635413.472161:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789635413.472164:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789635413.473862:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2398:x1876568411544192:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 8646us (9547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635413.473875:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 394 00000100:00100000:2.0:1789635413.474023:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550662300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411544704:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 9228us (9606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635413.474033:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 340 00000100:00100000:0.0:1789635413.474198:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04478ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+27:2398:x1876568411544320:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 9289us (9748us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635413.474206:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 341 00010000:00010000:0.0:1789635414.180700:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635415.204738:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789635415.459781:0:9895:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 434143182160ns, next at 435143179450ns, rc = 0 00000100:00100000:2.0:1789635415.460067:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427350400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789635415.460135:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635415.460211:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427350400 00000100:00100000:2.0:1789635415.460220:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427350400 00000100:00100000:2.0:1789635415.460275:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789635415.460285:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1876568427350400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789635415.460312:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789635415.460356:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1876568427350400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635415.460379:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:2.0:1789635415.460401:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789635415.460441:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427350400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789635415.460571:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543295180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876568427350656:0@lo:400:kworker.0 00000100:00100000:2.0:1789635415.460621:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635415.460658:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1876568427351168:0@lo:400:kworker.0 00000100:00100000:2.0:1789635415.460683:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635415.460703:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1876568427351680:0@lo:400:kworker.0 00000100:00100000:2.0:1789635415.460723:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635415.460744:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789635415.460749:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427350784:0@lo:400:kworker.0 00000100:00100000:2.0:1789635415.460786:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635415.460804:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427351296:0@lo:400:kworker.0 00000100:00100000:2.0:1789635415.460826:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635415.460841:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1876568427351808:0@lo:400:kworker.0 00000100:00100000:2.0:1789635415.460863:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635415.460891:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427350656 00000100:00100000:2.0:1789635415.460895:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427350656 00000100:00100000:2.0:1789635415.460919:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427351168 00000100:00100000:2.0:1789635415.460921:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427351168 00000100:00100000:2.0:1789635415.460939:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427351680 00000100:00100000:2.0:1789635415.460941:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427351680 00000100:00100000:2.0:1789635415.460956:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427351296 00000100:00100000:2.0:1789635415.460958:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427351296 00000100:00100000:2.0:1789635415.460969:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427351808 00000100:00100000:2.0:1789635415.460971:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427351808 00000100:00100000:2.0:1789635415.460996:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1789635415.461002:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876568427350656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635415.461044:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876568427350656:12345-0@lo:400:kworker.0 Request processed in 40us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635415.461050:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1789635415.461063:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1789635415.461069:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876568427351168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635415.461095:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876568427351168:12345-0@lo:400:kworker.0 Request processed in 26us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635415.461100:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1789635415.461112:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1789635415.461118:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876568427351680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635415.461145:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876568427351680:12345-0@lo:400:kworker.0 Request processed in 27us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635415.461151:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1789635415.461163:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1789635415.461168:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427351296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635415.461193:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427351296:12345-0@lo:400:kworker.0 Request processed in 25us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635415.461198:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1789635415.461208:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1789635415.461213:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876568427351808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635415.461236:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876568427351808:12345-0@lo:400:kworker.0 Request processed in 24us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635415.461242:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1789635415.461269:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427350784 00000100:00100000:2.0:1789635415.461273:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427350784 00000100:00100000:2.0:1789635415.461294:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789635415.461300:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427350784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635415.461332:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427350784:12345-0@lo:400:kworker.0 Request processed in 32us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635415.461338:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00080000:2.0:1789635415.461357:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789635415.461360:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635415.461368:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427350912:0@lo:400:kworker.0 00000100:00100000:2.0:1789635415.461392:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635415.461418:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427351424:0@lo:400:kworker.0 00000100:00100000:2.0:1789635415.461441:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635415.461458:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427351936:0@lo:400:kworker.0 00000100:00100000:2.0:1789635415.461476:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635415.461493:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789635415.461510:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427350528:0@lo:400:kworker.0 00000100:00100000:2.0:1789635415.461534:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635415.461551:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0446c3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427351040:0@lo:400:kworker.0 00000100:00100000:2.0:1789635415.461569:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635415.461582:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427351552:0@lo:400:kworker.0 00000100:00100000:2.0:1789635415.461635:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635415.461658:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427350912 00000100:00100000:2.0:1789635415.461662:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427350912 00000100:00100000:2.0:1789635415.461684:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789635415.461691:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427350912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635415.461736:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427350912:12345-0@lo:400:kworker.0 Request processed in 45us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635415.461742:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789635415.461760:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427351424 00000100:00100000:2.0:1789635415.461764:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427351424 00000100:00100000:2.0:1789635415.461791:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427351936 00000100:00100000:2.0:1789635415.461794:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427351936 00000100:00100000:2.0:1789635415.461807:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427351552 00000100:00100000:2.0:1789635415.461810:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427351552 00000100:00100000:2.0:1789635415.461822:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789635415.461828:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427351424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635415.461860:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427351424:12345-0@lo:400:kworker.0 Request processed in 32us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635415.461865:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789635415.461876:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789635415.461881:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427351936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635415.461906:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427351936:12345-0@lo:400:kworker.0 Request processed in 26us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635415.461912:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789635415.461922:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789635415.461928:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3640:x1876568427351552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635415.461953:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3640:x1876568427351552:12345-0@lo:400:kworker.0 Request processed in 25us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635415.461958:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:2.0:1789635415.461971:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789635415.461974:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789635415.461998:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427350784:0@lo:400:kworker.0 00010000:00080000:2.0:1789635415.462021:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0550bf9c00 x1876568427351296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635415.462031:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427351296:0@lo:400:kworker.0 00010000:00080000:2.0:1789635415.462042:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0550bf9180 x1876568427351808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635415.462050:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1876568427351808:0@lo:400:kworker.0 00000100:00100000:2.0:1789635415.462059:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543295180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876568427350656:0@lo:400:kworker.0 00000100:00100000:2.0:1789635415.462067:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1876568427351168:0@lo:400:kworker.0 00000100:00100000:2.0:1789635415.462077:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1876568427351680:0@lo:400:kworker.0 00000100:00100000:2.0:1789635415.462105:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427351040 00000100:00100000:2.0:1789635415.462108:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427351040 00000100:00100000:2.0:1789635415.462129:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1789635415.462134:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427351040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635415.462164:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427351040:12345-0@lo:400:kworker.0 Request processed in 29us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635415.462170:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1789635415.462196:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0446c3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427351040:0@lo:400:kworker.0 00000100:00100000:2.0:1789635415.462206:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427351552:0@lo:400:kworker.0 00000100:00100000:2.0:1789635415.462214:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427350912:0@lo:400:kworker.0 00000100:00100000:2.0:1789635415.462222:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427351424:0@lo:400:kworker.0 00000100:00100000:2.0:1789635415.462230:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427351936:0@lo:400:kworker.0 00000100:00100000:3.0:1789635415.462899:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427350528 00000100:00100000:3.0:1789635415.462906:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427350528 00000100:00100000:3.0:1789635415.462947:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1789635415.462955:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3640:x1876568427350528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635415.463001:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3640:x1876568427350528:12345-0@lo:400:kworker.0 Request processed in 47us (1466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635415.463008:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000001:00080000:3.0:1789635415.466586:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:3.0:1789635415.466647:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1789635415.471265:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427352064:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789635415.471477:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427350528:0@lo:400:kworker.0 00000100:00100000:0.0:1789635415.484247:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635415.485199:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427352064 00000100:00100000:1.0:1789635415.485212:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427352064 00000100:00100000:1.0:1789635415.485266:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789635415.485276:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05412af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427352064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789635415.485304:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789635415.485368:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05412af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427352064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635415.485375:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789635415.485909:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427352064:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789635416.228566:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635416.484399:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789635416.484422:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427352192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789635416.484514:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635416.484840:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427352192 00000100:00100000:3.0:1789635416.484858:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427352192 00000100:00100000:3.0:1789635416.484923:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789635416.484933:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427352192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789635416.484963:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635416.485037:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427352192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635416.485045:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789635416.485074:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1789635416.485082:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:1.0:1789635416.485099:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d0550660380, transno 4294967305 00000100:00100000:1.0:1789635416.485134:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427352192:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1789635416.487080:0:6493:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:1.0:1789635416.487121:0:6493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1789635416.487145:0:6493:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d0446df50c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1789635416.487161:0:6493:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d04477a4c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d0446df5480 00000020:00080000:1.0:1789635416.487164:0:6493:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d04477a4700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d0446d3c200 00000020:00080000:1.0:1789635416.487181:0:6493:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1789635416.487292:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000100:00100000:2.0:1789635416.487309:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789635416.487326:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427352320:0@lo:2:osp-syn-1-0.0 00000020:00080000:0.0:1789635416.487384:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:2.0:1789635416.487398:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635416.487451:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427352320 00000100:00100000:0.0:1789635416.487464:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427352320 00000100:00100000:0.0:1789635416.487553:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789635416.487565:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3642:x1876568427352320:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1789635416.487764:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1aa00/0xb0c3a59caa40f866 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635416.487785:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1aa00/0xb0c3a59caa40f866 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635416.487792:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1aa00/0xb0c3a59caa40f866 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635416.487798:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1aa00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635416.487803:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1aa00/0xb0c3a59caa40f866 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635416.487810:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1aa00/0xb0c3a59caa40f866 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635416.487827:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d0544e2ec00) 00010000:00010000:3.0:1789635416.487831:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635416.487836:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1aa00/0xb0c3a59caa40f866 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635416.487842:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1aa00/0xb0c3a59caa40f866 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789635416.488074:0:10116:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789635416.488079:0:10116:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1789635410 -> 1789635410 00002000:00010000:0.0:1789635416.488082:0:10116:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 1789635409 -> 1789635409 00002000:00010000:0.0:1789635416.488084:0:10116:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1789635410 -> 1789635410 00002000:00010000:0.0:1789635416.488087:0:10116:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000001:00080000:3.0:1789635416.488132:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:3.0:1789635416.488144:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000100:00100000:0.0:1789635416.488182:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3642:x1876568427352320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 617us (784us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1789635416.488190:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:2.0:1789635416.489865:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d0448598000/2, rc 0, transno 4294967313 00000100:00100000:2.0:1789635416.489879:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427352320:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789635416.996755:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427352448:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789635416.996828:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635416.996886:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427352448 00000100:00100000:2.0:1789635416.996896:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427352448 00000100:00100000:2.0:1789635416.996946:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789635416.996955:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05412ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427352448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789635416.996977:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635416.997019:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05412ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427352448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635416.997025:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789635416.998346:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427352448:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789635417.252828:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635418.277515:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635418.535830:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789635418.535863:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05412af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427352576:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789635418.535962:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635418.536292:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427352576 00000100:00100000:2.0:1789635418.536302:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427352576 00000100:00100000:2.0:1789635418.536355:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1789635418.536366:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05677d2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427352576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789635418.536415:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789635418.536464:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427352704:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789635418.536490:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05677d2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427352576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635418.536498:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789635418.536510:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635418.536902:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427352704 00000100:00100000:1.0:1789635418.536908:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427352704 00000100:00100000:1.0:1789635418.536933:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789635418.536941:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0558968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427352704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789635418.536962:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789635418.539349:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05412af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427352576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789635418.539658:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0558968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427352704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2708us (3137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635418.539671:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789635418.539737:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427352704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789635418.565738:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635418.565868:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635418.565909:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635418.565934:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635418.565956:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635418.565977:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635418.566002:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635418.566036:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411545472 00000100:00100000:1.0:1789635418.566050:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411545472 00000100:00100000:2.0:1789635418.566065:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411544960 00000100:00100000:2.0:1789635418.566070:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411544960 00000100:00100000:1.0:1789635418.566120:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411545344 00000100:00100000:1.0:1789635418.566123:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411545344 00000100:00100000:2.0:1789635418.566125:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 396 00000100:00100000:2.0:1789635418.566136:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2398:x1876568411544960:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789635418.566147:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 129 00000100:00100000:1.0:1789635418.566155:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2398:x1876568411545472:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635418.566284:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411545216 00000100:00100000:0.0:1789635418.566288:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411545216 00000100:00100000:0.0:1789635418.566321:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411545728 00000100:00100000:0.0:1789635418.566324:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411545728 00000100:00100000:0.0:1789635418.566338:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411545088 00000100:00100000:0.0:1789635418.566341:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411545088 00000100:00100000:0.0:1789635418.566352:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411545600 00000100:00100000:0.0:1789635418.566355:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411545600 00000100:00100000:0.0:1789635418.566370:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 349 00000100:00100000:0.0:1789635418.566376:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411545216:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789635418.566649:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2398:x1876568411545472:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 495us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635418.566666:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 129 00000100:00100000:1.0:1789635418.566687:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 130 00000100:00100000:1.0:1789635418.566694:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0558849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411545344:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635418.569060:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2398:x1876568411544960:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 2909us (3319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635418.569060:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411545216:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 2667us (3176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635418.569078:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 396 00000100:00100000:0.0:1789635418.569087:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 349 00000100:00100000:0.0:1789635418.569127:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 350 00000100:00100000:0.0:1789635418.569142:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411545728:12345-192.168.203.20@tcp:400:kworker.0 00000100:00080000:2.0:1789635418.569143:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789635418.569149:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789635418.569153:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789635418.569156:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789635418.569212:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411545728:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 77us (3276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635418.569218:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 350 00000100:00100000:0.0:1789635418.569232:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 351 00000100:00100000:0.0:1789635418.569239:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+13:2398:x1876568411545088:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635418.569404:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+13:2398:x1876568411545088:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 165us (3445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635418.569421:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 351 00000100:00100000:0.0:1789635418.569436:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 352 00000100:00100000:0.0:1789635418.569444:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d055884b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411545600:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635418.569486:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d055884b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411545600:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 32us (3472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635418.569493:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 352 00000100:00100000:1.0:1789635418.569975:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0558849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411545344:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 3278us (3993us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635418.569987:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 130 00000100:00100000:3.0:1789635418.894658:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635418.894699:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411545856 00000100:00100000:3.0:1789635418.894711:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411545856 00000100:00100000:3.0:1789635418.894760:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 147 00000100:00100000:3.0:1789635418.894769:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+13:11078:x1876568411545856:12345-192.168.203.20@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789635418.894865:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+13:11078:x1876568411545856:12345-192.168.203.20@tcp:60:lhsmtool_posix.0 Request processed in 97us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635418.894883:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 147 00000100:00100000:1.0:1789635418.899561:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635418.899715:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411545984 00000100:00100000:3.0:1789635418.899731:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411545984 00000100:00100000:3.0:1789635418.899825:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 148 00000100:00100000:3.0:1789635418.899837:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0558848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:11078:x1876568411545984:12345-192.168.203.20@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789635418.899984:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0558848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:11078:x1876568411545984:12345-192.168.203.20@tcp:60:lhsmtool_posix.0 Request processed in 149us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635418.899992:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 148 00000100:00100000:2.0:1789635418.905978:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635418.906231:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411546240 00000100:00100000:1.0:1789635418.906242:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411546240 00000100:00100000:1.0:1789635418.906296:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 35 00000100:00100000:1.0:1789635418.906306:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+13:11078:x1876568411546240:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789635418.906593:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+14:11078:x1876568411546240:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 288us (623us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1789635418.906619:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 35 00010000:00010000:2.0:1789635419.300850:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789635420.195900:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789635420.195913:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789635420.196026:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1789635420.196034:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789635420.323906:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789635420.389530:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789635420.580019:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427353216:0@lo:400:kworker.0 00000100:00100000:3.0:1789635420.580044:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0558969500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427352832:0@lo:400:kworker.0 00000100:00100000:1.0:1789635420.580823:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0558968e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427352960:0@lo:400:kworker.0 00000100:00100000:3.0:1789635420.582753:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635420.582844:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d054121b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876568427353344:0@lo:400:kworker.0 00000100:00100000:3.0:1789635420.582890:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635420.582916:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427353856:0@lo:400:kworker.0 00000100:00100000:3.0:1789635420.582944:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635420.582965:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427354368:0@lo:400:kworker.0 00000100:00100000:3.0:1789635420.582986:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635420.583053:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427352832 00000100:00100000:3.0:1789635420.583065:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427352832 00000100:00100000:3.0:1789635420.583128:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1789635420.583139:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3643:x1876568427352832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635420.583209:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3643:x1876568427352832:12345-0@lo:400:kworker.0 Request processed in 71us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635420.583218:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1789635420.583266:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427353856 00000100:00100000:3.0:1789635420.583284:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427353856 00000100:00100000:3.0:1789635420.583332:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427354368 00000100:00100000:3.0:1789635420.583336:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427354368 00000100:00100000:3.0:1789635420.583361:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789635420.583369:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427353856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635420.583405:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427353856:12345-0@lo:400:kworker.0 Request processed in 38us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635420.583411:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789635420.583423:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789635420.583429:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1876568427354368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635420.583469:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1876568427354368:12345-0@lo:400:kworker.0 Request processed in 29us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635420.583475:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1789635420.583501:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789635420.583506:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789635420.583542:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0558969500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427352832:0@lo:400:kworker.0 00000100:00100000:3.0:1789635420.583558:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427353856:0@lo:400:kworker.0 00000100:00100000:3.0:1789635420.583566:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1789635420.583572:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d04467ba680, transno 4294967310 00000004:00080000:3.0:1789635420.583583:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1789635420.583630:0:3643:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8d0448598000 x1876568427352320/t4294967313(4294967313) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789635432 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635420.583641:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427354368:0@lo:400:kworker.0 00000100:00100000:3.0:1789635420.583821:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427353088:0@lo:400:kworker.0 00000100:00100000:3.0:1789635420.583856:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635420.583893:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1876568427353600:0@lo:400:kworker.0 00000100:00100000:3.0:1789635420.583920:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635420.583940:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1876568427354112:0@lo:400:kworker.0 00000100:00100000:3.0:1789635420.583960:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635420.583977:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427354624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789635420.584001:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635420.584036:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427353088 00000100:00100000:3.0:1789635420.584041:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427353088 00000100:00100000:3.0:1789635420.584071:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1789635420.584078:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427353088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635420.584119:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427353088:12345-0@lo:400:kworker.0 Request processed in 41us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635420.584127:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1789635420.584146:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427353344 00000100:00100000:3.0:1789635420.584149:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427353344 00000100:00100000:3.0:1789635420.584173:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427353600 00000100:00100000:3.0:1789635420.584176:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427353600 00000100:00100000:3.0:1789635420.584195:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427354112 00000100:00100000:3.0:1789635420.584198:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427354112 00000100:00100000:3.0:1789635420.584213:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1789635420.584218:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575adb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876568427353344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635420.584261:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575adb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876568427353344:12345-0@lo:400:kworker.0 Request processed in 42us (1371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635420.584269:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1789635420.584285:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1789635420.584294:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876568427353600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635420.584334:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876568427353600:12345-0@lo:400:kworker.0 Request processed in 41us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635420.584352:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1789635420.584375:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1789635420.584382:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876568427354112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635420.584432:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876568427354112:12345-0@lo:400:kworker.0 Request processed in 48us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635420.585164:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635420.585338:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427353728:0@lo:400:kworker.0 00000100:00100000:0.0:1789635420.585373:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635420.585393:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427354240:0@lo:400:kworker.0 00000100:00100000:0.0:1789635420.585415:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635420.585471:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427353216 00000100:00100000:0.0:1789635420.585477:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427353216 00000100:00100000:0.0:1789635420.585531:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789635420.585547:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427353216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635420.585625:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427353216:12345-0@lo:400:kworker.0 Request processed in 84us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635420.585633:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789635420.585664:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427353728 00000100:00100000:0.0:1789635420.585679:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427353728 00000100:00100000:0.0:1789635420.585725:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427354240 00000100:00100000:0.0:1789635420.585728:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427354240 00000100:00100000:0.0:1789635420.585756:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789635420.585763:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427353728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635420.585798:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427353728:12345-0@lo:400:kworker.0 Request processed in 35us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635420.585804:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789635420.585815:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789635420.585822:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427354240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635420.585848:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427354240:12345-0@lo:400:kworker.0 Request processed in 26us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635420.585854:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789635420.586685:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427354624 00000100:00100000:2.0:1789635420.586701:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427354624 00000100:00100000:2.0:1789635420.586833:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789635420.586842:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0558969500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1876568427354624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789635420.586877:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789635420.587024:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0558969500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1876568427354624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 183us (3021us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635420.587031:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789635420.587089:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427353088:0@lo:400:kworker.0 00010000:00080000:2.0:1789635420.587107:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447ac1180 x1876568427353600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635420.587140:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1876568427353600:0@lo:400:kworker.0 00010000:00080000:2.0:1789635420.587158:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447ac3480 x1876568427354112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635420.587167:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1876568427354112:0@lo:400:kworker.0 00000100:00100000:2.0:1789635420.587186:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427354624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789635420.587393:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427353216:0@lo:400:kworker.0 00000100:00100000:0.0:1789635420.587410:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427353728:0@lo:400:kworker.0 00000100:00100000:0.0:1789635420.587423:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427354240:0@lo:400:kworker.0 00000100:00080000:0.0:1789635420.587520:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789635420.587526:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789635420.587530:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789635420.589889:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635420.589944:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427353472:0@lo:400:kworker.0 00000100:00100000:1.0:1789635420.589976:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635420.590023:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427352960 00000100:00100000:1.0:1789635420.590031:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427352960 00000100:00100000:1.0:1789635420.590074:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427353472 00000100:00100000:1.0:1789635420.590077:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427353472 00000100:00100000:1.0:1789635420.590106:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1789635420.590115:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05489cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427352960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635420.590180:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05489cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427352960:12345-0@lo:400:kworker.0 Request processed in 65us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635420.590187:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1789635420.590205:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1789635420.590212:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05489c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427353472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635420.590242:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05489c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427353472:12345-0@lo:400:kworker.0 Request processed in 31us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635420.590248:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00080000:1.0:1789635420.590269:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635420.590297:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427353472:0@lo:400:kworker.0 00000100:00100000:1.0:1789635420.590305:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427353984:0@lo:400:kworker.0 00000100:00100000:1.0:1789635420.590328:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635420.590347:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427353984 00000100:00100000:1.0:1789635420.590351:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427353984 00000100:00100000:1.0:1789635420.590377:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789635420.590385:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05489c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427353984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635420.590416:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05489c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427353984:12345-0@lo:400:kworker.0 Request processed in 33us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635420.590422:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00080000:1.0:1789635420.590438:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635420.590453:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427353984:0@lo:400:kworker.0 00000100:00100000:1.0:1789635420.590473:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427354496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789635420.590500:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635420.590522:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427354496 00000100:00100000:1.0:1789635420.590525:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427354496 00000100:00100000:1.0:1789635420.590557:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789635420.590562:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05489c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427354496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789635420.590579:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789635420.590629:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05489c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427354496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635420.590635:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789635420.590663:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427354496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789635420.590693:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0558968e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427352960:0@lo:400:kworker.0 00000100:00100000:2.0:1789635420.596880:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d054121b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876568427353344:0@lo:400:kworker.0 00000100:00100000:3.0:1789635420.600440:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000001:02000400:0.0:1789635421.326292:0:14462:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 04:56:59 (1789635419) 00010000:00010000:1.0:1789635421.349524:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635421.608922:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789635421.608947:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0558968e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427354752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789635421.609019:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635421.609118:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427354752 00000100:00100000:0.0:1789635421.609127:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427354752 00000100:00100000:0.0:1789635421.609181:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789635421.609192:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448599f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427354752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789635421.609293:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789635421.609365:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448599f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427354752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 175us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635421.609372:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789635421.609474:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0558968e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427354752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635422.117965:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427354880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789635422.118033:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635422.118480:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427354880 00000100:00100000:2.0:1789635422.118490:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427354880 00000100:00100000:2.0:1789635422.118567:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789635422.118578:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0558968e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427354880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789635422.118633:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635422.118678:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0558968e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427354880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635422.118686:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789635422.118839:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427354880:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789635422.118957:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789635422.121964:0:6493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:1.0:1789635422.121978:0:6493:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1789635422.122118:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1789635422.122127:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:3.0:1789635422.122625:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00010000:00010000:2.0:1789635422.372521:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635423.031734:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635423.031890:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411546496 00000100:00100000:0.0:1789635423.031900:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411546496 00000100:00100000:0.0:1789635423.031976:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 149 00000100:00100000:0.0:1789635423.031990:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05489c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+13:12137:x1876568411546496:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789635423.032013:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635423.032035:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f8f2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab741a3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.032107:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f8f9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.032121:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f8f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.032132:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f8f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.032172:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f900 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.032181:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f900 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.032188:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f900 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.032290:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f907 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.032300:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f907 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.032307:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f907 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635423.032316:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1789635423.032394:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f8f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.032415:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f8f9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.032422:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f8f9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.032428:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1a400 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635423.032432:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f8f9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.032446:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f8f9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.032459:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d056f407a00) 00010000:00010000:0.0:1789635423.032462:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635423.032467:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f8f9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.032484:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f8f9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.032498:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f900 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.032503:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f900 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.032509:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f900 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.032513:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1b600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635423.032516:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f900 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.032522:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f900 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.032529:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d0447667b00) 00010000:00010000:0.0:1789635423.032532:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635423.032534:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f900 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.032539:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40f900 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.032963:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40f8f2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741a3 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.032978:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f907 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741a3 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.032993:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d044766d300) 00010000:00010000:0.0:1789635423.032995:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635423.032998:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1a600, rc 0) 00000100:00100000:0.0:1789635423.033063:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05489c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+15:12137:x1876568411546496:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 1077us (1338us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1789635423.033071:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 149 00000100:00080000:1.0:1789635423.033511:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635423.042019:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635423.045458:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635423.045653:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411546752 00000100:00100000:0.0:1789635423.045663:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411546752 00000100:00100000:0.0:1789635423.045737:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:0.0:1789635423.045748:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b407c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+15:2399:x1876568411546752:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789635423.045933:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635423.045958:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40f907 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741a3 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.045977:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d044766d300) 00010000:00010000:0.0:1789635423.045982:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635423.046045:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b407c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+14:2399:x1876568411546752:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 299us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635423.046053:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:2.0:1789635423.047833:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411546624 00000100:00100000:2.0:1789635423.047848:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411546624 00000100:00100000:2.0:1789635423.047908:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 150 00000100:00100000:2.0:1789635423.047918:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05489cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+14:12137:x1876568411546624:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789635423.048031:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05489cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+14:12137:x1876568411546624:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 Request processed in 115us (6020us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635423.048038:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 150 00000100:00100000:1.0:1789635423.052070:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635423.052207:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411546880 00000100:00100000:3.0:1789635423.052218:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411546880 00000100:00100000:3.0:1789635423.052292:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 151 00000100:00100000:3.0:1789635423.052303:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05489ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:12137:x1876568411546880:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1789635423.052855:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789635423.053662:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05489ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:12137:x1876568411546880:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 Request processed in 1354us (1596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635423.053673:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 151 00000040:00080000:0.0:1789635423.270755:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789635423.270764:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789635423.270784:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1789635423.270792:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789635423.400701:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789635423.460220:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789635423.651906:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789635423.651928:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427355008:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789635423.651987:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635423.652201:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427355008 00000100:00100000:0.0:1789635423.652219:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427355008 00000100:00100000:0.0:1789635423.652261:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789635423.652269:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427355008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789635423.652299:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789635423.652338:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427355008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635423.652344:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789635423.652399:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789635423.652408:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427355136:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789635423.652433:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635423.652515:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427355008:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789635423.656626:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427355136 00000100:00100000:0.0:1789635423.656642:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427355136 00000100:00100000:0.0:1789635423.656715:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789635423.656726:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05489ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427355136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789635423.656761:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789635423.656845:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05489ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427355136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (4410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635423.656852:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789635423.656903:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427355136:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789635423.673397:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635423.673972:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411547008 00000100:00100000:3.0:1789635423.673983:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411547008 00000100:00100000:3.0:1789635423.674058:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 398 00000100:00100000:3.0:1789635423.674067:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2397:x1876568411547008:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789635423.674287:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635423.674777:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2397:x1876568411547008:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 710us (1387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635423.674787:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 398 00000100:00100000:3.0:1789635423.674850:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635423.674928:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635423.674948:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411547136 00000100:00100000:3.0:1789635423.674953:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411547136 00000100:00100000:3.0:1789635423.675027:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411547264 00000100:00100000:3.0:1789635423.675030:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411547264 00000100:00100000:3.0:1789635423.675050:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 135 00000100:00100000:3.0:1789635423.675056:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05489c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2397:x1876568411547136:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635423.675101:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05489c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2397:x1876568411547136:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 45us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635423.675108:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 135 00000100:00100000:3.0:1789635423.675119:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 136 00000100:00100000:3.0:1789635423.675124:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2397:x1876568411547264:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635423.675143:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2397:x1876568411547264:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 19us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635423.675148:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 136 00000100:00080000:3.0:1789635423.675160:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789635423.675164:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789635423.676266:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635423.676314:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411547520 00000100:00100000:3.0:1789635423.676324:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411547520 00000100:00100000:3.0:1789635423.676398:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411547392 00000100:00100000:3.0:1789635423.676401:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411547392 00000100:00100000:3.0:1789635423.676431:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 359 00000100:00100000:3.0:1789635423.676459:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2397:x1876568411547520:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635423.676689:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2397:x1876568411547520:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 231us (1759us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635423.676715:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 359 00000100:00100000:3.0:1789635423.676735:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 360 00000100:00100000:3.0:1789635423.676742:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447a84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2396:x1876568411547392:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635423.676775:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447a84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2396:x1876568411547392:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 34us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635423.676781:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 360 00000100:00080000:3.0:1789635423.676803:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789635423.676807:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789635424.420635:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635425.079872:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635425.079953:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411547648 00000100:00100000:0.0:1789635425.079964:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411547648 00000100:00100000:0.0:1789635425.080032:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 152 00000100:00100000:0.0:1789635425.080045:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447af3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+14:12180:x1876568411547648:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1789635425.080067:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635425.080086:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1aa00/0xb0c3a59caa40f915 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab741aa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.080152:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40f91c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.080180:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40f91c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.080192:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40f91c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.080209:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f923 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.080217:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f923 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.080224:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f923 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.080264:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40f91c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.080271:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40f91c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.080278:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40f91c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.080285:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1a800 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635425.080288:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40f91c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.080296:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40f91c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.080308:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d044766dc00) 00010000:00010000:0.0:1789635425.080316:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635425.080322:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40f91c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.080330:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40f91c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.080345:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f923 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.080351:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f923 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.080357:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f923 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.080362:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1a200 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635425.080365:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f923 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.080371:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f923 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.080379:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d0447667d00) 00010000:00010000:0.0:1789635425.080382:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635425.080385:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f923 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.080391:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40f923 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.080420:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1aa00/0xb0c3a59caa40f915 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741aa expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.080457:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d044766dc00) 00010000:00010000:0.0:1789635425.080460:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635425.080464:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1aa00/0xb0c3a59caa40f915 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741aa expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.080475:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1aa00, rc 0) 00000100:00100000:0.0:1789635425.080532:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447af3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+14:12180:x1876568411547648:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 491us (669us total) trans 0 rc 301/301 00000100:00100000:0.0:1789635425.080540:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 152 00000100:00080000:3.0:1789635425.080623:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635425.090728:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635425.090973:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411547904 00000100:00100000:2.0:1789635425.090984:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411547904 00000100:00100000:2.0:1789635425.091038:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 153 00000100:00100000:2.0:1789635425.091048:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447af1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+14:12180:x1876568411547904:12345-192.168.203.20@tcp:36:lfs.0 00010000:00010000:2.0:1789635425.091103:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635425.091128:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139cc00/0xb0c3a59caa40f277 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fd5 expref: 14 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.091149:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d044766dc00) 00010000:00010000:2.0:1789635425.091162:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789635425.091229:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f92a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.091242:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f92a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.091253:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f92a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.091265:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f931 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.091287:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f931 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.091295:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f931 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.092103:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f938 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.092116:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f938 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.092124:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f938 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789635425.092140:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000229fbd9d reply state 000000007b6c574f transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f938 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.092151:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f938 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.092158:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d0544e2e500) 00010000:00010000:2.0:1789635425.092161:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789635425.092164:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789635425.092169:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789635425.092176:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f92a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.092183:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f92a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.092190:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f92a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.092202:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540031400 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635425.092207:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f92a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.092215:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f92a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.092225:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0544e2ed00) 00010000:00010000:2.0:1789635425.092227:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635425.092231:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f92a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.092237:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f92a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789635425.092252:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000229fbd9d reply state 000000007b6c574f transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f931 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.092260:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f931 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.092266:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d0544e2e800) 00010000:00010000:2.0:1789635425.092268:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789635425.092271:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789635425.092411:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447af1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+15:12180:x1876568411547904:12345-192.168.203.20@tcp:36:lfs.0 Request processed in 1362us (1691us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1789635425.092419:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 153 00000100:00100000:0.0:1789635425.222547:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635425.222937:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411548032 00000100:00100000:2.0:1789635425.222947:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411548032 00000100:00100000:2.0:1789635425.223008:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 154 00000100:00100000:2.0:1789635425.223030:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+15:12188:x1876568411548032:12345-192.168.203.20@tcp:101:lctl.0 00010000:00010000:2.0:1789635425.223052:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635425.223083:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f93f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab741b1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.223145:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f946 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.223158:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f946 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.223170:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f946 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635425.223211:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789635425.223215:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789635425.223237:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f946 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.223260:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f93f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741b1 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.223279:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f946 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741b1 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.223287:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0544e2ed00) 00010000:00010000:2.0:1789635425.223290:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789635425.223293:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0540031800, rc 0) 00000100:00100000:2.0:1789635425.223354:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+16:12188:x1876568411548032:12345-192.168.203.20@tcp:101:lctl.0 Request processed in 326us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635425.223370:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 154 00000100:00100000:0.0:1789635425.315247:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635425.315348:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411548160 00000100:00100000:3.0:1789635425.315369:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411548160 00000100:00100000:3.0:1789635425.315448:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 155 00000100:00100000:3.0:1789635425.315460:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d055884bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+16:12194:x1876568411548160:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:3.0:1789635425.315488:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635425.315515:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff400/0xb0c3a59caa40f94d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab741b8 expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.315633:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa40f954 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.315649:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa40f954 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.315662:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa40f954 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.315695:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40f95b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.315702:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40f95b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.315709:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40f95b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.315815:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff800/0xb0c3a59caa40f962 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.315824:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff800/0xb0c3a59caa40f962 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.315830:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff800/0xb0c3a59caa40f962 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635425.315873:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789635425.315876:0:10094:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789635425.315900:0:10094:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff800/0xb0c3a59caa40f962 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.315913:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa40f954 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.315919:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa40f954 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.315926:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa40f954 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.315942:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488ffe00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635425.315947:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa40f954 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.315955:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa40f954 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.315969:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0544e2ed00) 00010000:00010000:3.0:1789635425.315972:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635425.315976:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa40f954 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.315982:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa40f954 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.315996:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40f95b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.316001:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40f95b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.316007:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40f95b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.316011:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488ff600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635425.316014:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40f95b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.316018:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40f95b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.316035:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d0544e2e800) 00010000:00010000:3.0:1789635425.316037:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635425.316040:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40f95b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.316046:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40f95b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.316073:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff400/0xb0c3a59caa40f94d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741b8 expref: 18 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.316090:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff800/0xb0c3a59caa40f962 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741b8 expref: 17 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.316097:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d0544e2e500) 00010000:00010000:3.0:1789635425.316099:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789635425.316101:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05488ff800, rc 0) 00000100:00100000:3.0:1789635425.316176:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d055884bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+17:12194:x1876568411548160:12345-192.168.203.20@tcp:101:bash.0 Request processed in 719us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635425.316184:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 155 00000100:00100000:3.0:1789635425.325183:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635425.325515:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411548416 00000100:00100000:2.0:1789635425.325529:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411548416 00000100:00100000:2.0:1789635425.325659:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 156 00000100:00100000:2.0:1789635425.325672:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447af2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+17:12194:x1876568411548416:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1789635425.325693:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635425.325714:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f969 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab741bf expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.325812:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f970 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.325827:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f970 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.325839:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f970 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.325894:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f977 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.325901:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f977 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.325908:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f977 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789635425.326229:0:9526:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1789635425.326353:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f97e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.326375:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f97e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.326383:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f97e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.326419:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f970 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.326436:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f970 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.326443:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f970 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.326448:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540030a00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635425.326452:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f970 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.326459:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f970 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.326471:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d0544e2e500) 00010000:00010000:2.0:1789635425.326475:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635425.326479:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f970 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.326485:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40f970 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789635425.326500:0:9526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f645e167 reply state 00000000162d4d72 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f977 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.326519:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f977 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.326525:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d0544e2e900) 00010000:00010000:2.0:1789635425.326527:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789635425.326530:0:9526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789635425.326561:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40f969 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741bf expref: 20 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.326577:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f97e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741bf expref: 19 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.326584:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2eb00) 00010000:00010000:2.0:1789635425.326587:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789635425.326589:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a3800, rc 0) 00000100:00100000:2.0:1789635425.326712:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447af2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+20:12194:x1876568411548416:12345-192.168.203.20@tcp:101:bash.0 Request processed in 1044us (1541us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1789635425.326721:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 156 00000100:00100000:0.0:1789635425.336673:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635425.337726:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411548544 00000100:00100000:3.0:1789635425.337745:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411548544 00000100:00100000:3.0:1789635425.337866:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:3.0:1789635425.337879:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0558848e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2397:x1876568411548544:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:3.0:1789635425.337905:0:10116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635425.337935:0:10116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008864ad8d/0xb0c3a59caa40f98c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab741c6 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789635425.337987:0:10116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789635425.338016:0:10116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1789635425.338022:0:10116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635425.338034:0:10116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008864ad8d/0xb0c3a59caa40f98c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741c6 expref: 6 pid: 10116 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.338058:0:10116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008864ad8d/0xb0c3a59caa40f98c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741c6 expref: 6 pid: 10116 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.338075:0:10116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05488ff400, rc 0) 00000100:00100000:3.0:1789635425.338174:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0558848e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2397:x1876568411548544:12345-192.168.203.20@tcp:101:bash.0 Request processed in 298us (1510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635425.338181:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00080000:0.0:1789635425.338793:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789635425.347827:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635425.348640:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411548672 00000100:00100000:0.0:1789635425.348656:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411548672 00000100:00100000:0.0:1789635425.348728:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 56 00000100:00100000:0.0:1789635425.348737:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447af1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:12194:x1876568411548672:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:0.0:1789635425.348755:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635425.348772:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7215836/0xb0c3a59caa40f993 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab741cd expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.348803:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008864ad8d/0xb0c3a59caa40f98c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741c6 expref: 7 pid: 10116 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.348812:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635425.348829:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635425.348835:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7215836/0xb0c3a59caa40f993 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741cd expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.348870:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008864ad8d/0xb0c3a59caa40f98c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741c6 expref: 7 pid: 10116 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.348883:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008864ad8d/0xb0c3a59caa40f98c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741c6 expref: 7 pid: 10116 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635425.348897:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1876568427355264:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789635425.348983:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446df5540 going to sleep for 11 seconds 00000100:00100000:0.0:1789635425.352321:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1876568427355264:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789635425.352364:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a7215836/0xb0c3a59caa40f993 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741cd expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.352394:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1a800, rc 0) 00000100:00100000:0.0:1789635425.352482:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447af1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:12194:x1876568411548672:12345-192.168.203.20@tcp:101:bash.0 Request processed in 3745us (4669us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635425.352490:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 56 00000100:00100000:0.0:1789635425.353101:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635425.353653:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411548800 00000100:00100000:1.0:1789635425.353663:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411548800 00010000:00010000:1.0:1789635425.353704:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008864ad8d/0xb0c3a59caa40f98c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741c6 expref: 7 pid: 10116 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635425.353760:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 79 00000100:00100000:1.0:1789635425.353769:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:2397:x1876568411548800:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635425.353783:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635425.353803:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008864ad8d/0xb0c3a59caa40f98c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741c6 expref: 7 pid: 10116 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635425.353816:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008864ad8d/0xb0c3a59caa40f98c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741c6 expref: 7 pid: 10116 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635425.353837:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008864ad8d/0xb0c3a59caa40f98c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741c6 expref: 7 pid: 10116 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635425.353849:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635425.353853:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635425.353861:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a7215836/0xb0c3a59caa40f993 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741cd expref: 6 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635425.353870:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7215836/0xb0c3a59caa40f993 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741cd expref: 6 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635425.353903:0:6501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a7215836/0xb0c3a59caa40f993 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741cd expref: 6 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635425.353917:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05489c8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6501:1876568427355392:192.168.203.20@tcp:105: 00000100:00100000:1.0:1789635425.354000:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0575963c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789635425.362054:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635425.362507:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411549056 00000100:00100000:2.0:1789635425.362524:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411549056 00000100:00100000:2.0:1789635425.362642:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 36 00000100:00100000:2.0:1789635425.362656:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+20:12194:x1876568411549056:12345-192.168.203.20@tcp:35:bash.0 00000100:00100000:2.0:1789635425.362966:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+21:12194:x1876568411549056:12345-192.168.203.20@tcp:35:bash.0 Request processed in 313us (927us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1789635425.362975:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 36 00000100:00100000:1.0:1789635425.363109:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05489c8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6501:1876568427355392:192.168.203.20@tcp:105: 00010000:00010000:1.0:1789635425.363136:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635425.363181:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2397:x1876568411548800:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 9413us (10089us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635425.363190:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 79 00010000:00010000:2.0:1789635425.444524:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635425.460911:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635425.461012:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411549312 00000100:00100000:3.0:1789635425.461023:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411549312 00000100:00100000:3.0:1789635425.461090:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 157 00000100:00100000:3.0:1789635425.461101:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+21:12204:x1876568411549312:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789635425.461127:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635425.461146:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40f99a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab741d4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635425.461247:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789635425.461351:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40f99a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741d4 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.461386:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0544e2ed00) 00010000:00010000:3.0:1789635425.461389:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789635425.461395:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40f99a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741d4 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.461409:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05488ff600, rc 0) 00000100:00100000:3.0:1789635425.461680:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+22:12204:x1876568411549312:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 385us (583us total) trans 4294967421 rc 301/301 00000100:00100000:3.0:1789635425.461689:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 157 00000100:00100000:0.0:1789635425.467119:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635425.468577:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411549568 00000100:00100000:1.0:1789635425.468590:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411549568 00000100:00100000:1.0:1789635425.468685:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 37 00000100:00100000:1.0:1789635425.468696:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+22:12204:x1876568411549568:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:1.0:1789635425.468913:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+23:12204:x1876568411549568:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 217us (1804us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1789635425.468920:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 37 00000100:00100000:1.0:1789635425.572743:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635425.572835:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411549696 00000100:00100000:2.0:1789635425.572845:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411549696 00000100:00100000:2.0:1789635425.572907:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 158 00000100:00100000:2.0:1789635425.572919:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05489c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+23:12210:x1876568411549696:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1789635425.572943:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635425.572964:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40f9a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab741db expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.573026:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40f9af lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.573040:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40f9af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.573051:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40f9af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635425.573093:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789635425.573097:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789635425.573115:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40f9af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.573143:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40f9a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741db expref: 25 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.573160:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40f9af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741db expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.573169:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d0544e2e500) 00010000:00010000:2.0:1789635425.573173:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789635425.573190:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a3400, rc 0) 00000100:00100000:2.0:1789635425.573256:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05489c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+24:12210:x1876568411549696:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 340us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635425.573263:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 158 00000100:00100000:3.0:1789635425.578585:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635425.578691:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411549952 00000100:00100000:0.0:1789635425.578702:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411549952 00000100:00100000:0.0:1789635425.578795:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 159 00000100:00100000:0.0:1789635425.578807:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e015880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+24:12210:x1876568411549952:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1789635425.578828:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635425.578849:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ae00/0xb0c3a59caa40f9b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab741e2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.578958:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b800/0xb0c3a59caa40f9bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.578971:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b800/0xb0c3a59caa40f9bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.578982:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b800/0xb0c3a59caa40f9bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635425.578992:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789635425.579082:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ae00/0xb0c3a59caa40f9b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741e2 expref: 27 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.579100:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b800/0xb0c3a59caa40f9bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741e2 expref: 26 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.579108:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2eb00) 00010000:00010000:0.0:1789635425.579111:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789635425.579114:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1b800, rc 0) 00000100:00100000:0.0:1789635425.579170:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e015880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+26:12210:x1876568411549952:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 367us (596us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1789635425.579177:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 159 00000100:00100000:0.0:1789635425.583231:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635425.583497:0:13189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411550336 00000100:00100000:1.0:1789635425.583516:0:13189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411550336 00000100:00100000:1.0:1789635425.583583:0:13189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:1.0:1789635425.583636:0:13189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543290a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+26:2398:x1876568411550336:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635425.583654:0:13189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635425.583679:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b800/0xb0c3a59caa40f9bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741e2 expref: 26 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635425.583701:0:13189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2eb00) 00010000:00010000:1.0:1789635425.583707:0:13189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635425.584003:0:13189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543290a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+25:2398:x1876568411550336:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 410us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635425.584023:0:13189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:1.0:1789635425.585352:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635425.585584:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411550208 00000100:00100000:0.0:1789635425.585592:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411550208 00000100:00100000:0.0:1789635425.585669:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 160 00000100:00100000:0.0:1789635425.585678:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+25:12210:x1876568411550208:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1789635425.585701:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635425.585720:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f9cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab741e9 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.586072:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f9d2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.586087:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f9d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.586097:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f9d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635425.586110:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789635425.586208:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f9cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741e9 expref: 28 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.586227:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f9d2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741e9 expref: 27 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.586236:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2eb00) 00010000:00010000:0.0:1789635425.586239:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789635425.586243:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1a400, rc 0) 00000100:00100000:0.0:1789635425.586286:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+27:12210:x1876568411550208:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 609us (939us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1789635425.586307:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 160 00000100:00100000:0.0:1789635425.591477:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635425.591646:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411550464 00000100:00100000:3.0:1789635425.591657:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411550464 00000100:00100000:3.0:1789635425.591714:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 57 00000100:00100000:3.0:1789635425.591726:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2396:x1876568411550464:12345-192.168.203.20@tcp:1:lfs.0 00010000:00010000:3.0:1789635425.591782:0:10116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8a542fc/0xb0c3a59caa40f9e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.591802:0:10116:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a7215836/0xb0c3a59caa40f993 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741cd expref: 6 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.591811:0:10116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635425.591815:0:10116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789635425.591820:0:10116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8a542fc/0xb0c3a59caa40f9e0 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.592317:0:10116:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a7215836/0xb0c3a59caa40f993 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741cd expref: 6 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.592334:0:10116:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a7215836/0xb0c3a59caa40f993 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741cd expref: 6 pid: 8431 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635425.592349:0:10116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e017b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10116:1876568427355520:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789635425.592440:0:10116:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549fab6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635425.597147:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635425.597299:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411550592 00000100:00100000:2.0:1789635425.597310:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411550592 00002000:00100000:2.0:1789635425.597362:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8d056e016680 x1876568411550592/t0(0) o4->6e1c17f2-a595-4ed0-97c8-b9260d0850ab@192.168.203.20@tcp:46/0 lens 504/0 e 0 to 0 dl 1789635436 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789635425.597374:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d056e016680 with x1876568411550592 ext(0->12) 00010000:00010000:2.0:1789635425.597384:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a7215836/0xb0c3a59caa40f993 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741cd expref: 7 pid: 8431 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.597400:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a7215836/0xb0c3a59caa40f993 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741cd expref: 7 pid: 8431 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789635425.597408:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d056e016680 00000100:00100000:2.0:1789635425.597448:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:2.0:1789635425.597459:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e016680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:2397:x1876568411550592:12345-192.168.203.20@tcp:4:lfs.0 00000100:00100000:0.0:1789635425.598568:0:10116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e017b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10116:1876568427355520:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789635425.598610:0:10116:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a8a542fc/0xb0c3a59caa40f9e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635425.598827:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e016680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+9:2397:x1876568411550592:12345-192.168.203.20@tcp:4:lfs.0 Request processed in 1369us (1689us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789635425.598837:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 2 00002000:00100000:2.0:1789635425.598848:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8d056e016680 x1876568411550592/t4294967306(0) o4->6e1c17f2-a595-4ed0-97c8-b9260d0850ab@192.168.203.20@tcp:46/0 lens 504/448 e 0 to 0 dl 1789635436 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789635425.598858:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d056e016680 with x1876568411550592 ext(0->12) 00010000:00010000:2.0:1789635425.598988:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a7215836/0xb0c3a59caa40f993 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741cd expref: 9 pid: 8431 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.599021:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a7215836/0xb0c3a59caa40f993 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741cd expref: 9 pid: 8431 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789635425.599029:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d056e016680 00000100:00100000:1.0:1789635425.603098:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635425.603952:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411550720 00000100:00100000:2.0:1789635425.603966:0:7457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411550720 00010000:00010000:2.0:1789635425.604013:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a7215836/0xb0c3a59caa40f993 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741cd expref: 9 pid: 8431 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635425.604060:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 80 00000100:00100000:2.0:1789635425.604070:0:7457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+9:2396:x1876568411550720:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635425.604086:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789635425.604104:0:7457:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789635425.604107:0:7457:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789635425 00002000:00010000:2.0:1789635425.604110:0:7457:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789635425 00002000:00010000:2.0:1789635425.604112:0:7457:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1789635425 00002000:00010000:2.0:1789635425.604114:0:7457:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789635425.604122:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a7215836/0xb0c3a59caa40f993 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741cd expref: 9 pid: 8431 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.604136:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a7215836/0xb0c3a59caa40f993 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741cd expref: 9 pid: 8431 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.604159:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7215836/0xb0c3a59caa40f993 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741cd expref: 9 pid: 8431 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.604198:0:7457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789635425.604203:0:7457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789635425.604210:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8a542fc/0xb0c3a59caa40f9e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.604220:0:7457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8a542fc/0xb0c3a59caa40f9e0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.604257:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789635425.604391:0:10116:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a8a542fc/0xb0c3a59caa40f9e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.604402:0:10116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8a542fc/0xb0c3a59caa40f9e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.604429:0:10116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8a542fc/0xb0c3a59caa40f9e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.604439:0:10116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8a542fc/0xb0c3a59caa40f9e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.604447:0:10116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8a542fc/0xb0c3a59caa40f9e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.604454:0:10116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488ffe00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:0.0:1789635425.604459:0:10116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8a542fc/0xb0c3a59caa40f9e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.604490:0:10116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8a542fc/0xb0c3a59caa40f9e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.604510:0:10116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8a542fc/0xb0c3a59caa40f9e0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.604517:0:10116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8a542fc/0xb0c3a59caa40f9e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635425.605189:0:7457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:2396:x1876568411550720:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 1115us (2096us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635425.605198:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 80 00000100:00100000:0.0:1789635425.611020:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:2396:x1876568411550464:12345-192.168.203.20@tcp:1:lfs.0 Request processed in 19282us (19540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635425.611037:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 57 00000100:00100000:2.0:1789635425.621266:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635425.621370:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411550976 00000100:00100000:1.0:1789635425.621380:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411550976 00000100:00100000:1.0:1789635425.621472:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 38 00000100:00100000:1.0:1789635425.621493:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b745450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+27:12210:x1876568411550976:12345-192.168.203.20@tcp:35:lfs.0 00000004:00010000:1.0:1789635425.621561:0:6518:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f9d2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741e9 expref: 27 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789635425.621782:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1789635425.621819:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1789635425.622139:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1789635425.622176:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f9e7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635425.622191:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f97e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741bf expref: 31 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635425.622200:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f9e7 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635425.622237:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f97e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741bf expref: 31 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635425.622251:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f97e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741bf expref: 31 pid: 9526 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635425.622285:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447bfa300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6518:1876568427355648:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789635425.622361:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05452879c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635425.628876:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635425.628911:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411551104 00000100:00100000:3.0:1789635425.628920:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411551104 00010000:00010000:3.0:1789635425.628958:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f97e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741bf expref: 32 pid: 9526 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635425.628995:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 81 00000100:00100000:3.0:1789635425.629006:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e015f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+32:2397:x1876568411551104:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635425.629021:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635425.629027:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f97e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741bf expref: 32 pid: 9526 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.629040:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f97e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741bf expref: 32 pid: 9526 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.629061:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2eb00) 00010000:00010000:3.0:1789635425.629079:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f9e7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.629088:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f9e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.629095:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f9e7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635425.629115:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635425.629164:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e015f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+32:2397:x1876568411551104:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 160us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635425.629172:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 81 00010000:00010000:0.0:1789635425.629665:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40f97e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741bf expref: 31 pid: 9526 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635425.629683:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447bfa300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6518:1876568427355648:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789635425.629702:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f9e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.629722:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f9e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.629728:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f9e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789635425.629842:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:0.0:1789635425.629973:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:0.0:1789635425.630053:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543291c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6518:1876568427355776:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789635425.630100:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635425.630122:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05461be180 going to sleep for 11 seconds 00000100:00100000:3.0:1789635425.630628:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427355776 00000100:00100000:3.0:1789635425.630635:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427355776 00000100:00100000:3.0:1789635425.630685:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789635425.630692:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6518:x1876568427355776:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789635425.630781:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6518:x1876568427355776:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 89us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635425.630788:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:0.0:1789635425.631177:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789635425.631205:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543291c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6518:1876568427355776:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789635425.631317:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:0.0:1789635425.631366:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543291c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6518:1876568427355904:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789635425.631396:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635425.631435:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446df5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789635425.631511:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427355904 00000100:00100000:3.0:1789635425.631516:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427355904 00000100:00100000:3.0:1789635425.631552:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789635425.631559:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6518:x1876568427355904:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789635425.631691:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6518:x1876568427355904:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 132us (293us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789635425.631697:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789635425.631960:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543291c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6518:1876568427355904:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789635425.632007:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1789635425.632041:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f9e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635425.632050:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f9e7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635425.632057:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f9e7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635425.632064:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152e00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635425.632068:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f9e7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635425.632076:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f9e7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635425.632089:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2eb00) 00010000:00010000:1.0:1789635425.632092:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789635425.632096:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f9e7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635425.632102:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40f9e7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789635425.632181:0:6518:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789635425.632253:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1789635425.632265:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 444315668109ns, next at 445315665860ns, rc = 0 00000001:00080000:1.0:1789635425.632271:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:1.0:1789635425.632295:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2eb00) 00010000:00010000:1.0:1789635425.632298:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789635425.632304:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40f9d2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741e9 expref: 35 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635425.632392:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b745450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+34:12210:x1876568411550976:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 10902us (11136us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1789635425.632400:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 38 00000020:00080000:1.0:1789635425.632404:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789635425.635550:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635425.635998:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411551232 00000100:00100000:2.0:1789635425.636009:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411551232 00000100:00100000:2.0:1789635425.636067:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 161 00000100:00100000:2.0:1789635425.636078:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e017b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+34:12210:x1876568411551232:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1789635425.636101:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635425.636122:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f9ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab741f0 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.636174:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f9ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741f0 expref: 35 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.636188:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f9ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741f0 expref: 35 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.636220:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:2.0:1789635425.636223:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789635425.636226:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a3000, rc 0) 00000100:00100000:2.0:1789635425.636288:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e017b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+35:12210:x1876568411551232:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 212us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635425.636295:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 161 00000100:00100000:3.0:1789635425.640072:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635425.640347:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411551488 00000100:00100000:0.0:1789635425.640363:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411551488 00000100:00100000:0.0:1789635425.640461:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 39 00000100:00100000:0.0:1789635425.640641:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05412af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+35:12210:x1876568411551488:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:0.0:1789635425.640970:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05412af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+36:12210:x1876568411551488:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 498us (912us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1789635425.640979:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 39 00000100:00100000:0.0:1789635425.700144:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05412ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427356032:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789635425.700258:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635425.700473:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427356032 00000100:00100000:3.0:1789635425.700485:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427356032 00000100:00100000:3.0:1789635425.700571:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789635425.700583:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427356032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789635425.700639:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789635425.700675:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427356416:0@lo:400:kworker.0 00000100:00100000:3.0:1789635425.700690:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427356032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635425.700697:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789635425.700710:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635425.700731:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1876568427356928:0@lo:400:kworker.0 00000100:00100000:3.0:1789635425.700732:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427356416 00000100:00100000:3.0:1789635425.700735:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427356416 00000100:00100000:2.0:1789635425.700756:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635425.700761:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789635425.700767:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427356416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635425.700772:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427357440:0@lo:400:kworker.0 00000100:00100000:3.0:1789635425.700808:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427356416:12345-0@lo:400:kworker.0 Request processed in 40us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635425.700808:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635425.700815:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789635425.700837:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427356928 00000100:00100000:3.0:1789635425.700840:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427356928 00000100:00100000:2.0:1789635425.700846:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427356416:0@lo:400:kworker.0 00000100:00100000:2.0:1789635425.700864:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789635425.700869:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1789635425.700870:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876568427356288:0@lo:400:kworker.0 00000100:00100000:3.0:1789635425.700875:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876568427356928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635425.700893:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635425.700905:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876568427356928:12345-0@lo:400:kworker.0 Request processed in 31us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635425.700908:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1876568427356800:0@lo:400:kworker.0 00000100:00100000:3.0:1789635425.700911:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1789635425.700922:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427356288 00000100:00100000:3.0:1789635425.700924:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427356288 00000100:00100000:2.0:1789635425.700927:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635425.700939:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427356800 00000100:00100000:3.0:1789635425.700942:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427356800 00000100:00100000:2.0:1789635425.700942:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1876568427357312:0@lo:400:kworker.0 00000100:00100000:3.0:1789635425.700958:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1789635425.700961:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635425.700963:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876568427356288:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1789635425.700978:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447ac3480 x1876568427356928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635425.700989:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1876568427356928:0@lo:400:kworker.0 00000100:00100000:3.0:1789635425.701008:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876568427356288:12345-0@lo:400:kworker.0 Request processed in 45us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635425.701010:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876568427356288:0@lo:400:kworker.0 00000100:00100000:3.0:1789635425.701014:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1789635425.701024:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427357312 00000100:00100000:3.0:1789635425.701026:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427357312 00000100:00100000:2.0:1789635425.701029:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1789635425.701035:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876568427356800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635425.701040:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1789635425.701045:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876568427357312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635425.701070:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876568427356800:12345-0@lo:400:kworker.0 Request processed in 35us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635425.701077:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1789635425.701141:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427357440 00000100:00100000:1.0:1789635425.701146:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427357440 00000100:00100000:1.0:1789635425.701179:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789635425.701186:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427357440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635425.701259:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427356544:0@lo:400:kworker.0 00000100:00100000:0.0:1789635425.701286:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635425.701305:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427357056:0@lo:400:kworker.0 00000100:00100000:0.0:1789635425.701327:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635425.701344:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427357568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789635425.701366:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635425.701404:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05412ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427356032:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789635425.701437:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789635425.701443:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427356160:0@lo:400:kworker.0 00000100:00100000:0.0:1789635425.701474:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635425.701502:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876568427356672:0@lo:400:kworker.0 00000100:00100000:0.0:1789635425.701526:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635425.701543:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d054121b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1876568427357184:0@lo:400:kworker.0 00000100:00100000:0.0:1789635425.701565:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635425.701586:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427357568 00000100:00100000:0.0:1789635425.701589:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427357568 00000100:00100000:0.0:1789635425.701637:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789635425.701644:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05446f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1876568427357568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789635425.701656:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789635425.701688:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05446f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1876568427357568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635425.701694:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789635425.701714:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427356160 00000100:00100000:0.0:1789635425.701718:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427356160 00000100:00100000:0.0:1789635425.701745:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1789635425.701751:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3642:x1876568427356160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635425.701781:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3642:x1876568427356160:12345-0@lo:400:kworker.0 Request processed in 30us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635425.701787:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1789635425.701817:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427356672 00000100:00100000:0.0:1789635425.701820:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427356672 00000100:00100000:0.0:1789635425.701834:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427357184 00000100:00100000:0.0:1789635425.701844:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427357184 00000100:00100000:0.0:1789635425.701868:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1789635425.701874:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05446f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876568427356672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635425.701902:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05446f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876568427356672:12345-0@lo:400:kworker.0 Request processed in 29us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635425.701908:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1789635425.701920:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1789635425.701927:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05446f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876568427357184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635425.701953:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05446f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876568427357184:12345-0@lo:400:kworker.0 Request processed in 27us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635425.701959:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1789635425.701975:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427356544 00000100:00100000:0.0:1789635425.701979:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427356544 00000100:00100000:0.0:1789635425.702002:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789635425.702009:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427356544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635425.702041:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427356544:12345-0@lo:400:kworker.0 Request processed in 33us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635425.702048:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789635425.702075:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427356160:0@lo:400:kworker.0 00000100:00100000:0.0:1789635425.702085:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876568427356672:0@lo:400:kworker.0 00000100:00100000:0.0:1789635425.702093:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d054121b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1876568427357184:0@lo:400:kworker.0 00000100:00100000:0.0:1789635425.702102:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427356544:0@lo:400:kworker.0 00000100:00100000:0.0:1789635425.702111:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1789635425.702116:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d0448598000, transno 4294967313 00000100:00100000:0.0:1789635425.702139:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427357568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789635425.704778:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876568427357312:12345-0@lo:400:kworker.0 Request processed in 3716us (3799us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635425.704797:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00080000:3.0:1789635425.704919:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789635425.704926:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789635425.704931:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789635425.704960:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427357056 00000100:00100000:3.0:1789635425.704971:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427357056 00000100:00100000:3.0:1789635425.705046:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789635425.705054:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543290000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427357056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635425.705145:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543290000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427357056:12345-0@lo:400:kworker.0 Request processed in 91us (3817us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635425.705151:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789635425.705196:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427357056:0@lo:400:kworker.0 00000100:00080000:0.0:1789635425.705623:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789635425.708043:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1876568427356800:0@lo:400:kworker.0 00010000:00080000:2.0:1789635425.708088:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0541218000 x1876568427357312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635425.708102:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1876568427357312:0@lo:400:kworker.0 00000100:00100000:1.0:1789635425.708392:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427357440:12345-0@lo:400:kworker.0 Request processed in 7203us (7579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635425.708405:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789635425.711709:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427357440:0@lo:400:kworker.0 00000100:00100000:3.0:1789635425.715210:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635425.715345:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411551744 00000100:00100000:0.0:1789635425.715359:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411551744 00000100:00100000:0.0:1789635425.715459:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 162 00000100:00100000:0.0:1789635425.715471:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05412aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+36:12220:x1876568411551744:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1789635425.715509:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635425.715534:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f9f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab741f7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635425.715718:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789635425.716052:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f9f5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741f7 expref: 38 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.716070:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0544e2ed00) 00010000:00010000:0.0:1789635425.716073:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789635425.716078:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40f9f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741f7 expref: 38 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.716095:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1b400, rc 0) 00000100:00100000:0.0:1789635425.716172:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05412aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+37:12220:x1876568411551744:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 703us (982us total) trans 4294967435 rc 301/301 00000100:00100000:0.0:1789635425.716180:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 162 00000100:00100000:3.0:1789635425.718846:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635425.719942:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411551872 00000100:00100000:0.0:1789635425.719958:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411551872 00000100:00100000:0.0:1789635425.720034:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 163 00000100:00100000:0.0:1789635425.720044:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05412ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+37:12220:x1876568411551872:12345-192.168.203.20@tcp:34:lfs.0 00010000:00010000:0.0:1789635425.720163:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fa03 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.720185:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fa03 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.720199:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fa03 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.720211:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40fa0a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.720219:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40fa0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.720226:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40fa0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.720323:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fa11 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.720332:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fa11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.720338:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fa11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789635425.720393:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fa11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.720407:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fa03 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.720433:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fa03 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.720439:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fa03 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.720445:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1b600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635425.720450:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fa03 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.720458:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fa03 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.720472:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d0544e2e500) 00010000:00010000:0.0:1789635425.720475:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635425.720480:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fa03 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.720486:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fa03 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.720503:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40fa0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.720509:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40fa0a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.720516:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40fa0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.720521:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1bc00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635425.720530:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40fa0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.720536:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40fa0a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.720544:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d0544e2e900) 00010000:00010000:0.0:1789635425.720546:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635425.720549:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40fa0a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.720556:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40fa0a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.720567:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fa11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.720574:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fa11 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.720580:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fa11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.720585:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1a600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635425.720587:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fa11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.720592:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fa11 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.720634:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:0.0:1789635425.720637:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635425.724769:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fa11 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635425.724797:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fa11 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635425.725317:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05412ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+37:12220:x1876568411551872:12345-192.168.203.20@tcp:34:lfs.0 Request processed in 5264us (6477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635425.725329:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 163 00000100:00100000:3.0:1789635425.727295:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635425.728858:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411552128 00000100:00100000:0.0:1789635425.728876:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411552128 00000100:00100000:0.0:1789635425.728953:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00100000:0.0:1789635425.728964:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+37:12220:x1876568411552128:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:0.0:1789635425.729264:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+38:12220:x1876568411552128:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 299us (1979us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1789635425.729272:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00100000:3.0:1789635425.774072:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635425.774494:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411552384 00000100:00100000:2.0:1789635425.774509:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411552384 00000100:00100000:2.0:1789635425.774689:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 164 00000100:00100000:2.0:1789635425.774702:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+38:12223:x1876568411552384:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1789635425.774740:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635425.775112:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fa18 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab741fe expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.775216:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40fa1f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.775235:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40fa1f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.775271:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40fa1f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.775286:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fa26 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.775294:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fa26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.775301:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fa26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.775447:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40fa2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.775456:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40fa2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.775464:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40fa2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635425.775475:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789635425.775576:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40fa1f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.775584:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40fa1f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.775593:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40fa1f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.775634:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a2e00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635425.775646:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40fa1f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.775655:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40fa1f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.775671:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d0544e2e500) 00010000:00010000:2.0:1789635425.775674:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635425.775679:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40fa1f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.775686:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40fa1f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.775702:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fa26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.775709:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fa26 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.775714:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fa26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.775719:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3800 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635425.775722:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fa26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.775729:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fa26 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.775736:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d0544e2e900) 00010000:00010000:2.0:1789635425.775738:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635425.775749:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fa26 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.775755:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fa26 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.775905:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fa18 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741fe expref: 41 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.775922:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40fa2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741fe expref: 40 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.775930:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:2.0:1789635425.775933:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789635425.775935:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a3e00, rc 0) 00000100:00100000:2.0:1789635425.776032:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+40:12223:x1876568411552384:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 1332us (1972us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1789635425.776042:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 164 00000100:00100000:3.0:1789635425.779947:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635425.789361:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411552512 00000100:00100000:0.0:1789635425.789384:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411552512 00000100:00100000:2.0:1789635425.790260:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 165 00000100:00100000:2.0:1789635425.790277:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+40:12223:x1876568411552512:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:2.0:1789635425.790372:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fa3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.790393:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fa3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.790407:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fa3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.790463:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fa3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.790488:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fa3b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.790496:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fa3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.790503:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a2600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635425.790509:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fa3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.790518:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fa3b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.790532:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:2.0:1789635425.790535:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789635425.790541:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fa3b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635425.790547:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fa3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635425.790684:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+40:12223:x1876568411552512:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 412us (10751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635425.790693:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 165 00000100:00100000:3.0:1789635425.797760:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635425.798006:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411552768 00000100:00100000:1.0:1789635425.798019:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411552768 00000100:00100000:1.0:1789635425.798089:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 41 00000100:00100000:1.0:1789635425.798101:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+40:12223:x1876568411552768:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:1.0:1789635425.798405:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+41:12223:x1876568411552768:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 306us (660us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1789635425.798433:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 41 00000100:00100000:3.0:1789635426.039240:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635426.039376:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411553024 00000100:00100000:1.0:1789635426.039389:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411553024 00000100:00100000:1.0:1789635426.039489:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 166 00000100:00100000:1.0:1789635426.039501:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+41:12254:x1876568411553024:12345-192.168.203.20@tcp:101:cat.0 00010000:00010000:1.0:1789635426.039533:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635426.039559:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fa42 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74205 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635426.039737:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fa49 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635426.039755:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fa49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635426.040295:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fa49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635426.040312:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789635426.040458:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fa42 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74205 expref: 44 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635426.040534:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fa49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74205 expref: 43 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635426.040546:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:1.0:1789635426.040549:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789635426.040553:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e153600, rc 0) 00000100:00100000:1.0:1789635426.040805:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+43:12254:x1876568411553024:12345-192.168.203.20@tcp:101:cat.0 Request processed in 1305us (1577us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1789635426.040814:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 166 00000100:00100000:1.0:1789635426.057477:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635426.057536:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635426.057752:0:13189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411553152 00000100:00100000:0.0:1789635426.057766:0:13189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411553152 00000100:00100000:0.0:1789635426.057857:0:13189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:0.0:1789635426.057872:0:13189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447bf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+43:2396:x1876568411553152:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789635426.057895:0:13189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635426.057926:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fa49 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74205 expref: 43 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635426.057950:0:13189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:0.0:1789635426.057956:0:13189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635426.058034:0:13189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447bf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+42:2396:x1876568411553152:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 167us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635426.058041:0:13189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:3.0:1789635426.058274:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411553408 00000100:00100000:3.0:1789635426.058281:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411553408 00000100:00100000:3.0:1789635426.058369:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 42 00000100:00100000:3.0:1789635426.058380:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+42:12254:x1876568411553408:12345-192.168.203.20@tcp:35:cat.0 00000100:00100000:3.0:1789635426.059036:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+43:12254:x1876568411553408:12345-192.168.203.20@tcp:35:cat.0 Request processed in 656us (1495us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1789635426.059046:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 42 00000100:00100000:1.0:1789635426.129729:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635426.129816:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411553664 00000100:00100000:3.0:1789635426.129830:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411553664 00000100:00100000:3.0:1789635426.129909:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 167 00000100:00100000:3.0:1789635426.129922:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447bfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+43:12260:x1876568411553664:12345-192.168.203.20@tcp:101:dd.0 00010000:00010000:3.0:1789635426.129954:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635426.129957:0:10094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789635426.129991:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40f9af lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741db expref: 43 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635426.130016:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d0544e2e500) 00010000:00010000:3.0:1789635426.130023:0:10094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789635426.130040:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa40fa57 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7420c expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635426.130183:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40fa5e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635426.130198:0:10094:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40fa2d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741fe expref: 43 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635426.130230:0:10094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40fa5e lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635426.130271:0:10094:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40fa2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741fe expref: 43 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635426.130287:0:10094:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40fa2d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741fe expref: 43 pid: 9526 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635426.130304:0:10094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459df480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10094:1876568427357696:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789635426.130402:0:10094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549fabcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635426.137719:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635426.137860:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411553792 00000100:00100000:2.0:1789635426.137873:0:7457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411553792 00010000:00010000:2.0:1789635426.137929:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40fa2d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741fe expref: 44 pid: 9526 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635426.137986:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 82 00000100:00100000:2.0:1789635426.138016:0:7457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05446f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+44:2397:x1876568411553792:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635426.138033:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635426.138042:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40fa2d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741fe expref: 44 pid: 9526 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.138059:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40fa2d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741fe expref: 44 pid: 9526 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.138089:0:7457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:2.0:1789635426.138096:0:7457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40fa5e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.138123:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40fa5e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.138132:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40fa5e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.138155:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635426.138223:0:7457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05446f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+44:2397:x1876568411553792:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 209us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635426.138230:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 82 00010000:00010000:3.0:1789635426.139231:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40fa2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741fe expref: 43 pid: 9526 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635426.139257:0:10094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459df480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10094:1876568427357696:192.168.203.20@tcp:104: 00010000:00010000:3.0:1789635426.139284:0:10094:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40fa5e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635426.139295:0:10094:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40fa5e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635426.139302:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40fa5e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635426.139326:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789635426.139527:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa40fa57 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7420c expref: 44 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635426.139563:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40fa5e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7420c expref: 43 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635426.139572:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:3.0:1789635426.139576:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789635426.139579:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05488ff600, rc 0) 00000100:00100000:3.0:1789635426.139676:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447bfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+43:12260:x1876568411553664:12345-192.168.203.20@tcp:101:dd.0 Request processed in 9756us (9959us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1789635426.139685:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 167 00000100:00100000:0.0:1789635426.145930:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635426.146035:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411553920 00000100:00100000:2.0:1789635426.146048:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411553920 00000100:00100000:2.0:1789635426.146142:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 168 00000100:00100000:2.0:1789635426.146155:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+43:12260:x1876568411553920:12345-192.168.203.20@tcp:101:dd.0 00010000:00010000:2.0:1789635426.146191:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635426.146218:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fa6c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74213 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.146285:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fa73 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.146304:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fa73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.146318:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fa73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.146473:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fa6c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74213 expref: 45 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.146495:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fa73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74213 expref: 44 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.146505:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:2.0:1789635426.146508:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789635426.146512:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a3800, rc 0) 00000100:00100000:2.0:1789635426.146891:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+44:12260:x1876568411553920:12345-192.168.203.20@tcp:101:dd.0 Request processed in 738us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635426.146899:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 168 00000100:00100000:1.0:1789635426.152199:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635426.152312:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411554176 00000100:00100000:0.0:1789635426.152326:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411554176 00000100:00100000:0.0:1789635426.152405:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 169 00000100:00100000:0.0:1789635426.152429:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+44:12260:x1876568411554176:12345-192.168.203.20@tcp:36:dd.0 00010000:00010000:0.0:1789635426.152799:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40fa7a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635426.152822:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40fa7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635426.152837:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40fa7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789635426.152893:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:0.0:1789635426.152923:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000041b402a2 reply state 00000000d1751ff7 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40fa7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635426.152938:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40fa7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635426.152946:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:0.0:1789635426.152949:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789635426.152954:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789635426.153079:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+47:12260:x1876568411554176:12345-192.168.203.20@tcp:36:dd.0 Request processed in 661us (894us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1789635426.153087:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 169 00000020:00080000:0.0:1789635426.153093:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789635426.470216:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635426.475720:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635426.475935:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411554304 00000100:00100000:1.0:1789635426.475948:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411554304 00000100:00100000:1.0:1789635426.476034:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 170 00000100:00100000:1.0:1789635426.476046:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+47:12274:x1876568411554304:12345-192.168.203.20@tcp:101:stat.0 00010000:00010000:1.0:1789635426.476076:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635426.476102:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fa81 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7421a expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635426.476527:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fa88 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635426.476547:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fa88 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635426.476560:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fa88 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635426.476573:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fa8f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635426.476581:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fa8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635426.476710:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fa8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635426.476808:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fa96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635426.476821:0:10094:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40fa5e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7420c expref: 48 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635426.476829:0:10094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fa96 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635426.476875:0:10094:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40fa5e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7420c expref: 48 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635426.476890:0:10094:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40fa5e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7420c expref: 48 pid: 10094 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635426.476907:0:10094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0541325880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10094:1876568427357824:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789635426.477024:0:10094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0545287300 going to sleep for 11 seconds 00000100:00100000:1.0:1789635426.482884:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635426.483719:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411554560 00000100:00100000:0.0:1789635426.483752:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411554560 00000100:00100000:0.0:1789635426.483838:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 43 00000100:00100000:0.0:1789635426.483850:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+49:11391:x1876568411554560:12345-192.168.203.20@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789635426.484263:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+50:11391:x1876568411554560:12345-192.168.203.20@tcp:35:ldlm_bl.0 Request processed in 414us (1392us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1789635426.484272:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 43 00000100:00100000:2.0:1789635426.486974:0:10094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0541325880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10094:1876568427357824:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789635426.487164:0:10094:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fa96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635426.490283:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635426.490456:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411554688 00000100:00100000:3.0:1789635426.490470:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411554688 00010000:00010000:3.0:1789635426.490521:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40fa5e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7420c expref: 50 pid: 10094 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635426.490574:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 83 00000100:00100000:3.0:1789635426.490586:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b405450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+50:2397:x1876568411554688:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635426.490644:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635426.490654:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40fa5e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7420c expref: 50 pid: 10094 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635426.490670:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40fa5e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7420c expref: 50 pid: 10094 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635426.490699:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40fa5e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7420c expref: 50 pid: 10094 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635426.490758:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:3.0:1789635426.490765:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fa96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635426.490777:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fa96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635426.490787:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fa96 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635426.490825:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635426.490899:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b405450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+49:2397:x1876568411554688:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 314us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635426.490907:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 83 00010000:00010000:2.0:1789635426.491875:0:10094:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fa96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.491901:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fa96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635426.491975:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789635426.491981:0:10094:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789635426.492020:0:10094:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fa96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.492038:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fa96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.492049:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fa88 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.492057:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fa88 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.492065:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fa88 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.492072:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152400 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635426.492077:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fa88 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.492085:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fa88 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.492099:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d0544e2e500) 00010000:00010000:2.0:1789635426.492102:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635426.492107:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fa88 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.492124:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fa88 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.492141:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fa8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.492148:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fa8f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.492153:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fa8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.492158:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152a00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635426.492161:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fa8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.492168:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fa8f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.492176:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d0544e2e900) 00010000:00010000:2.0:1789635426.492178:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635426.492181:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fa8f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.492643:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fa8f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.492704:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fa81 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7421a expref: 49 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.492736:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fa96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7421a expref: 48 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.492745:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:2.0:1789635426.492748:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789635426.492751:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e153a00, rc 0) 00000100:00100000:2.0:1789635426.492968:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+48:12274:x1876568411554304:12345-192.168.203.20@tcp:101:stat.0 Request processed in 16922us (17260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635426.492979:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 170 00000100:00100000:0.0:1789635426.568736:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635426.568867:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411554944 00000100:00100000:2.0:1789635426.568879:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411554944 00000100:00100000:2.0:1789635426.568956:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 171 00000100:00100000:2.0:1789635426.568969:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+48:12280:x1876568411554944:12345-192.168.203.20@tcp:36:truncate.0 00010000:00010000:2.0:1789635426.569051:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635426.569084:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fa96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7421a expref: 48 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.569110:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:2.0:1789635426.569116:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789635426.569361:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fa9d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.569380:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fa9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.569392:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fa9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789635426.569471:0:9526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:2.0:1789635426.569499:0:9526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca631722 reply state 00000000b94cb8ee transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fa9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.569513:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fa9d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.569520:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:2.0:1789635426.569523:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789635426.569526:0:9526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789635426.569714:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+50:12280:x1876568411554944:12345-192.168.203.20@tcp:36:truncate.0 Request processed in 745us (991us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1789635426.569721:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 171 00000020:00080000:2.0:1789635426.569727:0:9526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789635426.718475:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635426.718667:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411555072 00000100:00100000:2.0:1789635426.718681:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411555072 00000100:00100000:2.0:1789635426.718761:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 172 00000100:00100000:2.0:1789635426.718774:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+50:12294:x1876568411555072:12345-192.168.203.20@tcp:101:stat.0 00010000:00010000:2.0:1789635426.718812:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635426.718840:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40faa4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74221 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.718945:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40faab lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.718965:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40faab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.718979:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40faab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.719013:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40fab2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.719021:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40fab2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.719029:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40fab2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.719126:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fab9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.719136:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fab9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.719143:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fab9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635426.719197:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1789635426.719215:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789635426.719240:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fab9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.719255:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fab9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.719264:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40faab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.719272:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40faab lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.719292:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40faab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.719299:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3e00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635426.719304:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40faab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.719313:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40faab lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.719341:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d0544e2e500) 00010000:00010000:2.0:1789635426.719345:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635426.719351:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40faab lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.719358:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40faab lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.719377:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40fab2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.719384:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40fab2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.719390:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40fab2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.719396:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3400 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635426.719399:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40fab2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.719428:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40fab2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.719437:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d0544e2e900) 00010000:00010000:2.0:1789635426.719440:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635426.719443:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40fab2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.719449:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40fab2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.719486:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40faa4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74221 expref: 52 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.719502:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fab9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74221 expref: 51 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.719510:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:2.0:1789635426.719513:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789635426.719515:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a2600, rc 0) 00000100:00100000:2.0:1789635426.719708:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+51:12294:x1876568411555072:12345-192.168.203.20@tcp:101:stat.0 Request processed in 936us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635426.719717:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 172 00000100:00100000:1.0:1789635426.731132:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427357952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789635426.731231:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1789635426.731473:0:8866:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 445414872810ns, next at 446414867007ns, rc = 0 00000100:00100000:2.0:1789635426.731496:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427357952 00000100:00100000:2.0:1789635426.731510:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427357952 00000100:00100000:2.0:1789635426.731576:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789635426.731586:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541326300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1876568427357952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789635426.731633:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789635426.731705:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541326300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1876568427357952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635426.731713:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789635426.732067:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427357952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789635426.799527:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635426.799634:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411555328 00000100:00100000:2.0:1789635426.799644:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411555328 00000100:00100000:2.0:1789635426.799706:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 173 00000100:00100000:2.0:1789635426.799717:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+51:12304:x1876568411555328:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1789635426.799737:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635426.799768:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40fac0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74228 expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635426.799878:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789635426.799976:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40fac0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74228 expref: 53 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.799992:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0544e2ed00) 00010000:00010000:2.0:1789635426.799995:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789635426.800000:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40fac0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74228 expref: 53 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.800014:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a2e00, rc 0) 00000100:00100000:2.0:1789635426.800722:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+52:12304:x1876568411555328:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 1004us (1201us total) trans 4294967447 rc 301/301 00000100:00100000:2.0:1789635426.800730:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 173 00000100:00100000:0.0:1789635426.808159:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635426.808289:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411555584 00000100:00100000:3.0:1789635426.808298:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411555584 00000100:00100000:3.0:1789635426.808352:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 44 00000100:00100000:3.0:1789635426.808361:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b745050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+52:12304:x1876568411555584:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:3.0:1789635426.808624:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b745050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+53:12304:x1876568411555584:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 262us (472us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1789635426.808632:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 44 00000100:00100000:1.0:1789635426.877428:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635426.877653:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411555840 00000100:00100000:0.0:1789635426.877664:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411555840 00000100:00100000:0.0:1789635426.877735:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 174 00000100:00100000:0.0:1789635426.877746:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+53:12310:x1876568411555840:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:0.0:1789635426.877781:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635426.877801:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40face lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7422f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635426.877917:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fad5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635426.877931:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fab9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74221 expref: 54 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635426.877941:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fad5 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635426.877975:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fab9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74221 expref: 54 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635426.878002:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fab9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74221 expref: 54 pid: 6515 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635426.878016:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d054121b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6516:1876568427358080:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789635426.878100:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057ae00300 going to sleep for 11 seconds 00000100:00100000:1.0:1789635426.881747:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635426.881747:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d054121b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6516:1876568427358080:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789635426.881849:0:13189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411555968 00000100:00100000:2.0:1789635426.881857:0:13189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411555968 00010000:00010000:2.0:1789635426.881907:0:13189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fab9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74221 expref: 55 pid: 6515 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635426.881968:0:13189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 84 00000100:00100000:2.0:1789635426.881979:0:13189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541325500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+55:2397:x1876568411555968:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635426.881993:0:13189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635426.882001:0:13189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fab9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74221 expref: 55 pid: 6515 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.882013:0:13189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fab9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74221 expref: 55 pid: 6515 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.882036:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fab9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74221 expref: 55 pid: 6515 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.882051:0:13189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:2.0:1789635426.882056:0:13189:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fad5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.882067:0:13189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fad5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.882075:0:13189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fad5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.882094:0:13189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635426.882497:0:13189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541325500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+54:2397:x1876568411555968:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 518us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635426.882505:0:13189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 84 00010000:00010000:0.0:1789635426.883112:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fad5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635426.883125:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fad5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635426.883131:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fad5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635426.883149:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1789635426.883275:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40face lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7422f expref: 55 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635426.883293:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fad5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7422f expref: 54 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635426.883302:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:0.0:1789635426.883304:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789635426.883307:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1a800, rc 0) 00000100:00100000:0.0:1789635426.886510:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+54:12310:x1876568411555840:12345-192.168.203.20@tcp:101:bash.0 Request processed in 8754us (9088us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1789635426.886544:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 174 00000100:00100000:1.0:1789635426.893029:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635426.893127:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411556224 00000100:00100000:2.0:1789635426.893151:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411556224 00000100:00100000:2.0:1789635426.893213:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 175 00000100:00100000:2.0:1789635426.893223:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+54:12310:x1876568411556224:12345-192.168.203.20@tcp:36:bash.0 00010000:00010000:2.0:1789635426.893471:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fae3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.893489:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fae3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.893499:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fae3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789635426.893543:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:2.0:1789635426.893565:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000577010ab reply state 000000004692f5b2 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fae3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.893577:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fae3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.893584:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:2.0:1789635426.893586:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789635426.893589:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789635426.893712:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+57:12310:x1876568411556224:12345-192.168.203.20@tcp:36:bash.0 Request processed in 489us (691us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1789635426.893720:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 175 00000020:00080000:2.0:1789635426.893724:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789635426.906139:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635426.910515:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411556352 00000100:00100000:1.0:1789635426.910530:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411556352 00000100:00100000:1.0:1789635426.910664:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 176 00000100:00100000:1.0:1789635426.910676:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+57:12310:x1876568411556352:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:1.0:1789635426.910703:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635426.910726:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40faea lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74236 expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635426.910823:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40faf1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635426.910838:0:10094:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fad5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7422f expref: 58 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635426.910848:0:10094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40faf1 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635426.910886:0:10094:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fad5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7422f expref: 58 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635426.910899:0:10094:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fad5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7422f expref: 58 pid: 6516 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635426.910913:0:10094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447918700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10094:1876568427358208:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789635426.910997:0:10094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05452879c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635426.923885:0:10094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447918700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10094:1876568427358208:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789635426.923917:0:10094:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40faf1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635426.924368:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635426.924562:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411556480 00000100:00100000:1.0:1789635426.924577:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411556480 00010000:00010000:1.0:1789635426.924645:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fad5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7422f expref: 59 pid: 6516 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635426.924678:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 85 00000100:00100000:1.0:1789635426.924686:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448598000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+59:2397:x1876568411556480:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635426.924700:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635426.924707:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fad5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7422f expref: 59 pid: 6516 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635426.924718:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fad5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7422f expref: 59 pid: 6516 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635426.924739:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fad5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7422f expref: 59 pid: 6516 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635426.924764:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:1.0:1789635426.924770:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40faf1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635426.924779:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40faf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635426.924787:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40faf1 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635426.924813:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635426.924859:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448598000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+58:2397:x1876568411556480:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 173us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635426.924875:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 85 00010000:00010000:2.0:1789635426.925026:0:10094:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40faf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.925034:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40faf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635426.925090:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789635426.925095:0:10094:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789635426.925114:0:10094:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40faf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.925146:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40faea lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74236 expref: 58 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.925160:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40faf1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74236 expref: 57 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635426.925168:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:2.0:1789635426.925170:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789635426.925172:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e152a00, rc 0) 00000100:00100000:2.0:1789635426.925198:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+57:12310:x1876568411556352:12345-192.168.203.20@tcp:101:bash.0 Request processed in 14524us (19068us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635426.925205:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 176 00000100:00100000:1.0:1789635426.937466:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635426.937549:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411556736 00000100:00100000:3.0:1789635426.937559:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411556736 00000100:00100000:3.0:1789635426.937643:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 45 00000100:00100000:3.0:1789635426.937653:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044791ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+57:12310:x1876568411556736:12345-192.168.203.20@tcp:35:bash.0 00000100:00100000:3.0:1789635426.937900:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044791ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+58:12310:x1876568411556736:12345-192.168.203.20@tcp:35:bash.0 Request processed in 248us (444us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1789635426.937908:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 45 00000100:00100000:0.0:1789635427.050319:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635427.050522:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411556992 00000100:00100000:1.0:1789635427.050532:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411556992 00000100:00100000:1.0:1789635427.050627:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 177 00000100:00100000:1.0:1789635427.050647:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054121b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+58:12320:x1876568411556992:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789635427.050670:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635427.050688:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40faf8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7423d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635427.050951:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789635427.051045:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40faf8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7423d expref: 60 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.051061:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0544e2ed00) 00010000:00010000:1.0:1789635427.051064:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789635427.051069:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40faf8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7423d expref: 60 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.051094:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e152400, rc 0) 00000100:00100000:1.0:1789635427.051147:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054121b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+59:12320:x1876568411556992:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 512us (838us total) trans 4294967453 rc 301/301 00000100:00100000:1.0:1789635427.051154:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 177 00000100:00080000:0.0:1789635427.051960:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635427.060002:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635427.060086:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411557120 00000100:00100000:1.0:1789635427.060097:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411557120 00000100:00100000:1.0:1789635427.060154:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 178 00000100:00100000:1.0:1789635427.060164:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+59:12320:x1876568411557120:12345-192.168.203.20@tcp:34:lfs.0 00010000:00010000:1.0:1789635427.060249:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fb06 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.060264:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fb06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.060276:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fb06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.060287:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fb0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.060294:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fb0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.060299:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fb0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.060365:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fb14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.060373:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fb14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.060381:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fb14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789635427.060435:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fb14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.060447:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fb06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.060462:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fb06 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.060469:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fb06 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.060475:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152e00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635427.060479:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fb06 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.060487:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fb06 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.060499:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d0544e2e500) 00010000:00010000:1.0:1789635427.060502:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635427.060506:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fb06 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.060513:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fb06 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.060526:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fb0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.060532:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fb0d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.060538:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fb0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.060543:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e153600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635427.060552:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fb0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.060558:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fb0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.060567:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d0544e2e900) 00010000:00010000:1.0:1789635427.060570:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635427.060572:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fb0d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.060578:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fb0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.060587:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fb14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.060593:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fb14 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.060739:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fb14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.060744:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152800 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635427.060747:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fb14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.060753:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fb14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.060762:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:1.0:1789635427.060765:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635427.060773:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fb14 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.060779:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fb14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635427.060959:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+59:12320:x1876568411557120:12345-192.168.203.20@tcp:34:lfs.0 Request processed in 795us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635427.060967:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 178 00000100:00100000:1.0:1789635427.076663:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635427.076776:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411557376 00000100:00100000:3.0:1789635427.076786:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411557376 00000100:00100000:3.0:1789635427.076842:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 46 00000100:00100000:3.0:1789635427.076853:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+59:12320:x1876568411557376:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:3.0:1789635427.077076:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+60:12320:x1876568411557376:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 225us (423us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1789635427.077084:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 46 00000100:00100000:3.0:1789635427.132991:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635427.133138:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411557632 00000100:00100000:2.0:1789635427.133148:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411557632 00000100:00100000:2.0:1789635427.133208:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 179 00000100:00100000:2.0:1789635427.133239:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+60:12323:x1876568411557632:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1789635427.133263:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635427.133283:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40fb1b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74244 expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.133355:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40fb22 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.133370:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40fb22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.133381:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40fb22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.133392:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40fb29 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.133399:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40fb29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.133406:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40fb29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.133518:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40fb30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.133529:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40fb30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.133536:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40fb30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635427.133556:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789635427.133688:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40fb22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.133696:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40fb22 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.133703:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40fb22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.133709:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a2e00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635427.133713:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40fb22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.133721:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40fb22 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.133733:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d0544e2e500) 00010000:00010000:2.0:1789635427.133737:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635427.133741:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40fb22 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.133747:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40fb22 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.133758:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40fb29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.133764:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40fb29 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.133782:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40fb29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.133788:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3e00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635427.133791:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40fb29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.133797:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40fb29 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.133805:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d0544e2e900) 00010000:00010000:2.0:1789635427.133807:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635427.133810:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40fb29 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.133815:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa40fb29 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.133849:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40fb1b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74244 expref: 63 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.133861:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40fb30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74244 expref: 62 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.133868:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:2.0:1789635427.133870:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789635427.133872:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0540031400, rc 0) 00000100:00100000:2.0:1789635427.133937:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+62:12323:x1876568411557632:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 706us (956us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1789635427.133954:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 179 00000100:00100000:2.0:1789635427.140388:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635427.140440:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635427.140646:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411557760 00000100:00100000:3.0:1789635427.140656:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411557760 00000100:00100000:3.0:1789635427.140711:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 180 00000100:00100000:3.0:1789635427.140722:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+62:12323:x1876568411557760:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:3.0:1789635427.140786:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40fb3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.140804:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40fb3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.140814:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40fb3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.140849:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40fb3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.140856:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40fb3e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.140878:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40fb3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.140884:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488ff600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635427.140888:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40fb3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.140895:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40fb3e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.140907:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:3.0:1789635427.140910:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789635427.140914:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40fb3e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.140921:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40fb3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635427.140987:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+62:12323:x1876568411557760:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 267us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635427.140995:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 180 00000100:00100000:1.0:1789635427.141326:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411557888 00000100:00100000:1.0:1789635427.141333:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411557888 00000100:00100000:1.0:1789635427.141374:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00100000:1.0:1789635427.141382:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+62:2399:x1876568411557888:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635427.141393:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635427.141421:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40fb30 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74244 expref: 62 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.141434:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:1.0:1789635427.141438:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635427.141466:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+61:2399:x1876568411557888:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 86us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635427.141473:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00100000:2.0:1789635427.151502:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635427.156019:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411558144 00000100:00100000:3.0:1789635427.156035:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411558144 00000100:00100000:3.0:1789635427.156120:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 47 00000100:00100000:3.0:1789635427.156132:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+61:12323:x1876568411558144:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:3.0:1789635427.156355:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+62:12323:x1876568411558144:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 226us (4863us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1789635427.156363:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 47 00000100:00100000:0.0:1789635427.235895:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427358336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789635427.235973:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635427.236147:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427358336 00000100:00100000:3.0:1789635427.236156:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427358336 00000100:00100000:3.0:1789635427.236224:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789635427.236234:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427358336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789635427.236259:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635427.236316:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427358336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635427.236323:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789635427.236426:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427358336:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789635427.236443:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789635427.282586:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635427.282801:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411558400 00000100:00100000:2.0:1789635427.282811:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411558400 00000100:00100000:2.0:1789635427.282872:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 181 00000100:00100000:2.0:1789635427.282882:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+62:12341:x1876568411558400:12345-192.168.203.20@tcp:101:cat.0 00010000:00010000:2.0:1789635427.282906:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635427.282927:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40fb45 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7424b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.283030:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40fb4c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.283045:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40fb4c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.283057:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40fb4c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635427.283068:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789635427.283173:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40fb45 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7424b expref: 65 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.283192:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40fb4c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7424b expref: 64 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.283216:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:2.0:1789635427.283219:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789635427.283222:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0540031400, rc 0) 00000100:00100000:2.0:1789635427.283373:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+64:12341:x1876568411558400:12345-192.168.203.20@tcp:101:cat.0 Request processed in 492us (795us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1789635427.283380:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 181 00000100:00100000:0.0:1789635427.307306:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635427.307396:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411558528 00000100:00100000:1.0:1789635427.307416:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411558528 00000100:00100000:1.0:1789635427.307473:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 182 00000100:00100000:1.0:1789635427.307504:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+64:12342:x1876568411558528:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789635427.307527:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635427.307546:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fb5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74252 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.307634:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fb61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.307648:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fb61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.307659:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fb61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635427.307702:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1789635427.307706:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789635427.307723:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fb61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.307750:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fb5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74252 expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.307908:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fb61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74252 expref: 65 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.307918:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d0544e2e500) 00010000:00010000:1.0:1789635427.307921:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789635427.307924:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e152e00, rc 0) 00000100:00100000:1.0:1789635427.307991:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+65:12342:x1876568411558528:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 497us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635427.308007:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 182 00000100:00100000:2.0:1789635427.312314:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635427.312387:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411558912 00000100:00100000:3.0:1789635427.312398:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411558912 00000100:00100000:3.0:1789635427.312465:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 48 00000100:00100000:3.0:1789635427.312486:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+65:12342:x1876568411558912:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:3.0:1789635427.312897:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+66:12342:x1876568411558912:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 411us (592us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1789635427.312905:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 48 00000100:00100000:2.0:1789635427.316174:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635427.316286:0:13189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411559040 00000100:00100000:0.0:1789635427.316296:0:13189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411559040 00000100:00100000:0.0:1789635427.316404:0:13189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00100000:0.0:1789635427.316744:0:13189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+66:12342:x1876568411559040:12345-192.168.203.20@tcp:103:lfs.0 00010000:00010000:0.0:1789635427.316881:0:13189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789635427.316908:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40faf1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74236 expref: 66 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.316931:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40fb4c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7424b expref: 65 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.316945:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40f9ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741f0 expref: 64 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.316954:0:13189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:0.0:1789635427.316959:0:13189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635427.317055:0:13189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+63:12342:x1876568411559040:12345-192.168.203.20@tcp:103:lfs.0 Request processed in 315us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635427.317063:0:13189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00100000:0.0:1789635427.320033:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635427.320125:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411559168 00000100:00100000:2.0:1789635427.320135:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411559168 00000100:00100000:2.0:1789635427.320241:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 183 00000100:00100000:2.0:1789635427.320252:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+63:12342:x1876568411559168:12345-192.168.203.20@tcp:58:lfs.0 00010000:00010000:2.0:1789635427.320371:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40fb68 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.320387:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40fb68 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.320400:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40fb68 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789635427.320521:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1789635427.320633:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+63:12342:x1876568411559168:12345-192.168.203.20@tcp:58:lfs.0 Request processed in 383us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635427.320641:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 183 00000100:00100000:2.0:1789635427.351675:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635427.351783:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411559296 00000100:00100000:3.0:1789635427.351793:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411559296 00000100:00100000:3.0:1789635427.351853:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 184 00000100:00100000:3.0:1789635427.351864:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0441468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+63:12344:x1876568411559296:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789635427.351884:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635427.351904:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40fb6f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74259 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.351968:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa40fb76 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.351981:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa40fb76 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.352004:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa40fb76 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.352016:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa40fb7d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.352023:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa40fb7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.352029:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa40fb7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.352102:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff400/0xb0c3a59caa40fb84 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.352111:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff400/0xb0c3a59caa40fb84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.352118:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff400/0xb0c3a59caa40fb84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635427.352156:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789635427.352160:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789635427.352179:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff400/0xb0c3a59caa40fb84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.352191:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff400/0xb0c3a59caa40fb84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.352199:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa40fb76 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.352215:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa40fb76 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.352222:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa40fb76 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.352228:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488fea00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635427.352233:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa40fb76 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.352241:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa40fb76 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.352253:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d0544e2e500) 00010000:00010000:3.0:1789635427.352257:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635427.352262:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa40fb76 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.352268:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa40fb76 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.352282:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa40fb7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.352288:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa40fb7d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.352294:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa40fb7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.352300:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488ffe00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635427.352310:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa40fb7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.352316:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa40fb7d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.352325:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d0544e2e900) 00010000:00010000:3.0:1789635427.352328:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635427.352331:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa40fb7d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.352336:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa40fb7d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.352363:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40fb6f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74259 expref: 65 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.352376:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff400/0xb0c3a59caa40fb84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74259 expref: 64 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.352383:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:3.0:1789635427.352385:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789635427.352387:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05488ff400, rc 0) 00000100:00100000:3.0:1789635427.352451:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0441468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+64:12344:x1876568411559296:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 589us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635427.352458:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 184 00000040:00080000:3.0:1789635427.363869:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789635427.363879:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789635427.363922:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1789635427.363934:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789635427.364079:0:13797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ddf80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1876568427358464:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789635427.364171:0:13797:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549fab6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635427.368874:0:13797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ddf80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1876568427358464:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789635427.375317:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635427.375414:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411559424 00000100:00100000:3.0:1789635427.375426:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411559424 00000100:00100000:3.0:1789635427.375498:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 185 00000100:00100000:3.0:1789635427.375509:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+64:12346:x1876568411559424:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789635427.375540:0:9526:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789635427.375690:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+64:12346:x1876568411559424:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 182us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635427.375698:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 185 00000100:00100000:2.0:1789635427.379883:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635427.379995:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411559552 00000100:00100000:1.0:1789635427.380006:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411559552 00000100:00100000:1.0:1789635427.380062:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 186 00000100:00100000:1.0:1789635427.380072:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+64:12346:x1876568411559552:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789635427.380143:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fb8b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.380160:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fb8b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.380172:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fb8b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.380239:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fb92 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.380248:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fb92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.380254:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fb92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.380279:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fb99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.380288:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fb99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.380294:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fb99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635427.380345:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789635427.380350:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789635427.380362:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fb99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.380374:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fb8b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.380380:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fb8b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.380386:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fb8b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.380392:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e153600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635427.380395:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fb8b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.380403:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fb8b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.380428:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d044766d300) 00010000:00010000:1.0:1789635427.380432:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635427.380436:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fb8b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.380442:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fb8b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.380456:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fb92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.380475:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fb92 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.380480:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fb92 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.380485:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152400 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635427.380499:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fb92 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.380507:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fb92 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.380515:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8d04466ca400) 00010000:00010000:1.0:1789635427.380517:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635427.380520:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fb92 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.380526:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fb92 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.380541:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fb99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.380547:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fb99 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.380552:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fb99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.380557:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e153a00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635427.380566:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fb99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.380572:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fb99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.380580:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:1.0:1789635427.380582:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635427.380585:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fb99 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.380591:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fb99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635427.382588:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+64:12346:x1876568411559552:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 Request processed in 2507us (2704us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635427.382617:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 186 00000100:00100000:2.0:1789635427.401264:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635427.401357:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411559808 00000100:00100000:3.0:1789635427.401367:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411559808 00000100:00100000:3.0:1789635427.401441:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 187 00000100:00100000:3.0:1789635427.401452:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044844bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+64:12346:x1876568411559808:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789635427.401473:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635427.401503:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40fba0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74260 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.401873:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b200/0xb0c3a59caa40fba7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.401889:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b200/0xb0c3a59caa40fba7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.401902:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b200/0xb0c3a59caa40fba7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635427.401915:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789635427.401994:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b200/0xb0c3a59caa40fba7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.402001:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b200/0xb0c3a59caa40fba7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.402008:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b200/0xb0c3a59caa40fba7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.402013:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1b200 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635427.402017:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b200/0xb0c3a59caa40fba7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.402024:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b200/0xb0c3a59caa40fba7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.402035:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:0.0:1789635427.402038:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789635427.402042:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b200/0xb0c3a59caa40fba7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.402065:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b200/0xb0c3a59caa40fba7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.402109:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40fba0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74260 expref: 66 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.402119:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d044766d300) 00010000:00010000:0.0:1789635427.402122:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789635427.402126:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff600/0xb0c3a59caa40fba0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74260 expref: 66 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.402135:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05488ff600, rc 0) 00000100:00100000:0.0:1789635427.402198:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044844bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+65:12346:x1876568411559808:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 747us (944us total) trans 4294967459 rc 301/301 00000100:00100000:0.0:1789635427.402205:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 187 00000100:00100000:0.0:1789635427.407750:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635427.407915:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411559936 00000100:00100000:1.0:1789635427.407926:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411559936 00000100:00100000:1.0:1789635427.408031:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 188 00000100:00100000:1.0:1789635427.408041:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+65:12346:x1876568411559936:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789635427.408074:0:10094:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789635427.408185:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+65:12346:x1876568411559936:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 145us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635427.408193:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 188 00000100:00100000:2.0:1789635427.413284:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635427.413650:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411560192 00000100:00100000:1.0:1789635427.413660:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411560192 00000100:00100000:1.0:1789635427.414110:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 189 00000100:00100000:1.0:1789635427.414121:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044844b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+65:12346:x1876568411560192:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789635427.414155:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635427.414159:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789635427.414185:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fb61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74252 expref: 65 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.414205:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d0544e2e500) 00010000:00010000:1.0:1789635427.414211:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789635427.414224:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fbb5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74267 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789635427.414674:0:6514:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:1.0:1789635427.414822:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fbbc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.414835:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fbbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.414845:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fbbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.414892:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fbb5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74267 expref: 67 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.414908:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fbbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74267 expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.414916:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d04466ca400) 00010000:00010000:1.0:1789635427.414919:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789635427.414932:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e152400, rc 0) 00000100:00100000:1.0:1789635427.415004:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044844b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+66:12346:x1876568411560192:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 885us (1729us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1789635427.415012:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 189 00000100:00100000:2.0:1789635427.418360:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635427.418583:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411560448 00000100:00100000:0.0:1789635427.418593:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411560448 00000100:00100000:0.0:1789635427.418718:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 190 00000100:00100000:0.0:1789635427.418729:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044844a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+66:12346:x1876568411560448:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789635427.418791:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635427.418815:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fbbc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74267 expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.418833:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d04466ca400) 00010000:00010000:0.0:1789635427.418843:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789635427.418879:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b200/0xb0c3a59caa40fbca lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.418893:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b200/0xb0c3a59caa40fbca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.418903:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b200/0xb0c3a59caa40fbca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.418917:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40fbd1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x18d31bcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.418924:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40fbd1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x18d31bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.418930:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40fbd1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x18d31bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.418971:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b200/0xb0c3a59caa40fbca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.418979:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b200/0xb0c3a59caa40fbca lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.418985:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b200/0xb0c3a59caa40fbca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.418991:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1b200 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635427.418995:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b200/0xb0c3a59caa40fbca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.419001:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b200/0xb0c3a59caa40fbca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.419019:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d0544e2e500) 00010000:00010000:0.0:1789635427.419022:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635427.419026:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b200/0xb0c3a59caa40fbca lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.419031:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b200/0xb0c3a59caa40fbca lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.419042:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40fbd1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x18d31bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.419048:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40fbd1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x18d31bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.419054:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40fbd1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x18d31bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.419059:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1ba00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635427.419062:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40fbd1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x18d31bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.419067:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40fbd1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x18d31bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.419074:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x18d31bcf (ffff8d0447667b00) 00010000:00010000:0.0:1789635427.419076:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635427.419078:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40fbd1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x18d31bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.419083:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40fbd1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x18d31bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635427.419177:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044844a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+65:12346:x1876568411560448:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 450us (825us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789635427.419184:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 190 00000100:00100000:3.0:1789635427.421354:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635427.421448:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411560576 00000100:00100000:1.0:1789635427.421458:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411560576 00000100:00100000:1.0:1789635427.421532:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 191 00000100:00100000:1.0:1789635427.421542:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+65:12346:x1876568411560576:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789635427.421566:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635427.421588:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fbd8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7426e expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.421649:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fbdf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.421662:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fbdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.421672:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fbdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.421782:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fbd8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7426e expref: 67 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.421799:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fbdf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7426e expref: 66 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.421806:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d04466cae00) 00010000:00010000:1.0:1789635427.421809:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789635427.421819:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e153000, rc 0) 00000100:00100000:1.0:1789635427.421870:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+66:12346:x1876568411560576:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 329us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635427.421878:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 191 00000100:00100000:3.0:1789635427.425141:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635427.425910:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411560832 00000100:00100000:1.0:1789635427.425920:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411560832 00000100:00100000:1.0:1789635427.426098:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 192 00000100:00100000:1.0:1789635427.426111:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+66:12346:x1876568411560832:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789635427.426197:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fbe6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.426213:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fbe6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.426224:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fbe6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789635427.426379:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1789635427.426390:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 446109793024ns, next at 447109790209ns, rc = 0 00000004:00010000:1.0:1789635427.426453:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025eebce1 reply state 000000009c753e61 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fbe6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.426475:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fbe6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.426483:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d04466cae00) 00010000:00010000:1.0:1789635427.426486:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789635427.426497:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789635427.426619:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+68:12346:x1876568411560832:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 486us (1462us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1789635427.426641:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 192 00000100:00100000:2.0:1789635427.428855:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635427.428926:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411560960 00000100:00100000:0.0:1789635427.428936:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411560960 00000100:00100000:0.0:1789635427.429034:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 193 00000100:00100000:0.0:1789635427.429047:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448449500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+68:12346:x1876568411560960:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789635427.429070:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635427.429090:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40fbed lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74275 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.429143:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40fbed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74275 expref: 69 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.429158:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40fbed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74275 expref: 69 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.429189:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d04466cae00) 00010000:00010000:0.0:1789635427.429197:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789635427.429200:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1a200, rc 0) 00000100:00100000:0.0:1789635427.429257:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448449500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+69:12346:x1876568411560960:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 213us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635427.429265:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 193 00000100:00100000:3.0:1789635427.431676:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635427.431808:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411561088 00000100:00100000:1.0:1789635427.431819:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411561088 00000100:00100000:1.0:1789635427.431892:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 58 00000100:00100000:1.0:1789635427.431903:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+6:2398:x1876568411561088:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789635427.432138:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:2398:x1876568411561088:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 236us (468us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789635427.432145:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 58 00000100:00080000:3.0:1789635427.432244:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789635427.434776:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635427.434899:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411561344 00000100:00100000:1.0:1789635427.434909:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411561344 00000100:00100000:1.0:1789635427.435087:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 49 00000100:00100000:1.0:1789635427.435096:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05412af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+69:12346:x1876568411561344:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789635427.435273:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05412af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+70:12346:x1876568411561344:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 179us (505us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1789635427.435278:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 49 00000100:00100000:0.0:1789635427.437838:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635427.437927:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411561600 00000100:00100000:2.0:1789635427.437938:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411561600 00000100:00100000:2.0:1789635427.438066:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 194 00000100:00100000:2.0:1789635427.438077:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+70:12346:x1876568411561600:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789635427.438182:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+70:12346:x1876568411561600:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 107us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635427.438189:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 194 00000100:00100000:0.0:1789635427.440881:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635427.441862:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411561728 00000100:00100000:1.0:1789635427.442049:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411561728 00000100:00100000:1.0:1789635427.442114:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 195 00000100:00100000:1.0:1789635427.442125:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+70:12346:x1876568411561728:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789635427.442145:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635427.442165:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fbf4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7427c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.442255:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fbfb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.442276:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fbfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.442287:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fbfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635427.442329:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789635427.442348:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fbfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.442375:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fbf4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7427c expref: 72 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.442391:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fbfb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7427c expref: 71 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.442400:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d04466cae00) 00010000:00010000:1.0:1789635427.442403:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789635427.442419:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e152e00, rc 0) 00000100:00100000:1.0:1789635427.442485:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+71:12346:x1876568411561728:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 362us (1614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635427.442493:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 195 00000100:00100000:3.0:1789635427.445429:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635427.445951:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411561856 00000100:00100000:0.0:1789635427.446041:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411561856 00000100:00100000:0.0:1789635427.446137:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00100000:0.0:1789635427.446149:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:2398:x1876568411561856:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789635427.446168:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635427.446190:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b39846b6/0xb0c3a59caa40fc02 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74283 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789635427.446214:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aabab63, blocks: 0x0 00010000:00010000:0.0:1789635427.446230:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1789635427.446235:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635427.446244:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b39846b6/0xb0c3a59caa40fc02 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74283 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.446261:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b39846b6/0xb0c3a59caa40fc02 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74283 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.446274:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1aa00, rc 0) 00000100:00100000:0.0:1789635427.446340:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:2398:x1876568411561856:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 194us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635427.446347:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00100000:2.0:1789635427.450327:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635427.450400:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411562112 00000100:00100000:1.0:1789635427.450419:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411562112 00000100:00100000:1.0:1789635427.450479:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 196 00000100:00100000:1.0:1789635427.450490:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+71:12346:x1876568411562112:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789635427.450618:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+71:12346:x1876568411562112:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 107us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635427.450641:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 196 00000100:00100000:3.0:1789635427.460267:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635427.461788:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411562240 00000100:00100000:1.0:1789635427.461799:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411562240 00000100:00100000:1.0:1789635427.461901:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:1.0:1789635427.461912:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:12346:x1876568411562240:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789635427.461929:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635427.461946:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070c933e6/0xb0c3a59caa40fc09 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7428a expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.462049:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b39846b6/0xb0c3a59caa40fc02 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74283 expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.462059:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635427.462063:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635427.462069:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070c933e6/0xb0c3a59caa40fc09 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7428a expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.462104:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b39846b6/0xb0c3a59caa40fc02 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74283 expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.462118:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b39846b6/0xb0c3a59caa40fc02 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74283 expref: 9 pid: 8432 timeout: 546 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635427.462132:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0446c3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8431:1876568427358592:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789635427.462324:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446df50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635427.473161:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0446c3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8431:1876568427358592:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789635427.473177:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00010000:00010000:1.0:1789635427.473202:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000070c933e6/0xb0c3a59caa40fc09 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7428a expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635427.473208:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411562368 00000100:00100000:3.0:1789635427.473216:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411562368 00010000:00010000:1.0:1789635427.473227:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e153a00, rc 0) 00010000:00010000:3.0:1789635427.473250:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b39846b6/0xb0c3a59caa40fc02 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74283 expref: 10 pid: 8432 timeout: 546 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635427.473290:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+10:12346:x1876568411562240:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 11377us (13028us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635427.473291:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 86 00000100:00100000:1.0:1789635427.473305:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:3.0:1789635427.473308:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543290a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+10:2396:x1876568411562368:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635427.473323:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635427.473345:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b39846b6/0xb0c3a59caa40fc02 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74283 expref: 9 pid: 8432 timeout: 546 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.473359:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b39846b6/0xb0c3a59caa40fc02 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74283 expref: 9 pid: 8432 timeout: 546 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.473394:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b39846b6/0xb0c3a59caa40fc02 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74283 expref: 9 pid: 8432 timeout: 546 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.473418:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635427.473422:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635427.473430:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000070c933e6/0xb0c3a59caa40fc09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7428a expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.473440:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070c933e6/0xb0c3a59caa40fc09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7428a expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.473486:0:6499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000070c933e6/0xb0c3a59caa40fc09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7428a expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635427.473501:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e015f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6499:1876568427358720:192.168.203.20@tcp:105: 00000100:00100000:3.0:1789635427.473549:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549fab540 going to sleep for 11 seconds 00000100:00100000:3.0:1789635427.478809:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e015f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6499:1876568427358720:192.168.203.20@tcp:105: 00010000:00010000:3.0:1789635427.478838:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635427.479305:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543290a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:2396:x1876568411562368:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 5999us (6195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635427.479316:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 86 00000100:00100000:1.0:1789635427.479452:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635427.479487:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411562496 00000100:00100000:1.0:1789635427.479494:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411562496 00002000:00100000:1.0:1789635427.479535:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8d0446c3d500 x1876568411562496/t0(0) o4->6e1c17f2-a595-4ed0-97c8-b9260d0850ab@192.168.203.20@tcp:48/0 lens 504/0 e 0 to 0 dl 1789635438 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789635427.479545:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0446c3d500 with x1876568411562496 ext(0->8) 00002000:00010000:1.0:1789635427.479549:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d0446c3d500 00000100:00100000:1.0:1789635427.479573:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:1.0:1789635427.479583:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:2399:x1876568411562496:12345-192.168.203.20@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789635427.482345:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+10:2399:x1876568411562496:12345-192.168.203.20@tcp:4:lhsmtool_posix.0 Request processed in 2753us (2884us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1789635427.482359:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 4 00002000:00100000:1.0:1789635427.482371:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8d0446c3d500 x1876568411562496/t4294967315(0) o4->6e1c17f2-a595-4ed0-97c8-b9260d0850ab@192.168.203.20@tcp:48/0 lens 504/448 e 0 to 0 dl 1789635438 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789635427.482381:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0446c3d500 with x1876568411562496 ext(0->8) 00002000:00010000:1.0:1789635427.482387:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d0446c3d500 00010000:00010000:1.0:1789635427.492232:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635427.494650:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635427.494739:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411562624 00000100:00100000:0.0:1789635427.494749:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411562624 00000100:00100000:0.0:1789635427.494815:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 197 00000100:00100000:0.0:1789635427.494827:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e015f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+71:12346:x1876568411562624:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789635427.499756:0:6493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:1.0:1789635427.499774:0:6493:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:1.0:1789635427.499818:0:6493:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:1.0:1789635427.499857:0:6493:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1789635427.499866:0:6493:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d0446df5540 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1789635427.499870:0:6493:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d057b506200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d0544e0e180 00000020:00080000:1.0:1789635427.499873:0:6493:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d04466e1d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d054120aa00 00000100:00100000:1.0:1789635427.500006:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0446c3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427358848:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789635427.500070:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635427.500126:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427358848 00000100:00100000:1.0:1789635427.500134:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427358848 00000100:00100000:1.0:1789635427.500188:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789635427.500197:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1876568427358848:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789635427.500224:0:8430:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:1.0:1789635427.500254:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aabab61, atime: 0x6aabab61, ctime: 0x6aabab61, blocks: 0x8 00010000:00010000:1.0:1789635427.500262:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000094f8377/0xb0c3a59caa40fc10 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.500278:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1789635427.500283:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635427.500289:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000094f8377/0xb0c3a59caa40fc10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.500304:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000094f8377/0xb0c3a59caa40fc10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.500328:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000094f8377/0xb0c3a59caa40fc10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.500337:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000094f8377/0xb0c3a59caa40fc10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.500354:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789635427.500523:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3641:x1876568427358848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 326us (451us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789635427.500530:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1789635427.500553:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789635427.500562:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635427.500568:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000094f8377/0xb0c3a59caa40fc10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.500576:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152800 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:1.0:1789635427.500580:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000094f8377/0xb0c3a59caa40fc10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.500589:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000094f8377/0xb0c3a59caa40fc10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.500638:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000094f8377/0xb0c3a59caa40fc10 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.500657:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000094f8377/0xb0c3a59caa40fc10 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.500675:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635427.500677:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635427.500678:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789635427.500707:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d0446c3f100/2, rc 0, transno 4294967308 00000100:00100000:1.0:1789635427.500715:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0446c3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427358848:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789635427.502464:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f931 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502491:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f931 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502499:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f931 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502504:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540030200 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635427.502509:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f931 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502516:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f931 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502530:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d0544e2e800) 00010000:00010000:0.0:1789635427.502535:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635427.502539:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f931 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502545:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40f931 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502565:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f938 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502571:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f938 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502576:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f938 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502581:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540030c00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635427.502590:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f938 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502611:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f938 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502620:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d0544e2e500) 00010000:00010000:0.0:1789635427.502623:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635427.502625:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f938 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502631:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40f938 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502646:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f977 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502651:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f977 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502656:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f977 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502660:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540031c00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635427.502662:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f977 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502668:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f977 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502674:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d0544e2e900) 00010000:00010000:0.0:1789635427.502676:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635427.502685:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f977 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502691:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40f977 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502706:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40fa7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502711:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40fa7a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502716:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40fa7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502721:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1b400 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635427.502724:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40fa7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502729:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40fa7a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502738:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:0.0:1789635427.502740:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635427.502743:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40fa7a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502748:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40fa7a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502759:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fa9d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502764:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fa9d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502776:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fa9d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502781:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3a00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635427.502784:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fa9d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502790:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fa9d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502798:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:0.0:1789635427.502800:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635427.502803:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fa9d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502809:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fa9d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502821:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fae3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502894:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fae3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502899:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fae3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502904:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a2600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635427.502906:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fae3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502921:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fae3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502930:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:0.0:1789635427.502932:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635427.502935:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fae3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502939:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fae3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502953:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fbe6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502958:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fbe6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502964:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fbe6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502969:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152a00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635427.502972:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fbe6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502977:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fbe6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.502983:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d04466cae00) 00010000:00010000:0.0:1789635427.502985:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789635427.502988:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fbe6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.503167:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fbe6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789635427.503189:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1789635427.503245:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1789635427.503759:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447bfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427358976:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789635427.503827:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635427.503886:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427358976 00000100:00100000:0.0:1789635427.503894:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427358976 00000100:00100000:0.0:1789635427.503950:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789635427.503959:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0446c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427358976:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789635427.504086:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789635427.504090:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789635427 00002000:00010000:0.0:1789635427.504092:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789635427.504094:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789635427 -> 1789635427 00002000:00010000:0.0:1789635427.504096:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1789635427.504146:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0446c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1876568427358976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 187us (318us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789635427.504153:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1789635427.504174:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789635427.504279:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e015f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+19:12346:x1876568411562624:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 Request processed in 9454us (9636us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635427.504287:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 197 00000004:00080000:1.0:1789635427.504703:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d0447bfbb80/2, rc 0, transno 4294967316 00000100:00100000:1.0:1789635427.504711:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447bfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427358976:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789635427.510862:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635427.511032:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411562752 00000100:00100000:3.0:1789635427.511042:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411562752 00000100:00100000:3.0:1789635427.511109:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00100000:3.0:1789635427.511122:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+10:2396:x1876568411562752:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1789635427.513253:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:2.0:1789635427.513266:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1789635427.513697:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:2396:x1876568411562752:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 Request processed in 2572us (3236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635427.513709:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00100000:3.0:1789635427.517703:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635427.517933:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411563008 00000100:00100000:2.0:1789635427.517943:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411563008 00000100:00100000:2.0:1789635427.518012:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 198 00000100:00100000:2.0:1789635427.518023:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+19:12346:x1876568411563008:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789635427.518074:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635427.518101:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fbfb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7427c expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.518119:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d04466cae00) 00010000:00010000:2.0:1789635427.518124:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789635427.518154:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40fc17 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.518181:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40fc17 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.518191:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40fc17 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789635427.518304:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096684fed reply state 000000009c2ccada transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40fc17 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.518316:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40fc17 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.518323:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d04466cae00) 00010000:00010000:2.0:1789635427.518325:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789635427.518328:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789635427.518585:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+20:12346:x1876568411563008:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 563us (889us total) trans 4294967463 rc 0/0 00000100:00100000:2.0:1789635427.518593:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 198 00000100:00100000:2.0:1789635427.522075:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635427.522168:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411563136 00000100:00100000:3.0:1789635427.522177:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411563136 00000100:00100000:3.0:1789635427.522233:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 64 00000100:00100000:3.0:1789635427.522244:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:2397:x1876568411563136:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789635427.522424:0:10116:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789635427.522427:0:10116:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1789635427 -> 1789635427 00002000:00010000:3.0:1789635427.522430:0:10116:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789635425 00002000:00010000:3.0:1789635427.522432:0:10116:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789635427 -> 1789635427 00002000:00010000:3.0:1789635427.522435:0:10116:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1789635427.522683:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:2397:x1876568411563136:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 439us (616us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1789635427.522691:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 64 00000100:00100000:0.0:1789635427.526732:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635427.526818:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411563392 00000100:00100000:2.0:1789635427.526828:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411563392 00000100:00100000:2.0:1789635427.526885:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 199 00000100:00100000:2.0:1789635427.526895:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+20:12346:x1876568411563392:12345-192.168.203.20@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789635427.526971:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fc1e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.526989:0:9526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fbdf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7426e expref: 20 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.527011:0:9526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fc1e lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.527044:0:9526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fbdf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7426e expref: 20 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.527059:0:9526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fbdf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7426e expref: 20 pid: 10094 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635427.527075:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447974000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9526:1876568427359104:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789635427.527162:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05429e7540 going to sleep for 11 seconds 00000100:00100000:2.0:1789635427.530104:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447974000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9526:1876568427359104:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789635427.530136:0:9526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fc1e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635427.531290:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635427.534361:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411563520 00000100:00100000:3.0:1789635427.534373:0:7457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411563520 00010000:00010000:3.0:1789635427.534485:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fbdf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7426e expref: 21 pid: 10094 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635427.534631:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 87 00000100:00100000:1.0:1789635427.534643:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543297480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+21:2397:x1876568411563520:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635427.534658:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635427.534665:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fbdf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7426e expref: 21 pid: 10094 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.534678:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fbdf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7426e expref: 21 pid: 10094 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.534706:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fbdf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7426e expref: 21 pid: 10094 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.534734:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d04466cae00) 00010000:00010000:1.0:1789635427.534748:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fc1e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.534758:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fc1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.534764:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fc1e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.534788:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789635427.534813:0:9526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fc1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.534824:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fc1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635427.534853:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543297480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+20:2397:x1876568411563520:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 212us (3567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635427.534860:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 87 00010000:00010000:2.0:1789635427.534864:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fc1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.534873:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fc1e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.534881:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fc1e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.534894:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540030200 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635427.534898:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fc1e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.534905:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fc1e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.534917:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d04466cae00) 00010000:00010000:2.0:1789635427.534919:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789635427.534923:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fc1e lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.534929:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fc1e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635427.535038:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+19:12346:x1876568411563392:12345-192.168.203.20@tcp:55:lhsmtool_posix.0 Request processed in 8144us (8314us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789635427.535047:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 199 00000100:00100000:0.0:1789635427.537709:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635427.538246:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411563648 00000100:00100000:1.0:1789635427.538256:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411563648 00000100:00100000:1.0:1789635427.538305:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 65 00000100:00100000:1.0:1789635427.538315:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543295180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:2396:x1876568411563648:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789635427.538357:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000094f8377/0xb0c3a59caa40fc25 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.538453:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000070c933e6/0xb0c3a59caa40fc09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7428a expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.538464:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635427.538469:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789635427.538474:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000094f8377/0xb0c3a59caa40fc25 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.538519:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000070c933e6/0xb0c3a59caa40fc09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7428a expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.538533:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000070c933e6/0xb0c3a59caa40fc09 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7428a expref: 8 pid: 8431 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635427.540050:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bfa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8431:1876568427359232:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789635427.540283:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446df50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635427.545478:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bfa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8431:1876568427359232:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789635427.545507:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000094f8377/0xb0c3a59caa40fc25 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635427.548288:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635427.548379:0:13189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411563776 00000100:00100000:0.0:1789635427.548389:0:13189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411563776 00010000:00010000:0.0:1789635427.548449:0:13189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000070c933e6/0xb0c3a59caa40fc09 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7428a expref: 9 pid: 8431 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635427.548486:0:13189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 88 00000100:00100000:0.0:1789635427.548495:0:13189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b405050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+9:2396:x1876568411563776:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789635427.548521:0:13189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635427.548552:0:13189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000070c933e6/0xb0c3a59caa40fc09 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7428a expref: 9 pid: 8431 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.548565:0:13189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000070c933e6/0xb0c3a59caa40fc09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7428a expref: 9 pid: 8431 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.548587:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070c933e6/0xb0c3a59caa40fc09 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7428a expref: 9 pid: 8431 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.549634:0:13189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789635427.549641:0:13189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789635427.549649:0:13189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000094f8377/0xb0c3a59caa40fc25 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.549662:0:13189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000094f8377/0xb0c3a59caa40fc25 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.549703:0:13189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789635427.549720:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000094f8377/0xb0c3a59caa40fc25 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.549730:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000094f8377/0xb0c3a59caa40fc25 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.549752:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000094f8377/0xb0c3a59caa40fc25 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.549761:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000094f8377/0xb0c3a59caa40fc25 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635427.549771:0:13189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b405050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:2396:x1876568411563776:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 1275us (1555us total) trans 0 rc 0/0 00010000:00010000:2.0:1789635427.549776:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000094f8377/0xb0c3a59caa40fc25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635427.549780:0:13189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 88 00010000:00010000:2.0:1789635427.549784:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152800 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635427.549788:0:8431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000094f8377/0xb0c3a59caa40fc25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.549796:0:8431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000094f8377/0xb0c3a59caa40fc25 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.549810:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000094f8377/0xb0c3a59caa40fc25 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.549816:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000094f8377/0xb0c3a59caa40fc25 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635427.549865:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543295180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:2396:x1876568411563648:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 Request processed in 11548us (12161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635427.549873:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 65 00000100:00100000:3.0:1789635427.553743:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635427.553970:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411564032 00000100:00100000:2.0:1789635427.553980:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411564032 00000100:00100000:2.0:1789635427.554036:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 200 00000100:00100000:2.0:1789635427.554047:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447bf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+19:12346:x1876568411564032:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789635427.554122:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fc2c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.554148:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fa73 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74213 expref: 19 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.554159:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fc2c lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.554194:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fa73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74213 expref: 19 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.554208:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fa73 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74213 expref: 19 pid: 9526 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635427.554221:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447974000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6516:1876568427359360:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789635427.554305:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05429e7540 going to sleep for 11 seconds 00000100:00100000:3.0:1789635427.558617:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447974000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6516:1876568427359360:192.168.203.20@tcp:104: 00010000:00010000:3.0:1789635427.558648:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fc2c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635427.559572:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635427.562761:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411564160 00000100:00100000:3.0:1789635427.562778:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411564160 00010000:00010000:3.0:1789635427.562822:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fa73 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74213 expref: 20 pid: 9526 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635427.564808:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 89 00000100:00100000:3.0:1789635427.564827:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+20:2396:x1876568411564160:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635427.564843:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635427.564859:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fa73 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74213 expref: 20 pid: 9526 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.564874:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fa73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74213 expref: 20 pid: 9526 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.564896:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fa73 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74213 expref: 20 pid: 9526 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.564909:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:3.0:1789635427.564913:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fc2c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.564922:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fc2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.564928:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fc2c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.564956:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635427.565008:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+19:2396:x1876568411564160:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 189us (5440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635427.565014:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 89 00010000:00010000:1.0:1789635427.565058:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fc2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.565066:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fc2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.565252:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fc33 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.565264:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40fbed lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74275 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.565273:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fc33 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.565314:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40fbed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74275 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.565327:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40fbed lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74275 expref: 19 pid: 6515 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635427.565342:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bf8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6516:1876568427359488:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789635427.565394:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446df5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789635427.569366:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635427.569468:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bf8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6516:1876568427359488:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789635427.569501:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fc33 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635427.569693:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411564288 00000100:00100000:3.0:1789635427.569701:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411564288 00010000:00010000:3.0:1789635427.569736:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40fbed lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74275 expref: 20 pid: 6515 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635427.569856:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 90 00000100:00100000:3.0:1789635427.569866:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447975f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+20:2397:x1876568411564288:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635427.569899:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635427.569908:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40fbed lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74275 expref: 20 pid: 6515 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.569919:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40fbed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74275 expref: 20 pid: 6515 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.569941:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40fbed lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74275 expref: 20 pid: 6515 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.569955:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d04466cae00) 00010000:00010000:3.0:1789635427.569959:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fc33 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.569968:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fc33 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.569977:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fc33 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.569997:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635427.570042:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447975f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+19:2397:x1876568411564288:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 178us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635427.570050:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 90 00010000:00010000:1.0:1789635427.570111:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fc33 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.570119:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fc33 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789635427.570221:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:1.0:1789635427.570331:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:1.0:1789635427.570371:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:1.0:1789635427.570587:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bf8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6516:1876568427359616:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789635427.570862:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635427.570889:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05746cfa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789635427.571147:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427359616 00000100:00100000:3.0:1789635427.571152:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427359616 00000100:00100000:3.0:1789635427.571187:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789635427.571194:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6516:x1876568427359616:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789635427.571418:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6516:x1876568427359616:12345-0@lo:1000:mdt00_002.0 Request processed in 212us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635427.571436:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789635427.571554:0:6516:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:0.0:1789635427.571560:0:6516:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d0447bfbb80, transno 4294967316 00000100:00100000:0.0:1789635427.571578:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bf8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6516:1876568427359616:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1789635427.572664:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:0.0:1789635427.572731:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543297480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6516:1876568427359744:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789635427.572780:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635427.572804:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0545287300 going to sleep for 11 seconds 00000100:00100000:2.0:1789635427.572883:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427359744 00000100:00100000:2.0:1789635427.572890:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427359744 00000100:00100000:2.0:1789635427.572933:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789635427.572942:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6516:x1876568427359744:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789635427.573057:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6516:x1876568427359744:12345-0@lo:1000:mdt00_002.0 Request processed in 116us (277us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789635427.573064:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789635427.573104:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543297480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6516:1876568427359744:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1789635427.573138:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fc33 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.573147:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fc33 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.573162:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fc33 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.573168:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e153000 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635427.573173:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fc33 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.573181:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fc33 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.573196:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d04466cae00) 00010000:00010000:2.0:1789635427.573199:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789635427.573203:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fc33 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.573209:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fc33 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.573230:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40fb68 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.573236:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40fb68 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.573241:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40fb68 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.573245:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540030a00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635427.573248:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40fb68 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.573264:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40fb68 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.573274:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:2.0:1789635427.573276:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789635427.573279:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40fb68 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.573284:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40fb68 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.573305:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40fc3a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.573318:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff400/0xb0c3a59caa40fb84 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74259 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.573328:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40fc3a lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.573353:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff400/0xb0c3a59caa40fb84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74259 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635427.573366:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff400/0xb0c3a59caa40fb84 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74259 expref: 22 pid: 6515 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635427.573377:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447977100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6516:1876568427359872:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789635427.573451:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05429e7540 going to sleep for 11 seconds 00000100:00100000:0.0:1789635427.579352:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447977100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6516:1876568427359872:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789635427.579382:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40fc3a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635427.583778:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635427.585206:0:13189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411564416 00000100:00100000:1.0:1789635427.585220:0:13189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411564416 00010000:00010000:1.0:1789635427.585266:0:13189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff400/0xb0c3a59caa40fb84 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74259 expref: 23 pid: 6515 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635427.585378:0:13189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 91 00000100:00100000:1.0:1789635427.585389:0:13189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0541325500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+23:2397:x1876568411564416:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635427.585413:0:13189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635427.585421:0:13189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff400/0xb0c3a59caa40fb84 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74259 expref: 23 pid: 6515 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.585438:0:13189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff400/0xb0c3a59caa40fb84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74259 expref: 23 pid: 6515 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.585467:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff400/0xb0c3a59caa40fb84 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74259 expref: 23 pid: 6515 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.585483:0:13189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:1.0:1789635427.585494:0:13189:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40fc3a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.585504:0:13189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40fc3a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.585512:0:13189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40fc3a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635427.585543:0:13189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789635427.585593:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40fc3a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635427.585610:0:13189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0541325500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+22:2397:x1876568411564416:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 209us (1825us total) trans 0 rc 0/0 00010000:00010000:3.0:1789635427.585617:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40fc3a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635427.585618:0:13189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 91 00010000:00010000:3.0:1789635427.585638:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40fc3a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.585645:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40fc3a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.585651:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40fc3a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.585656:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540031c00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635427.585660:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40fc3a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.585667:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40fc3a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.585676:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:3.0:1789635427.585679:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635427.585683:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40fc3a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.585689:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40fc3a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.585700:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fc2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.585713:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fc2c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.585719:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fc2c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.585724:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540030200 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635427.585728:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fc2c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.585734:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fc2c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.585859:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0544e2e400) 00010000:00010000:3.0:1789635427.585861:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789635427.585864:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fc2c lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.585870:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fc2c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635427.586945:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447bf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+21:12346:x1876568411564032:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 32896us (33208us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1789635427.586955:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 200 00000020:00080000:3.0:1789635427.586960:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789635427.587052:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789635427.587056:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789635427.589850:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789635427.589867:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789635427.590450:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635427.590627:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411564672 00000100:00100000:3.0:1789635427.590649:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411564672 00000100:00100000:3.0:1789635427.590698:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 50 00000100:00100000:3.0:1789635427.590706:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b747850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+21:12346:x1876568411564672:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789635427.591094:0:6518:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789635427.591125:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:3.0:1789635427.591157:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa40fc41 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.591173:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa40fc41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.591185:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa40fc41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.591192:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa40fc41 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.591199:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa40fc41 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.591206:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa40fc41 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635427.591387:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789635427.591481:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b747850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+23:12346:x1876568411564672:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 774us (1033us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1789635427.591494:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 50 00000020:00080000:3.0:1789635427.591498:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789635427.593652:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635427.593665:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa40fc41 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.593678:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488ffe00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:0.0:1789635427.593682:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa40fc41 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.593692:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa40fc41 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.593708:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d04466cae00) 00010000:00010000:0.0:1789635427.593712:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789635427.593716:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa40fc41 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.593722:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa40fc41 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635427.593750:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635427.593753:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635427.593754:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789635428.074344:0:14609:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789635428.074354:0:14609:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789635428.074384:0:14609:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1789635428.074396:0:14609:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789635428.197037:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635428.198356:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411564928 00000100:00100000:2.0:1789635428.198375:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411564928 00000100:00100000:2.0:1789635428.198455:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 201 00000100:00100000:2.0:1789635428.198466:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+23:12365:x1876568411564928:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1789635428.198492:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635428.198513:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40fc48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74291 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.198645:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40fc4f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.198659:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40fc4f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.198680:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40fc4f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635428.198691:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789635428.198982:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40fc48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74291 expref: 26 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.199000:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40fc4f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74291 expref: 25 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.199009:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d0544e2e500) 00010000:00010000:2.0:1789635428.199012:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789635428.199015:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0540031c00, rc 0) 00000100:00100000:2.0:1789635428.199093:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+25:12365:x1876568411564928:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 629us (2066us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1789635428.199101:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 201 00000100:00100000:1.0:1789635428.205864:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635428.206095:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411565056 00000100:00100000:3.0:1789635428.206109:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411565056 00000100:00100000:3.0:1789635428.206170:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 202 00000100:00100000:3.0:1789635428.206180:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+25:12365:x1876568411565056:12345-192.168.203.20@tcp:34:lfs.0 00010000:00010000:3.0:1789635428.206255:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffa00/0xb0c3a59caa40fc5d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.206272:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffa00/0xb0c3a59caa40fc5d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.206285:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffa00/0xb0c3a59caa40fc5d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.206299:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa40fc64 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.206306:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa40fc64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.206313:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa40fc64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.206385:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa40fc6b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.206394:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa40fc6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.206411:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa40fc6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789635428.206457:0:9526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa40fc6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.206477:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffa00/0xb0c3a59caa40fc5d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.206483:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffa00/0xb0c3a59caa40fc5d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.206490:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffa00/0xb0c3a59caa40fc5d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.206495:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488ffa00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635428.206499:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffa00/0xb0c3a59caa40fc5d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.206506:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffa00/0xb0c3a59caa40fc5d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.206518:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d0544e2e500) 00010000:00010000:3.0:1789635428.206520:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635428.206524:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffa00/0xb0c3a59caa40fc5d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.206529:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffa00/0xb0c3a59caa40fc5d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.206540:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa40fc64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.206546:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa40fc64 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.206552:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa40fc64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.206563:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488fea00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635428.206566:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa40fc64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.206572:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa40fc64 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.206625:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d044764bb00) 00010000:00010000:3.0:1789635428.206628:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635428.206632:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa40fc64 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.206637:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa40fc64 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.206656:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa40fc6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.206662:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa40fc6b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.206667:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa40fc6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.206672:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488ff000 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635428.206675:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa40fc6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.206681:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa40fc6b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.206701:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d044764be00) 00010000:00010000:3.0:1789635428.206704:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635428.206707:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa40fc6b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.206713:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa40fc6b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635428.206973:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+25:12365:x1876568411565056:12345-192.168.203.20@tcp:34:lfs.0 Request processed in 792us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635428.206981:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 202 00000100:00100000:3.0:1789635428.256056:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635428.256357:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411565312 00000100:00100000:0.0:1789635428.256368:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411565312 00000100:00100000:0.0:1789635428.256437:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 203 00000100:00100000:0.0:1789635428.256448:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+25:12368:x1876568411565312:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1789635428.256468:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635428.256487:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40fc72 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74298 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.256553:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fc79 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.256566:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fc79 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.256577:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fc79 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.256590:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40fc80 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.256615:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40fc80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.256622:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40fc80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.256751:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fc87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.256760:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fc87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.256767:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fc87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635428.256778:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1789635428.256853:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fc79 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.256861:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fc79 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.256868:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fc79 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.256874:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1a600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635428.256877:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fc79 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.256884:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fc79 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.256895:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d0544e2e500) 00010000:00010000:0.0:1789635428.256897:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635428.256901:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fc79 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.256918:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fc79 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.256931:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40fc80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.256937:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40fc80 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.256943:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40fc80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.256947:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1bc00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635428.256950:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40fc80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.256956:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40fc80 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.256963:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d0447667900) 00010000:00010000:0.0:1789635428.256965:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635428.256968:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40fc80 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.256973:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40fc80 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.257007:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40fc72 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74298 expref: 28 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.257019:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fc87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74298 expref: 27 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.257031:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0447667200) 00010000:00010000:0.0:1789635428.257033:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789635428.257036:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1b600, rc 0) 00000100:00100000:0.0:1789635428.257089:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+27:12368:x1876568411565312:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 642us (1040us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1789635428.257095:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 203 00000100:00100000:0.0:1789635428.262549:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635428.263925:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411565440 00000100:00100000:1.0:1789635428.263938:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411565440 00000100:00100000:1.0:1789635428.264001:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 204 00000100:00100000:1.0:1789635428.264012:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+27:12368:x1876568411565440:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:1.0:1789635428.264076:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fc95 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.264094:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fc95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.264106:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fc95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.264140:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fc95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.264155:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fc95 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.264162:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fc95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.264170:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152800 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635428.264175:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fc95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.264183:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fc95 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.264196:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0447667200) 00010000:00010000:1.0:1789635428.264200:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789635428.264222:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fc95 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.264229:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fc95 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635428.265290:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+27:12368:x1876568411565440:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 1273us (2742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635428.265300:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 204 00000100:00100000:0.0:1789635428.271261:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635428.271421:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411565696 00000100:00100000:1.0:1789635428.271431:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411565696 00000100:00100000:1.0:1789635428.271495:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00100000:1.0:1789635428.271506:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+27:12368:x1876568411565696:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:1.0:1789635428.271758:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+28:12368:x1876568411565696:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 253us (504us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1789635428.271766:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00100000:0.0:1789635428.313643:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635428.313704:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411565952 00000100:00100000:3.0:1789635428.313714:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411565952 00000100:00100000:2.0:1789635428.313915:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 205 00000100:00100000:2.0:1789635428.313928:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+28:11901:x1876568411565952:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1789635428.313953:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635428.313974:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40fc9c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7429f expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.314083:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fca3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.314108:0:10094:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fc87 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74298 expref: 29 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.314124:0:10094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fca3 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.314165:0:10094:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fc87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74298 expref: 29 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.314179:0:10094:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fc87 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74298 expref: 29 pid: 6516 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635428.314198:0:10094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447977100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10094:1876568427360000:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789635428.314285:0:10094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05489c2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789635428.324298:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635428.324669:0:10094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447977100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10094:1876568427360000:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789635428.324695:0:10094:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fca3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635428.324916:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411566080 00000100:00100000:3.0:1789635428.324924:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411566080 00010000:00010000:3.0:1789635428.324961:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fc87 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74298 expref: 30 pid: 6516 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635428.325005:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 92 00000100:00100000:3.0:1789635428.325016:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+30:2396:x1876568411566080:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635428.325031:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635428.325038:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fc87 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74298 expref: 30 pid: 6516 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.325050:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fc87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74298 expref: 30 pid: 6516 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.325096:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fc87 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74298 expref: 30 pid: 6516 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.325112:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0447667200) 00010000:00010000:3.0:1789635428.325117:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fca3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.325126:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fca3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.325133:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fca3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.325164:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635428.325213:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+29:2396:x1876568411566080:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 199us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635428.325221:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 92 00010000:00010000:1.0:1789635428.325443:0:10094:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fca3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.325462:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fca3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635428.325480:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789635428.325640:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40fc9c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7429f expref: 30 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.325658:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fca3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7429f expref: 29 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.325678:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0447667200) 00010000:00010000:1.0:1789635428.325681:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789635428.325684:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0540030200, rc 0) 00000100:00100000:1.0:1789635428.325726:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+29:11901:x1876568411565952:12345-192.168.203.20@tcp:101:bash.0 Request processed in 11801us (12137us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1789635428.325734:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 205 00000100:00100000:0.0:1789635428.329516:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635428.333182:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411566208 00000100:00100000:1.0:1789635428.333197:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411566208 00000100:00100000:1.0:1789635428.333299:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 206 00000100:00100000:1.0:1789635428.333308:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+29:11901:x1876568411566208:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:1.0:1789635428.333332:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635428.333351:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fcb1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab742a6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.333384:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fcb8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.333397:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fcb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.333417:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fcb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.333559:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fcb1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742a6 expref: 31 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.333577:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fcb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742a6 expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.333593:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0447667200) 00010000:00010000:1.0:1789635428.333770:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789635428.333841:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e153a00, rc 0) 00000100:00100000:1.0:1789635428.333951:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+30:11901:x1876568411566208:12345-192.168.203.20@tcp:101:bash.0 Request processed in 643us (4443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635428.333959:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 206 00000100:00100000:0.0:1789635428.337272:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635428.337360:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411566464 00000100:00100000:1.0:1789635428.337369:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411566464 00000100:00100000:1.0:1789635428.337475:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 207 00000100:00100000:1.0:1789635428.337495:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044881c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+30:11901:x1876568411566464:12345-192.168.203.20@tcp:36:bash.0 00010000:00010000:1.0:1789635428.337851:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fcbf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.337867:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fcbf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.337879:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fcbf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789635428.337924:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:1.0:1789635428.337946:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000088c928d2 reply state 0000000081302b4b transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fcbf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.337959:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fcbf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.337966:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0447667200) 00010000:00010000:1.0:1789635428.337969:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789635428.337980:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789635428.338021:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:1.0:1789635428.338130:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044881c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+34:11901:x1876568411566464:12345-192.168.203.20@tcp:36:bash.0 Request processed in 644us (866us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1789635428.338138:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 207 00000020:00080000:1.0:1789635428.338143:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789635428.340571:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635428.340764:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411566592 00000100:00100000:2.0:1789635428.340797:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411566592 00000100:00100000:2.0:1789635428.340862:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 208 00000100:00100000:2.0:1789635428.340872:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044881fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+34:11901:x1876568411566592:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1789635428.340897:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635428.340916:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40fcc6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab742ad expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.340973:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40fcc6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742ad expref: 35 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.340988:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40fcc6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742ad expref: 35 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.341006:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0447667200) 00010000:00010000:2.0:1789635428.341009:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789635428.341012:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0540030a00, rc 0) 00000100:00100000:2.0:1789635428.341065:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044881fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+35:11901:x1876568411566592:12345-192.168.203.20@tcp:101:bash.0 Request processed in 194us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635428.341072:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 208 00000100:00100000:3.0:1789635428.344200:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635428.344377:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411566720 00000100:00100000:0.0:1789635428.344387:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411566720 00000100:00100000:0.0:1789635428.344454:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 66 00000100:00100000:0.0:1789635428.344464:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044791ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:11901:x1876568411566720:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:0.0:1789635428.344483:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635428.344516:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7e1938c/0xb0c3a59caa40fccd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab742b4 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789635428.344541:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aabab63, atime: 0x6aabab61, ctime: 0x6aabab63, blocks: 0x8 00010000:00010000:0.0:1789635428.344561:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=447s v=(0 0) 00010000:00010000:0.0:1789635428.344567:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635428.344575:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7e1938c/0xb0c3a59caa40fccd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742b4 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.344653:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d7e1938c/0xb0c3a59caa40fccd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742b4 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.344667:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1be00, rc 0) 00000100:00100000:0.0:1789635428.344734:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044791ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:11901:x1876568411566720:12345-192.168.203.20@tcp:101:bash.0 Request processed in 271us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635428.344741:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 66 00000100:00100000:0.0:1789635428.352365:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635428.353223:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411566848 00000100:00100000:2.0:1789635428.353236:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411566848 00002000:00010000:2.0:1789635428.353285:0:8437:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1789635428.353290:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d044881f800 with x1876568411566848 ext(0->18446744073709551615) 00002000:00010000:2.0:1789635428.353303:0:8437:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d044881f800. 00000100:00100000:2.0:1789635428.353388:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:2.0:1789635428.353411:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044881f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:2397:x1876568411566848:12345-192.168.203.20@tcp:10:bash.0 00002000:00010000:2.0:1789635428.353767:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789635428.353780:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1789635427 -> 1789635428 00002000:00010000:2.0:1789635428.353783:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1789635425 -> 1789635425 00002000:00010000:2.0:1789635428.353785:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789635427 -> 1789635428 00002000:00010000:2.0:1789635428.353786:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1789635428.353851:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044881f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+9:2397:x1876568411566848:12345-192.168.203.20@tcp:10:bash.0 Request processed in 452us (1493us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789635428.353859:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 5 00002000:00010000:2.0:1789635428.353863:0:8437:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1789635428.353866:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d044881f800 with x1876568411566848 ext(0->18446744073709551615) 00002000:00010000:2.0:1789635428.353870:0:8437:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d044881f800. 00000100:00100000:1.0:1789635428.455375:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635428.455722:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411566976 00000100:00100000:2.0:1789635428.455732:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411566976 00000100:00100000:2.0:1789635428.455800:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 209 00000100:00100000:2.0:1789635428.455811:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+35:12382:x1876568411566976:12345-192.168.203.20@tcp:34:lfs.0 00010000:00010000:2.0:1789635428.455883:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40fcd4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.455901:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40fcd4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.455912:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40fcd4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.455929:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fcdb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.455937:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fcdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.455944:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fcdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.456454:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fce2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.456465:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fce2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.456472:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fce2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789635428.456526:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fce2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.456537:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40fcd4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.456543:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40fcd4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.456549:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40fcd4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.456555:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540031400 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635428.456559:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40fcd4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.456567:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40fcd4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.456578:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d0544e2e500) 00010000:00010000:2.0:1789635428.456581:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635428.456586:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40fcd4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.456743:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031400/0xb0c3a59caa40fcd4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.456759:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fcdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.456766:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fcdb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.456772:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fcdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.456777:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3800 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635428.456780:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fcdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.456785:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fcdb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.456794:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d0543c44a00) 00010000:00010000:2.0:1789635428.456796:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635428.456799:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fcdb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.456805:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fcdb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.456818:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fce2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.456824:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fce2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.456837:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fce2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.456841:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a2600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635428.456844:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fce2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.456849:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fce2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.456857:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0447667200) 00010000:00010000:2.0:1789635428.456860:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635428.456863:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fce2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.456868:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fce2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635428.467691:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+35:12382:x1876568411566976:12345-192.168.203.20@tcp:34:lfs.0 Request processed in 11870us (12315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635428.467707:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 209 00010000:00010000:1.0:1789635428.516151:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635428.525784:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635428.526064:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411567232 00000100:00100000:2.0:1789635428.526078:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411567232 00000100:00100000:2.0:1789635428.526231:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 210 00000100:00100000:2.0:1789635428.526246:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+35:12385:x1876568411567232:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1789635428.526274:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635428.526311:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fce9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab742bb expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.526425:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fcf0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.526442:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fcf0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.526474:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fcf0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.526492:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fcf7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.526501:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fcf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.526508:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fcf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.526703:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40fcfe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.526714:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40fcfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.526722:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40fcfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635428.526742:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789635428.527331:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fcf0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.527343:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fcf0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.527351:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fcf0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.527357:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3800 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635428.527437:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fcf0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.527447:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fcf0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.527463:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d0544e2e500) 00010000:00010000:2.0:1789635428.527466:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635428.527471:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fcf0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.527477:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fcf0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.527495:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fcf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.527502:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fcf7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.527507:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fcf7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.527512:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3a00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635428.527514:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fcf7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.527520:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fcf7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.527527:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d0543c44a00) 00010000:00010000:2.0:1789635428.527529:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635428.527539:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fcf7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.527545:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fcf7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.527655:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fce9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742bb expref: 38 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.527672:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40fcfe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742bb expref: 37 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.527680:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0447667200) 00010000:00010000:2.0:1789635428.527682:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789635428.527685:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a3000, rc 0) 00000100:00100000:2.0:1789635428.528394:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+37:12385:x1876568411567232:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 2146us (2629us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1789635428.528419:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 210 00000100:00100000:0.0:1789635428.532994:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635428.533237:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411567360 00000100:00100000:1.0:1789635428.533250:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411567360 00000100:00100000:1.0:1789635428.533336:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 211 00000100:00100000:1.0:1789635428.533349:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044881ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+37:12385:x1876568411567360:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:1.0:1789635428.533700:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fd0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.533722:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fca3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7429f expref: 37 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.533733:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fd0c lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.533793:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fca3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7429f expref: 37 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.533808:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fca3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7429f expref: 37 pid: 10094 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635428.533824:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bf9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6515:1876568427360128:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789635428.533933:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0548dc63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635428.538716:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bf9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6515:1876568427360128:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789635428.538779:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fd0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635428.540095:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635428.540779:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411567616 00000100:00100000:0.0:1789635428.540792:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411567616 00000100:00100000:0.0:1789635428.540872:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 52 00000100:00100000:0.0:1789635428.540885:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+38:6163:x1876568411567616:12345-192.168.203.20@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789635428.541259:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+39:6163:x1876568411567616:12345-192.168.203.20@tcp:35:ldlm_bl.0 Request processed in 375us (1173us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1789635428.541268:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 52 00000100:00100000:3.0:1789635428.547043:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635428.547213:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411567744 00000100:00100000:1.0:1789635428.547227:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411567744 00010000:00010000:1.0:1789635428.547281:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fca3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7429f expref: 39 pid: 10094 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635428.547659:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 93 00000100:00100000:1.0:1789635428.547672:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05412af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+39:2396:x1876568411567744:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635428.547691:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635428.547700:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fca3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7429f expref: 39 pid: 10094 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.547717:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fca3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7429f expref: 39 pid: 10094 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.547754:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030200/0xb0c3a59caa40fca3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7429f expref: 39 pid: 10094 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.547788:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0447667200) 00010000:00010000:1.0:1789635428.547794:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fd0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.547806:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fd0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.547814:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fd0c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.547860:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635428.547955:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05412af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+38:2396:x1876568411567744:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 286us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635428.547964:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 93 00010000:00010000:2.0:1789635428.548035:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fd0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.548045:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fd0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.548095:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fd0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.548102:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fd0c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.548109:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fd0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.548135:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e153600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635428.548141:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fd0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.548150:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fd0c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.548160:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0447667200) 00010000:00010000:2.0:1789635428.548163:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789635428.548167:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fd0c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.548174:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fd0c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635428.548219:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044881ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+37:12385:x1876568411567360:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 14873us (15239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635428.548229:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 211 00000100:00100000:1.0:1789635428.552878:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635428.553625:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411568000 00000100:00100000:0.0:1789635428.553641:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411568000 00000100:00100000:0.0:1789635428.553736:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:0.0:1789635428.553749:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+37:12385:x1876568411568000:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:0.0:1789635428.554082:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+38:12385:x1876568411568000:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 335us (1218us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1789635428.554092:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:3.0:1789635428.660846:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635428.660988:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411568256 00000100:00100000:1.0:1789635428.661005:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411568256 00000100:00100000:1.0:1789635428.661083:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 212 00000100:00100000:1.0:1789635428.661096:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05446f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+38:12396:x1876568411568256:12345-192.168.203.20@tcp:101:cat.0 00010000:00010000:1.0:1789635428.661121:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635428.661144:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fd13 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab742c2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.661214:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fd1a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.661229:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fd1a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.661240:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fd1a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.661257:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fd21 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.661264:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fd21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.661270:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fd21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.661586:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fd28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.661660:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fd28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.661668:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fd28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635428.661678:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:1.0:1789635428.661752:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fd1a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.661760:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fd1a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.661766:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fd1a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.661772:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152400 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635428.661776:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fd1a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.661782:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fd1a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.661794:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d0544e2e500) 00010000:00010000:1.0:1789635428.661796:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635428.661800:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fd1a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.661805:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fd1a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.661816:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fd21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.661828:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fd21 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.661834:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fd21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.661839:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e153000 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635428.661842:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fd21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.661848:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fd21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.661856:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d04466cad00) 00010000:00010000:1.0:1789635428.661859:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635428.661861:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fd21 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.661867:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fd21 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.661909:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fd13 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742c2 expref: 41 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.661923:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fd28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742c2 expref: 40 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.661930:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0447667200) 00010000:00010000:1.0:1789635428.661932:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789635428.661940:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e153600, rc 0) 00000100:00100000:1.0:1789635428.662007:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05446f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+40:12396:x1876568411568256:12345-192.168.203.20@tcp:101:cat.0 Request processed in 913us (1174us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1789635428.662014:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 212 00000100:00100000:3.0:1789635428.670759:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635428.670920:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411568512 00000100:00100000:0.0:1789635428.670932:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411568512 00000100:00100000:0.0:1789635428.671000:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 54 00000100:00100000:0.0:1789635428.671011:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+40:12396:x1876568411568512:12345-192.168.203.20@tcp:35:cat.0 00000100:00100000:0.0:1789635428.671377:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+41:12396:x1876568411568512:12345-192.168.203.20@tcp:35:cat.0 Request processed in 367us (632us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1789635428.671385:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 54 00000100:00100000:0.0:1789635428.703012:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635428.703184:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411568768 00000100:00100000:2.0:1789635428.703198:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411568768 00000100:00100000:2.0:1789635428.703278:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 213 00000100:00100000:2.0:1789635428.703291:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054648e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+41:12397:x1876568411568768:12345-192.168.203.20@tcp:36:rm.0 00010000:00010000:2.0:1789635428.703376:0:10094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1789635428.704030:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030a00/0xb0c3a59caa40fcc6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742ad expref: 41 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.704063:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fd28 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742c2 expref: 40 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.704105:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40fcfe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742bb expref: 39 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.704119:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fcb8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742a6 expref: 38 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.704131:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0447667200) 00010000:00010000:2.0:1789635428.704137:0:10094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789635428.704165:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fd36 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.704182:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fd36 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.704194:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fd36 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.704210:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fd3d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.704217:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fd3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.704225:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fd3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.704325:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fd44 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.704336:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fd44 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.704351:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fd44 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789635428.711073:0:10094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1789635428.711096:0:10094:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 447394499024ns, next at 448394494981ns, rc = 0 00010000:00010000:2.0:1789635428.711187:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40fd4b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.711208:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40fd4b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.711222:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40fd4b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.711233:0:10094:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40fd4b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.711240:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40fd4b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.711245:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40fd4b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.711352:0:10094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789635428.711404:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fd44 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.711412:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fd44 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.711428:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fd44 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.711463:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3800 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635428.711469:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fd44 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.711487:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fd44 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.711504:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0447667200) 00010000:00010000:2.0:1789635428.711507:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789635428.711513:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fd44 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.711519:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3800/0xb0c3a59caa40fd44 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.711546:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fd36 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.711553:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fd36 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.711559:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fd36 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.711564:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a2600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635428.711567:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fd36 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.711574:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fd36 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.711593:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d0544e2e500) 00010000:00010000:2.0:1789635428.711617:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635428.711621:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fd36 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.711627:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fd36 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789635428.711639:0:10094:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af5e457a reply state 0000000054cde7a1 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fd3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.711651:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fd3d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.711657:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d0543c44a00) 00010000:00010000:2.0:1789635428.711659:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789635428.711663:0:10094:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789635428.711797:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054648e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+39:12397:x1876568411568768:12345-192.168.203.20@tcp:36:rm.0 Request processed in 8503us (8794us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1789635428.711809:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 213 00010000:00010000:1.0:1789635428.718565:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635428.718586:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40fd4b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.718615:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3400 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:1.0:1789635428.718621:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40fd4b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.718633:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40fd4b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.718658:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0447667200) 00010000:00010000:1.0:1789635428.718662:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789635428.718668:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40fd4b lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.718675:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40fd4b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.718702:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635428.718704:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635428.718706:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635428.772061:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789635428.772094:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044881c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427360256:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789635428.772209:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635428.772490:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427360256 00000100:00100000:3.0:1789635428.772503:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427360256 00000100:00100000:3.0:1789635428.772634:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789635428.772646:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427360256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789635428.772694:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789635428.772762:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427360256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635428.772770:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789635428.772855:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044881c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427360256:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789635428.774844:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789635428.774869:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427360384:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789635428.775123:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635428.775126:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635428.775176:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411569024 00000100:00100000:0.0:1789635428.775186:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411569024 00000100:00100000:0.0:1789635428.775261:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 214 00000100:00100000:0.0:1789635428.775272:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+39:12403:x1876568411569024:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:0.0:1789635428.775301:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635428.775326:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40fd52 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab742c9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635428.775351:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427360384 00000100:00100000:2.0:1789635428.775356:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427360384 00000100:00100000:2.0:1789635428.775404:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789635428.775414:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427360384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789635428.775442:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00010000:00010000:0.0:1789635428.775483:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1aa00/0xb0c3a59caa40fd59 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635428.775503:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427360384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (380us total) trans 0 rc 0/0 00010000:00010000:0.0:1789635428.775503:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1aa00/0xb0c3a59caa40fd59 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635428.775510:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00010000:00010000:0.0:1789635428.775517:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1aa00/0xb0c3a59caa40fd59 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.775538:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b200/0xb0c3a59caa40fd60 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.775547:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b200/0xb0c3a59caa40fd60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.775555:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b200/0xb0c3a59caa40fd60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635428.775622:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427360384:0@lo:41:osp-pre-1-0.0 00000004:00080000:0.0:1789635428.776011:0:6515:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:0.0:1789635428.776165:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40fd67 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.776175:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40fd67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.776183:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40fd67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.776221:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1aa00/0xb0c3a59caa40fd59 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.776229:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1aa00/0xb0c3a59caa40fd59 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.776237:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1aa00/0xb0c3a59caa40fd59 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.776244:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1aa00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635428.776249:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1aa00/0xb0c3a59caa40fd59 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.776271:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1aa00/0xb0c3a59caa40fd59 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.776285:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d0544e2e500) 00010000:00010000:0.0:1789635428.776289:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635428.776295:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1aa00/0xb0c3a59caa40fd59 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.776301:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1aa00/0xb0c3a59caa40fd59 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789635428.776322:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e08844ff reply state 000000002cb6880b transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b200/0xb0c3a59caa40fd60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.776334:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b200/0xb0c3a59caa40fd60 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.776341:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d0543c44a00) 00010000:00010000:0.0:1789635428.776344:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789635428.776347:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789635428.776381:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b400/0xb0c3a59caa40fd52 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742c9 expref: 42 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.776408:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40fd67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742c9 expref: 41 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.776417:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d0447667e00) 00010000:00010000:0.0:1789635428.776419:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789635428.776422:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1ba00, rc 0) 00000100:00100000:0.0:1789635428.776491:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+42:12403:x1876568411569024:12345-192.168.203.20@tcp:101:bash.0 Request processed in 1220us (1367us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1789635428.776505:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 214 00000100:00100000:3.0:1789635428.783715:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635428.786317:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411569152 00000100:00100000:1.0:1789635428.786360:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411569152 00000100:00100000:1.0:1789635428.786669:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 67 00000100:00100000:1.0:1789635428.786685:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:2398:x1876568411569152:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:1.0:1789635428.786710:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635428.786741:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d20db3fa/0xb0c3a59caa40fd75 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab742d0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789635428.786784:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789635428.786811:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=447s v=(0 0) 00010000:00010000:1.0:1789635428.786818:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635428.786829:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d20db3fa/0xb0c3a59caa40fd75 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742d0 expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.786852:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d20db3fa/0xb0c3a59caa40fd75 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742d0 expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.786868:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e153000, rc 0) 00000100:00100000:1.0:1789635428.786966:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:2398:x1876568411569152:12345-192.168.203.20@tcp:101:bash.0 Request processed in 285us (3269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635428.786974:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 67 00000100:00080000:0.0:1789635428.790755:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789635428.792964:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635428.793020:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635428.793049:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635428.793087:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635428.793111:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635428.793138:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635428.793173:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411569920 00000100:00100000:1.0:1789635428.793204:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411569920 00000100:00100000:1.0:1789635428.793284:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411569536 00000100:00100000:1.0:1789635428.793288:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411569536 00000100:00100000:1.0:1789635428.793311:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411569792 00000100:00100000:1.0:1789635428.793314:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411569792 00000100:00100000:1.0:1789635428.793340:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 367 00000100:00100000:1.0:1789635428.793350:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2397:x1876568411569920:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635428.794863:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411569280 00000100:00100000:0.0:1789635428.794879:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411569280 00000100:00100000:3.0:1789635428.795063:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411569408 00000100:00100000:3.0:1789635428.795069:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411569408 00000100:00100000:3.0:1789635428.795119:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 400 00000100:00100000:3.0:1789635428.795131:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2397:x1876568411569408:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635428.800911:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411569664 00000100:00100000:0.0:1789635428.800933:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411569664 00000100:00100000:1.0:1789635428.801235:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2397:x1876568411569920:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 7876us (8136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635428.801250:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 367 00000100:00100000:2.0:1789635428.801755:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 139 00000100:00100000:2.0:1789635428.801772:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+9:2397:x1876568411569664:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635428.803977:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 68 00000100:00100000:0.0:1789635428.804009:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:12403:x1876568411569280:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:0.0:1789635428.804033:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635428.804059:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b97f25b/0xb0c3a59caa40fd7c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab742d7 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.804099:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d20db3fa/0xb0c3a59caa40fd75 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742d0 expref: 9 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.804109:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635428.804115:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635428.804121:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b97f25b/0xb0c3a59caa40fd7c lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742d7 expref: 9 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789635428.804237:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789635428.804245:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789635428.804266:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 368 00000100:00100000:1.0:1789635428.804389:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2397:x1876568411569536:12345-192.168.203.20@tcp:400:kworker.0 00010000:00010000:0.0:1789635428.804654:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d20db3fa/0xb0c3a59caa40fd75 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742d0 expref: 9 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635428.804668:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+9:2397:x1876568411569664:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 2897us (11612us total) trans 0 rc 0/0 00010000:00010000:0.0:1789635428.804677:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d20db3fa/0xb0c3a59caa40fd75 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742d0 expref: 9 pid: 8430 timeout: 547 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635428.804685:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 139 00000100:00100000:0.0:1789635428.804726:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044881d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1876568427360512:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789635428.804813:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05452879c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635428.804850:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 369 00000100:00100000:0.0:1789635428.804862:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2397:x1876568411569792:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635428.804897:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2397:x1876568411569792:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 39us (11758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635428.804903:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 369 00000100:00100000:1.0:1789635428.805014:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2397:x1876568411569536:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 738us (11899us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635428.805022:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 368 00000100:00100000:3.0:1789635428.805197:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2397:x1876568411569408:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 10065us (12173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635428.805208:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 400 00000100:00100000:3.0:1789635428.812001:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635428.812163:0:13189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411570048 00000100:00100000:1.0:1789635428.812177:0:13189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411570048 00010000:00010000:1.0:1789635428.812230:0:13189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d20db3fa/0xb0c3a59caa40fd75 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742d0 expref: 10 pid: 8430 timeout: 547 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635428.812292:0:13189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 94 00000100:00100000:1.0:1789635428.812303:0:13189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+10:2396:x1876568411570048:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635428.812323:0:13189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635428.812351:0:13189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d20db3fa/0xb0c3a59caa40fd75 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742d0 expref: 10 pid: 8430 timeout: 547 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.812391:0:13189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d20db3fa/0xb0c3a59caa40fd75 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742d0 expref: 10 pid: 8430 timeout: 547 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.812434:0:13189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635428.812440:0:13189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635428.812449:0:13189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002b97f25b/0xb0c3a59caa40fd7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742d7 expref: 10 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.812472:0:13189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b97f25b/0xb0c3a59caa40fd7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742d7 expref: 10 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.813027:0:13189:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002b97f25b/0xb0c3a59caa40fd7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742d7 expref: 10 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635428.813046:0:13189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bfbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:13189:1876568427360640:192.168.203.20@tcp:105: 00000100:00100000:1.0:1789635428.813159:0:13189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0548dc6000 going to sleep for 11 seconds 00010000:00010000:0.0:1789635428.816032:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d20db3fa/0xb0c3a59caa40fd75 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742d0 expref: 10 pid: 8430 timeout: 547 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635428.816065:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044881d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1876568427360512:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789635428.816110:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002b97f25b/0xb0c3a59caa40fd7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742d7 expref: 9 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.816128:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1b400, rc 0) 00000100:00100000:0.0:1789635428.816222:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+9:12403:x1876568411569280:12345-192.168.203.20@tcp:101:bash.0 Request processed in 12229us (23271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635428.816233:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 68 00000100:00100000:1.0:1789635428.824753:0:13189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bfbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:13189:1876568427360640:192.168.203.20@tcp:105: 00010000:00010000:1.0:1789635428.824790:0:13189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635428.824867:0:13189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:2396:x1876568411570048:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 12565us (12879us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635428.824881:0:13189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 94 00000100:00100000:2.0:1789635428.825143:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635428.826136:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411570304 00000100:00100000:1.0:1789635428.826150:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411570304 00000100:00100000:1.0:1789635428.826267:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:1.0:1789635428.826300:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+42:12403:x1876568411570304:12345-192.168.203.20@tcp:35:bash.0 00000100:00100000:1.0:1789635428.826728:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+43:12403:x1876568411570304:12345-192.168.203.20@tcp:35:bash.0 Request processed in 429us (1584us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1789635428.826736:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:3.0:1789635428.952778:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635428.952878:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411570432 00000100:00100000:0.0:1789635428.952892:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411570432 00000100:00100000:0.0:1789635428.953058:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 215 00000100:00100000:0.0:1789635428.953072:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+43:12419:x1876568411570432:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1789635428.953125:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635428.953152:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1aa00/0xb0c3a59caa40fd83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab742de expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.953306:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40fd8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.953323:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40fd8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.953336:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40fd8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635428.953405:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789635428.953410:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789635428.953433:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40fd8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.953474:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1aa00/0xb0c3a59caa40fd83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742de expref: 45 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.953505:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40fd8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742de expref: 44 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.953516:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d0544e2e500) 00010000:00010000:0.0:1789635428.953519:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789635428.953523:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1b000, rc 0) 00000100:00100000:0.0:1789635428.953675:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+44:12419:x1876568411570432:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 606us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635428.953682:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 215 00000100:00100000:2.0:1789635428.959340:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635428.959487:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411570688 00000100:00100000:1.0:1789635428.959500:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411570688 00000100:00100000:1.0:1789635428.959578:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 216 00000100:00100000:1.0:1789635428.959590:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+44:12419:x1876568411570688:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789635428.959646:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635428.959673:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fd91 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab742e5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.959814:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fd98 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.959832:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fd98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.959845:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fd98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635428.959858:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789635428.959984:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fd91 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742e5 expref: 47 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.960006:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fd98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742e5 expref: 46 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.960040:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d0447667e00) 00010000:00010000:1.0:1789635428.960044:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789635428.960048:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e152a00, rc 0) 00000100:00100000:1.0:1789635428.960128:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+46:12419:x1876568411570688:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 541us (802us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1789635428.960136:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 216 00000100:00100000:3.0:1789635428.965471:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635428.965647:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411571072 00000100:00100000:2.0:1789635428.965661:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411571072 00000100:00100000:2.0:1789635428.965745:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:2.0:1789635428.965756:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b407850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+46:2397:x1876568411571072:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635428.965789:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635428.965830:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fd98 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742e5 expref: 46 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.965856:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d0447667e00) 00010000:00010000:2.0:1789635428.965862:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635428.966593:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b407850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+45:2397:x1876568411571072:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 834us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635428.966629:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:3.0:1789635428.970256:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635428.971174:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411570944 00000100:00100000:1.0:1789635428.971193:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411570944 00000100:00100000:1.0:1789635428.971644:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 217 00000100:00100000:1.0:1789635428.971659:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+45:12419:x1876568411570944:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789635428.971692:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635428.971721:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fda6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab742ec expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.971860:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fdad lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.971878:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fdad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.971892:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fdad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635428.971906:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789635428.972046:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fda6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742ec expref: 48 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.972093:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fdad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742ec expref: 47 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.972103:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d0447667e00) 00010000:00010000:1.0:1789635428.972106:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789635428.972110:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e152800, rc 0) 00000100:00100000:1.0:1789635428.972201:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+47:12419:x1876568411570944:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 546us (1957us total) trans 4294967487 rc 0/0 00000100:00100000:1.0:1789635428.972208:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 217 00000100:00100000:3.0:1789635428.978175:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635428.978524:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411571200 00000100:00100000:1.0:1789635428.978537:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411571200 00000100:00100000:1.0:1789635428.978645:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 69 00000100:00100000:1.0:1789635428.978658:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:2396:x1876568411571200:12345-192.168.203.20@tcp:1:lfs.0 00010000:00010000:1.0:1789635428.978717:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e635a381/0xb0c3a59caa40fdbb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.978753:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002b97f25b/0xb0c3a59caa40fd7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742d7 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.978764:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635428.978770:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789635428.978775:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e635a381/0xb0c3a59caa40fdbb lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.978899:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002b97f25b/0xb0c3a59caa40fd7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742d7 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.978935:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002b97f25b/0xb0c3a59caa40fd7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742d7 expref: 8 pid: 8432 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635428.978954:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bfbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1876568427360768:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789635428.979048:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05746cf600 going to sleep for 11 seconds 00000100:00100000:1.0:1789635428.981295:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bfbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1876568427360768:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789635428.981337:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e635a381/0xb0c3a59caa40fdbb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635428.983140:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635428.983447:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411571328 00000100:00100000:3.0:1789635428.983489:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411571328 00002000:00100000:3.0:1789635428.983557:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8d044881d880 x1876568411571328/t0(0) o4->6e1c17f2-a595-4ed0-97c8-b9260d0850ab@192.168.203.20@tcp:49/0 lens 504/0 e 0 to 0 dl 1789635439 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789635428.983570:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d044881d880 with x1876568411571328 ext(0->8) 00010000:00010000:3.0:1789635428.983580:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002b97f25b/0xb0c3a59caa40fd7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742d7 expref: 9 pid: 8432 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.983633:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002b97f25b/0xb0c3a59caa40fd7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742d7 expref: 9 pid: 8432 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789635428.983641:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d044881d880 00000100:00100000:3.0:1789635428.983675:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:3.0:1789635428.983686:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044881d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+9:2396:x1876568411571328:12345-192.168.203.20@tcp:4:lfs.0 00000100:00100000:3.0:1789635428.984750:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044881d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+11:2396:x1876568411571328:12345-192.168.203.20@tcp:4:lfs.0 Request processed in 1056us (1614us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789635428.984762:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 3 00002000:00100000:3.0:1789635428.984773:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8d044881d880 x1876568411571328/t4294967309(0) o4->6e1c17f2-a595-4ed0-97c8-b9260d0850ab@192.168.203.20@tcp:49/0 lens 504/448 e 0 to 0 dl 1789635439 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789635428.984783:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d044881d880 with x1876568411571328 ext(0->8) 00010000:00010000:3.0:1789635428.984793:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002b97f25b/0xb0c3a59caa40fd7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742d7 expref: 11 pid: 8432 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.984808:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002b97f25b/0xb0c3a59caa40fd7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742d7 expref: 11 pid: 8432 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789635428.984831:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d044881d880 00000100:00100000:3.0:1789635428.997252:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635428.997770:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411571456 00000100:00100000:1.0:1789635428.997784:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411571456 00010000:00010000:1.0:1789635428.997913:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002b97f25b/0xb0c3a59caa40fd7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742d7 expref: 11 pid: 8432 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635428.997967:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 95 00000100:00100000:1.0:1789635428.997979:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+11:2397:x1876568411571456:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635428.997998:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789635428.998021:0:6501:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789635428.998025:0:6501:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789635429 00002000:00010000:1.0:1789635428.998027:0:6501:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789635429 00002000:00010000:1.0:1789635428.998030:0:6501:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1789635429 00002000:00010000:1.0:1789635428.998032:0:6501:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1789635428.998040:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002b97f25b/0xb0c3a59caa40fd7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742d7 expref: 11 pid: 8432 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.998080:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002b97f25b/0xb0c3a59caa40fd7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742d7 expref: 11 pid: 8432 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.998109:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b97f25b/0xb0c3a59caa40fd7c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742d7 expref: 11 pid: 8432 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.998144:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789635428.998150:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789635428.998156:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e635a381/0xb0c3a59caa40fdbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.998167:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e635a381/0xb0c3a59caa40fdbb lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635428.998281:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635428.998867:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+10:2397:x1876568411571456:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 886us (1624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635428.998878:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 95 00010000:00010000:2.0:1789635428.999909:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e635a381/0xb0c3a59caa40fdbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.999927:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e635a381/0xb0c3a59caa40fdbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.999989:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e635a381/0xb0c3a59caa40fdbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.999998:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e635a381/0xb0c3a59caa40fdbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.000007:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e635a381/0xb0c3a59caa40fdbb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.000015:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152400 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635429.000020:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e635a381/0xb0c3a59caa40fdbb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.000028:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e635a381/0xb0c3a59caa40fdbb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.000048:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e635a381/0xb0c3a59caa40fdbb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.000055:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e635a381/0xb0c3a59caa40fdbb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635429.000155:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+9:2396:x1876568411571200:12345-192.168.203.20@tcp:1:lfs.0 Request processed in 21495us (21986us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635429.000164:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 69 00000100:00100000:1.0:1789635429.010723:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635429.010994:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411571712 00000100:00100000:0.0:1789635429.011008:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411571712 00000100:00080000:1.0:1789635429.011079:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635429.011114:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 56 00000100:00100000:0.0:1789635429.011138:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b746050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+47:12419:x1876568411571712:12345-192.168.203.20@tcp:35:lfs.0 00000004:00010000:0.0:1789635429.011391:0:6517:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fdad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742ec expref: 47 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789635429.011749:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1789635429.011787:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1789635429.016463:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:0.0:1789635429.016571:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fdc2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.016620:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40fd67 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742c9 expref: 51 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.016633:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fdc2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.016686:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40fd67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742c9 expref: 51 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.016708:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40fd67 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742c9 expref: 51 pid: 6515 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635429.016727:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044881f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6517:1876568427360896:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789635429.017465:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0545287c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789635429.027485:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635429.027514:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044881f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6517:1876568427360896:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789635429.027558:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fdc2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635429.028064:0:13189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411571840 00000100:00100000:3.0:1789635429.028074:0:13189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411571840 00010000:00010000:3.0:1789635429.028127:0:13189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40fd67 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742c9 expref: 52 pid: 6515 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635429.028171:0:13189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 96 00000100:00100000:3.0:1789635429.028182:0:13189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044881df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+52:2396:x1876568411571840:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635429.028200:0:13189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635429.028209:0:13189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40fd67 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742c9 expref: 52 pid: 6515 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635429.028223:0:13189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40fd67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742c9 expref: 52 pid: 6515 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635429.028257:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ba00/0xb0c3a59caa40fd67 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742c9 expref: 52 pid: 6515 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635429.028281:0:13189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d0447667e00) 00010000:00010000:3.0:1789635429.028287:0:13189:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fdc2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635429.028299:0:13189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fdc2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635429.028435:0:13189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fdc2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635429.028571:0:13189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789635429.028635:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fdc2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.028646:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fdc2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635429.028695:0:13189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044881df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+51:2396:x1876568411571840:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 515us (1226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635429.028705:0:13189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 96 00000001:00080000:2.0:1789635429.028822:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:2.0:1789635429.028974:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1789635429.029095:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447975f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6517:1876568427361024:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789635429.029161:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635429.029196:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0548dc63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635429.030782:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427361024 00000100:00100000:0.0:1789635429.030812:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427361024 00000100:00100000:0.0:1789635429.030900:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789635429.030915:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6517:x1876568427361024:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789635429.031068:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6517:x1876568427361024:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 159us (1907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635429.031086:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:3.0:1789635429.031220:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789635429.031864:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447975f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6517:1876568427361024:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789635429.032185:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1789635429.032282:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447975f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6517:1876568427361152:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789635429.032336:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635429.032371:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0544fb3540 going to sleep for 11 seconds 00000100:00100000:1.0:1789635429.033592:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427361152 00000100:00100000:1.0:1789635429.033638:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427361152 00000100:00100000:1.0:1789635429.033691:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1789635429.033701:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6517:x1876568427361152:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789635429.033873:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6517:x1876568427361152:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 174us (1538us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789635429.033893:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789635429.034679:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447975f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6517:1876568427361152:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789635429.034919:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1789635429.035015:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fdc2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.035028:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fdc2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.035036:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fdc2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.035056:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1b600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635429.035061:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fdc2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.035069:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fdc2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.035085:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d0447667e00) 00010000:00010000:2.0:1789635429.035088:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789635429.035092:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fdc2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.035098:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b600/0xb0c3a59caa40fdc2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789635429.035222:0:6517:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789635429.035282:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1789635429.035294:0:6517:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 447718697039ns, next at 448718694779ns, rc = 0 00000001:00080000:2.0:1789635429.035300:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1789635429.035326:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d0447667e00) 00010000:00010000:2.0:1789635429.035329:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789635429.035337:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fdad lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742ec expref: 55 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635429.035548:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b746050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+54:12419:x1876568411571712:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 24423us (24838us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1789635429.035557:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 56 00000020:00080000:2.0:1789635429.035562:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789635429.038461:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635429.038769:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411571968 00000100:00100000:1.0:1789635429.038781:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411571968 00000100:00100000:1.0:1789635429.038849:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 218 00000100:00100000:1.0:1789635429.038858:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044881ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+54:12419:x1876568411571968:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789635429.038888:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635429.038914:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fdc9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab742f3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.038985:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fdc9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742f3 expref: 55 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.039003:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fdc9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742f3 expref: 55 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.039024:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d04466ca700) 00010000:00010000:1.0:1789635429.039028:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789635429.039032:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e153000, rc 0) 00000100:00100000:1.0:1789635429.039097:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044881ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+55:12419:x1876568411571968:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 240us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635429.039103:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 218 00000100:00100000:3.0:1789635429.043354:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635429.043858:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411572224 00000100:00100000:1.0:1789635429.043874:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411572224 00000100:00100000:1.0:1789635429.043963:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 57 00000100:00100000:1.0:1789635429.043975:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+55:12419:x1876568411572224:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:1.0:1789635429.044287:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+56:12419:x1876568411572224:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 313us (946us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1789635429.044314:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 57 00000100:00100000:3.0:1789635429.139065:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635429.140061:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411572352 00000100:00100000:1.0:1789635429.140079:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411572352 00000100:00100000:1.0:1789635429.140224:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 219 00000100:00100000:1.0:1789635429.140239:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+56:12429:x1876568411572352:12345-192.168.203.20@tcp:34:lfs.0 00010000:00010000:1.0:1789635429.140350:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fdd0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.140372:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fdd0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.140387:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fdd0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.140410:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fdd7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.140419:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fdd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.140426:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fdd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.140524:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fdde lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.140544:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fdde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.140552:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fdde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789635429.142913:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fdde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.142955:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fdd0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.142964:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fdd0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.142972:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fdd0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.142979:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e153600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635429.142985:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fdd0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.142994:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fdd0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.143014:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d0544e2e500) 00010000:00010000:0.0:1789635429.143018:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635429.143025:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fdd0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.143058:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fdd0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.143081:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fdd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.143087:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fdd7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.143093:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fdd7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.143098:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152800 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635429.143102:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fdd7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.143108:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fdd7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.143119:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d0543c44a00) 00010000:00010000:0.0:1789635429.143122:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635429.143125:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fdd7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.143131:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fdd7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.143142:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fdde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.143148:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fdde lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.143160:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fdde lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.143166:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152400 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635429.143169:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fdde lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.143175:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fdde lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.143184:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d04466ca700) 00010000:00010000:0.0:1789635429.143186:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635429.143189:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fdde lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.143195:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fdde lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635429.143417:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+56:12429:x1876568411572352:12345-192.168.203.20@tcp:34:lfs.0 Request processed in 3174us (4359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635429.143430:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 219 00000100:00100000:0.0:1789635429.201554:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635429.201845:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411572608 00000100:00100000:1.0:1789635429.201859:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411572608 00000100:00100000:1.0:1789635429.201952:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 220 00000100:00100000:1.0:1789635429.201965:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044881ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+56:12432:x1876568411572608:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789635429.201993:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635429.202020:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fde5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab742fa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.202401:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fdec lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.202419:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fdec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.202433:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fdec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.202448:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fdf3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.202456:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fdf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.202462:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fdf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.202911:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fdfa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.202990:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fdfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.203018:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fdfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635429.203030:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789635429.203129:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fdec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.203138:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fdec lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.203144:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fdec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.203150:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152a00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635429.203156:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fdec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.203164:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fdec lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.203178:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d0544e2e500) 00010000:00010000:1.0:1789635429.203182:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635429.203187:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fdec lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.203194:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fdec lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.203209:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fdf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.203215:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fdf3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.203227:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fdf3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.203232:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152400 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635429.203235:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fdf3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.203242:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fdf3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.203250:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d0543c44a00) 00010000:00010000:1.0:1789635429.203252:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635429.203256:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fdf3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.203262:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fdf3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.203304:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fde5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742fa expref: 59 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.203317:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fdfa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742fa expref: 58 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.203324:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d04466ca700) 00010000:00010000:1.0:1789635429.203326:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789635429.203328:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e152800, rc 0) 00000100:00100000:1.0:1789635429.203868:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044881ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+58:12432:x1876568411572608:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 1901us (2324us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1789635429.203890:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 220 00000100:00100000:3.0:1789635429.210639:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635429.210775:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411572736 00000100:00100000:0.0:1789635429.210790:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411572736 00000100:00100000:0.0:1789635429.210875:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 221 00000100:00100000:0.0:1789635429.210887:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+58:12432:x1876568411572736:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:0.0:1789635429.210987:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fe08 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.211031:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fe08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.211046:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fe08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.211092:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fe08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.211099:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fe08 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.211106:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fe08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.211113:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1a600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635429.211118:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fe08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.211127:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fe08 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.211140:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d04466ca700) 00010000:00010000:0.0:1789635429.211143:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789635429.211149:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fe08 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.211155:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fe08 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635429.211253:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+58:12432:x1876568411572736:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 367us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635429.211268:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 221 00000100:00100000:3.0:1789635429.213643:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635429.214142:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411572992 00000100:00100000:1.0:1789635429.214156:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411572992 00000100:00100000:1.0:1789635429.214234:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 58 00000100:00100000:1.0:1789635429.214246:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+58:12432:x1876568411572992:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:1.0:1789635429.214579:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+59:12432:x1876568411572992:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 334us (948us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1789635429.214588:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 58 00000100:00100000:3.0:1789635429.328634:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635429.328768:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411573248 00000100:00100000:0.0:1789635429.328942:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411573248 00000100:00100000:0.0:1789635429.329017:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 222 00000100:00100000:0.0:1789635429.329027:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+59:12442:x1876568411573248:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:0.0:1789635429.329057:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635429.329060:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789635429.329092:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40fd8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742de expref: 59 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.329117:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d0544e2e500) 00010000:00010000:0.0:1789635429.329123:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789635429.329138:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fe0f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74301 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.329474:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40fe16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.329493:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40fe16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.329505:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40fe16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635429.329517:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789635429.330222:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fe0f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74301 expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.330244:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40fe16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74301 expref: 60 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.330272:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d04466ca700) 00010000:00010000:0.0:1789635429.330276:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789635429.330279:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1a400, rc 0) 00000100:00100000:0.0:1789635429.330370:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+60:12442:x1876568411573248:12345-192.168.203.20@tcp:101:bash.0 Request processed in 1344us (1774us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1789635429.330377:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 222 00000100:00100000:0.0:1789635429.337440:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635429.337739:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635429.339013:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411573376 00000100:00100000:1.0:1789635429.339031:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411573376 00000100:00100000:1.0:1789635429.339187:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 223 00000100:00100000:1.0:1789635429.339213:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044881ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+60:12442:x1876568411573376:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:1.0:1789635429.339247:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635429.339272:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fe24 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74308 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.339316:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fe2b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.339333:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fe2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.339346:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fe2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.339506:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fe24 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74308 expref: 62 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.339542:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fe2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74308 expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.339551:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d04466ca700) 00010000:00010000:1.0:1789635429.339555:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789635429.339559:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e152400, rc 0) 00000100:00100000:1.0:1789635429.339666:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044881ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+61:12442:x1876568411573376:12345-192.168.203.20@tcp:101:bash.0 Request processed in 458us (2240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635429.339675:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 223 00000100:00100000:2.0:1789635429.339779:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411573504 00000100:00100000:2.0:1789635429.339786:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411573504 00000100:00100000:2.0:1789635429.339841:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:2.0:1789635429.339850:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044881f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+61:2397:x1876568411573504:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635429.339863:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635429.339882:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40fe16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74301 expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.339899:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d04466ca700) 00010000:00010000:2.0:1789635429.339904:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635429.339940:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044881f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+60:2397:x1876568411573504:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 91us (2200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635429.339948:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:0.0:1789635429.342690:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635429.346242:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411573760 00000100:00100000:2.0:1789635429.346263:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411573760 00000100:00100000:2.0:1789635429.346361:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 224 00000100:00100000:2.0:1789635429.346374:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044881dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+60:12442:x1876568411573760:12345-192.168.203.20@tcp:36:bash.0 00010000:00010000:2.0:1789635429.346564:0:10094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635429.346618:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fdfa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742fa expref: 60 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.346642:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d04466ca700) 00010000:00010000:2.0:1789635429.346648:0:10094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789635429.346946:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40fe32 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.346963:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40fe32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.347419:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40fe32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789635429.347831:0:10094:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:2.0:1789635429.347866:0:10094:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e575bbc reply state 00000000f18dc4b5 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40fe32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.347881:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40fe32 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.347888:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d04466ca700) 00010000:00010000:2.0:1789635429.347891:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789635429.347895:0:10094:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789635429.348049:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044881dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+62:12442:x1876568411573760:12345-192.168.203.20@tcp:36:bash.0 Request processed in 1674us (5369us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1789635429.348057:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 224 00000020:00080000:2.0:1789635429.348063:0:10094:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789635429.360677:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635429.360899:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411573888 00000100:00100000:0.0:1789635429.360913:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411573888 00000100:00100000:0.0:1789635429.360992:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 225 00000100:00100000:0.0:1789635429.361004:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+62:12442:x1876568411573888:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:0.0:1789635429.361035:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635429.361061:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fe39 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7430f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.361187:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40fe40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.361205:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40fe40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.361218:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40fe40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635429.361253:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789635429.361265:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789635429.361290:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40fe40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.361321:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fe39 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7430f expref: 64 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.361341:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40fe40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7430f expref: 63 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.361350:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d04466ca700) 00010000:00010000:0.0:1789635429.361354:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789635429.361358:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1b000, rc 0) 00000100:00100000:0.0:1789635429.361445:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+63:12442:x1876568411573888:12345-192.168.203.20@tcp:101:bash.0 Request processed in 444us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635429.361453:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 225 00000100:00100000:3.0:1789635429.369646:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635429.369776:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411574144 00000100:00100000:1.0:1789635429.369790:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411574144 00000100:00100000:1.0:1789635429.369860:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00100000:1.0:1789635429.369873:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+63:12442:x1876568411574144:12345-192.168.203.20@tcp:35:bash.0 00000100:00100000:1.0:1789635429.370179:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+64:12442:x1876568411574144:12345-192.168.203.20@tcp:35:bash.0 Request processed in 307us (587us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1789635429.370186:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00100000:3.0:1789635429.445098:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635429.445924:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411574272 00000100:00100000:1.0:1789635429.445939:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411574272 00000100:00100000:1.0:1789635429.446023:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 226 00000100:00100000:1.0:1789635429.446036:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+64:12448:x1876568411574272:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789635429.446074:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635429.446099:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fe47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74316 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.446309:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fe4e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.446343:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fe4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.446368:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fe4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635429.446435:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1789635429.446439:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789635429.446463:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fe4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.446493:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fe47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74316 expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.447283:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fe4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74316 expref: 65 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.447297:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d0544e2e500) 00010000:00010000:1.0:1789635429.447300:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789635429.447305:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e152a00, rc 0) 00000100:00100000:1.0:1789635429.449680:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+65:12448:x1876568411574272:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 3629us (4590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635429.449695:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 226 00000100:00100000:2.0:1789635429.467233:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635429.467372:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411574400 00000100:00100000:0.0:1789635429.467384:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411574400 00000100:00100000:0.0:1789635429.467472:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 227 00000100:00100000:0.0:1789635429.467490:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+65:12448:x1876568411574400:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1789635429.467519:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635429.467545:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fe55 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7431d expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.467677:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40fe5c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.467694:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40fe5c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.467730:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40fe5c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.467743:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fe63 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.467751:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fe63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.467758:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fe63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.467859:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40fe6a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.467867:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40fe6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.467873:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40fe6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635429.467922:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789635429.467927:0:10094:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789635429.467946:0:10094:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40fe6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.467966:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40fe6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.467976:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40fe5c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.467992:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40fe5c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.468000:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40fe5c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.468006:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1a200 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635429.468011:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40fe5c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.468020:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40fe5c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.468034:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d0544e2e500) 00010000:00010000:0.0:1789635429.468037:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635429.468042:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40fe5c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.468048:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40fe5c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.468063:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fe63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.468069:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fe63 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.468075:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fe63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.468080:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1a800 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635429.468088:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fe63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.468096:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fe63 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.468104:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d0543c44a00) 00010000:00010000:0.0:1789635429.468106:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635429.468110:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fe63 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.468115:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fe63 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.468146:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a600/0xb0c3a59caa40fe55 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7431d expref: 67 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.468160:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40fe6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7431d expref: 66 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.468167:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d04466ca700) 00010000:00010000:0.0:1789635429.468169:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789635429.468172:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1a400, rc 0) 00000100:00100000:0.0:1789635429.468248:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+66:12448:x1876568411574400:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 761us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635429.468255:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 227 00000100:00100000:2.0:1789635429.480220:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635429.480383:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411574656 00000100:00100000:1.0:1789635429.480407:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411574656 00000100:00100000:1.0:1789635429.480489:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 228 00000100:00100000:1.0:1789635429.480502:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+66:12448:x1876568411574656:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789635429.480530:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635429.480574:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fe71 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74324 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.480768:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fe78 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.480786:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40fe40 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7430f expref: 67 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.480920:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40fe6a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7431d expref: 67 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.480933:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fe78 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.480978:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40fe6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7431d expref: 67 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.481055:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40fe6a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7431d expref: 67 pid: 10094 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635429.481073:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bfbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6515:1876568427361280:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789635429.481191:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40fe40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7430f expref: 67 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.481202:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40fe40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7430f expref: 67 pid: 6514 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635429.481212:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bfb100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6515:1876568427361408:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789635429.481247:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05746cfa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789635429.481990:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635429.482175:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411574784 00000100:00100000:3.0:1789635429.482186:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411574784 00010000:00010000:3.0:1789635429.482224:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40fe6a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7431d expref: 68 pid: 10094 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635429.482374:0:13189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 97 00000100:00100000:1.0:1789635429.482387:0:13189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447974380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+68:2397:x1876568411574784:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635429.482415:0:13189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635429.482423:0:13189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40fe6a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7431d expref: 68 pid: 10094 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.482437:0:13189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40fe6a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7431d expref: 68 pid: 10094 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.482462:0:13189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d04466ca700) 00010000:00010000:1.0:1789635429.482468:0:13189:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fe78 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.482478:0:13189:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fe78 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.482484:0:13189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635429.482531:0:13189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447974380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+68:2397:x1876568411574784:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 146us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635429.482538:0:13189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 97 00000100:00100000:1.0:1789635429.490798:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00010000:00010000:0.0:1789635429.490971:0:6515:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.20@tcp) returned -22 from blocking AST (req@0000000089cee57e x1876568427361280) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40fe6a lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7431d expref: 67 pid: 10094 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.491026:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40fe6a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7431d expref: 67 pid: 10094 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635429.491047:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bfbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6515:1876568427361280:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789635429.491065:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bfb100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6515:1876568427361408:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789635429.491105:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d04466ca700) 00010000:00010000:0.0:1789635429.491112:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fe78 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.491123:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fe78 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.491133:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fe78 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635429.491398:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411574912 00000100:00100000:2.0:1789635429.491409:0:7457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411574912 00010000:00010000:2.0:1789635429.491468:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40fe40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7430f expref: 67 pid: 6514 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635429.491524:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 98 00000100:00100000:2.0:1789635429.491537:0:7457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+67:2396:x1876568411574912:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635429.491555:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635429.491570:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40fe40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7430f expref: 67 pid: 6514 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.491583:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40fe40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7430f expref: 67 pid: 6514 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.491651:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b000/0xb0c3a59caa40fe40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7430f expref: 67 pid: 6514 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.491666:0:7457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d04466ca700) 00010000:00010000:2.0:1789635429.491670:0:7457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fe78 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.491679:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fe78 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.491687:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fe78 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.491712:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789635429.492242:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fe78 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.492253:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fe78 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635429.492275:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789635429.492549:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fe71 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74324 expref: 68 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.492571:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fe78 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74324 expref: 67 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.492581:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d04466ca700) 00010000:00010000:1.0:1789635429.492584:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789635429.492588:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e153600, rc 0) 00000100:00100000:1.0:1789635429.492697:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+67:12448:x1876568411574656:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 12197us (12492us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1789635429.492708:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 228 00000100:00100000:2.0:1789635429.493048:0:7457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+66:2396:x1876568411574912:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 1513us (2266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635429.493057:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 98 00000100:00100000:0.0:1789635429.499890:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635429.500047:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411575168 00000100:00100000:1.0:1789635429.500062:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411575168 00000100:00100000:1.0:1789635429.500162:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:1.0:1789635429.500174:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044881e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+66:12448:x1876568411575168:12345-192.168.203.20@tcp:103:lfs.0 00010000:00010000:1.0:1789635429.500193:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635429.500226:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fdc9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742f3 expref: 66 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.500247:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d04466ca700) 00010000:00010000:1.0:1789635429.500253:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635429.500334:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044881e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+65:12448:x1876568411575168:12345-192.168.203.20@tcp:103:lfs.0 Request processed in 162us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635429.500342:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:2.0:1789635429.503059:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635429.503307:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411575296 00000100:00100000:1.0:1789635429.503321:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411575296 00000100:00100000:1.0:1789635429.503417:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 229 00000100:00100000:1.0:1789635429.503428:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+65:12448:x1876568411575296:12345-192.168.203.20@tcp:58:lfs.0 00010000:00010000:1.0:1789635429.503626:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fe86 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.503647:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fe86 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.503660:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fe86 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789635429.503782:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1789635429.504070:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+65:12448:x1876568411575296:12345-192.168.203.20@tcp:58:lfs.0 Request processed in 641us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635429.504166:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 229 00000100:00100000:1.0:1789635429.509360:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635429.509489:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411575424 00000100:00100000:2.0:1789635429.509502:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411575424 00000100:00100000:2.0:1789635429.509575:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 230 00000100:00100000:2.0:1789635429.509588:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+65:12448:x1876568411575424:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1789635429.509636:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635429.509683:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40fe8d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7432b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.509753:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fe86 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.509777:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40fe8d lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7432b expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.509802:0:6514:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fe86 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.509830:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40fe8d lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7432b expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.509847:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d04466ca700) 00010000:00010000:2.0:1789635429.509850:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789635429.509854:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40fe8d lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7432b expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.509864:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a3400, rc 0) 00000100:00100000:2.0:1789635429.509933:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+66:12448:x1876568411575424:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 347us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635429.509940:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 230 00010000:00010000:0.0:1789635429.540276:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789635429.674666:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789635429.674680:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789635429.674712:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 5 00000040:00080000:3.0:1789635429.674837:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789635429.675031:0:13797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1876568427361536:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789635429.675153:0:13797:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549fab0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635429.688764:0:13797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1876568427361536:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789635429.695745:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635429.695992:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411575552 00000100:00100000:1.0:1789635429.696006:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411575552 00000100:00100000:1.0:1789635429.696131:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 231 00000100:00100000:1.0:1789635429.696144:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+66:12449:x1876568411575552:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789635429.696204:0:6515:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789635429.696365:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+66:12449:x1876568411575552:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 223us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635429.696374:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 231 00000100:00100000:3.0:1789635429.702228:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635429.705730:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411575680 00000100:00100000:0.0:1789635429.705753:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411575680 00000100:00100000:0.0:1789635429.705948:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 232 00000100:00100000:0.0:1789635429.705962:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+66:12449:x1876568411575680:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789635429.706061:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fe94 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.706085:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fe94 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.706124:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fe94 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.706144:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40fe9b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.706153:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40fe9b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.706161:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40fe9b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.706189:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40fea2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.706301:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40fea2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.706310:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40fea2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635429.706574:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789635429.706581:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789635429.706627:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40fea2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.706641:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fe94 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.706649:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fe94 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.706670:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fe94 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.706676:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1a800 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635429.706681:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fe94 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.706690:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fe94 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.706705:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d044766d300) 00010000:00010000:0.0:1789635429.706709:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635429.706715:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fe94 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.706723:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fe94 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.706740:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40fe9b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.706746:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40fe9b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.706752:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40fe9b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.706758:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1a200 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635429.706946:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40fe9b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.706964:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40fe9b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.706978:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff8d0447667700) 00010000:00010000:0.0:1789635429.706980:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635429.706984:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40fe9b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.706990:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40fe9b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.707008:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40fea2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.707014:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40fea2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.707020:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40fea2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.707025:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1bc00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635429.707028:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40fea2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.707034:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40fea2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.707041:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d04466ca700) 00010000:00010000:0.0:1789635429.707043:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635429.707046:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40fea2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.707063:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40fea2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635429.708564:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+66:12449:x1876568411575680:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 Request processed in 2591us (6338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635429.708581:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 232 00000100:00100000:3.0:1789635429.711075:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635429.711503:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411575936 00000100:00100000:2.0:1789635429.711516:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411575936 00000100:00100000:2.0:1789635429.711660:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 233 00000100:00100000:2.0:1789635429.711674:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+66:12449:x1876568411575936:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789635429.711997:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635429.712023:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fea9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74332 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.712145:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40feb0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.712162:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40feb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.712176:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40feb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635429.712188:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789635429.714080:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40feb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.714099:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40feb0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.714108:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40feb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.714114:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3000 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635429.714120:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40feb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.714128:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40feb0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.714147:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d04466ca700) 00010000:00010000:2.0:1789635429.714166:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789635429.714172:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40feb0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.714178:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40feb0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.714403:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fea9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74332 expref: 68 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.714416:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d044766d300) 00010000:00010000:2.0:1789635429.714419:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789635429.714423:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40fea9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74332 expref: 68 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.714435:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a2600, rc 0) 00000100:00100000:2.0:1789635429.715144:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+67:12449:x1876568411575936:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 3468us (4077us total) trans 4294967505 rc 301/301 00000100:00100000:2.0:1789635429.715156:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 233 00000100:00100000:3.0:1789635429.719585:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635429.721205:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411576064 00000100:00100000:1.0:1789635429.721224:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411576064 00000100:00100000:1.0:1789635429.721385:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 234 00000100:00100000:1.0:1789635429.721407:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+67:12449:x1876568411576064:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789635429.721984:0:6515:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789635429.722200:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+67:12449:x1876568411576064:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 795us (2627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635429.722209:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 234 00000100:00100000:2.0:1789635429.729042:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635429.730256:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411576320 00000100:00100000:0.0:1789635429.730273:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411576320 00000100:00100000:0.0:1789635429.730427:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 235 00000100:00100000:0.0:1789635429.730439:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+67:12449:x1876568411576320:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789635429.730564:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635429.730568:0:10094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789635429.730673:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fe4e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74316 expref: 67 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.730702:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d0544e2e500) 00010000:00010000:0.0:1789635429.730707:0:10094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789635429.731005:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40febe lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74339 expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789635429.732013:0:10094:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:0.0:1789635429.732195:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40fec5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.732213:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40fec5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.732226:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40fec5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.732456:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1bc00/0xb0c3a59caa40febe lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74339 expref: 69 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.732738:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40fec5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74339 expref: 68 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.732750:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d0447667700) 00010000:00010000:0.0:1789635429.732754:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789635429.732758:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1a200, rc 0) 00000100:00100000:1.0:1789635429.733269:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+68:12449:x1876568411576320:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 2830us (4238us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1789635429.733280:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 235 00000100:00100000:3.0:1789635429.737569:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635429.737825:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411576576 00000100:00100000:0.0:1789635429.737838:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411576576 00000100:00100000:0.0:1789635429.737915:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 236 00000100:00100000:0.0:1789635429.737926:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+68:12449:x1876568411576576:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789635429.738008:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635429.738041:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a200/0xb0c3a59caa40fec5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74339 expref: 68 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.738063:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d0447667700) 00010000:00010000:0.0:1789635429.738077:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789635429.738102:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fed3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.738118:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fed3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.738130:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fed3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.738167:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ae00/0xb0c3a59caa40feda lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x57b5a68 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.738175:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ae00/0xb0c3a59caa40feda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x57b5a68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.738182:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ae00/0xb0c3a59caa40feda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x57b5a68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.738239:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fed3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.738248:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fed3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.738255:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fed3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.738262:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1a800 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635429.738267:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fed3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.738276:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fed3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.738284:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d0544e2e500) 00010000:00010000:0.0:1789635429.738287:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635429.738291:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fed3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.738310:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a800/0xb0c3a59caa40fed3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.738326:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ae00/0xb0c3a59caa40feda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x57b5a68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.738333:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ae00/0xb0c3a59caa40feda lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x57b5a68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.738339:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ae00/0xb0c3a59caa40feda lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x57b5a68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.738344:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1ae00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635429.738347:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ae00/0xb0c3a59caa40feda lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x57b5a68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.738353:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ae00/0xb0c3a59caa40feda lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x57b5a68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.738361:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x57b5a68 (ffff8d0447667300) 00010000:00010000:0.0:1789635429.738363:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635429.738366:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ae00/0xb0c3a59caa40feda lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x57b5a68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.738371:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ae00/0xb0c3a59caa40feda lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x57b5a68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635429.738485:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+67:12449:x1876568411576576:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 560us (927us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789635429.738494:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 236 00000100:00100000:3.0:1789635429.741338:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635429.744665:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411576704 00000100:00100000:1.0:1789635429.744687:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411576704 00000100:00100000:1.0:1789635429.745002:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 237 00000100:00100000:1.0:1789635429.745016:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+67:12449:x1876568411576704:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789635429.745046:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635429.745077:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fee1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74340 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.745124:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fee8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.745140:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fee8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.745155:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fee8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.745313:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40fee1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74340 expref: 69 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.745333:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fee8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74340 expref: 68 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.745351:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d04466ca000) 00010000:00010000:1.0:1789635429.745354:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789635429.745358:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e152800, rc 0) 00000100:00100000:1.0:1789635429.745456:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+68:12449:x1876568411576704:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 433us (4121us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635429.745464:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 237 00000100:00100000:0.0:1789635429.749145:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635429.749929:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411576960 00000100:00100000:2.0:1789635429.749943:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411576960 00000100:00100000:2.0:1789635429.750049:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 238 00000100:00100000:2.0:1789635429.750062:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044881c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+68:12449:x1876568411576960:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789635429.750173:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40feef lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.750194:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40feef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.750230:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40feef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789635429.750450:0:10094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:2.0:1789635429.750463:0:10094:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 448433865847ns, next at 449433862727ns, rc = 0 00000004:00010000:2.0:1789635429.750525:0:10094:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005461161c reply state 00000000b89ee36e transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40feef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.750539:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40feef lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.750549:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d04466ca000) 00010000:00010000:2.0:1789635429.750552:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789635429.750556:0:10094:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789635429.750706:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044881c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+70:12449:x1876568411576960:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 646us (1573us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1789635429.750715:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 238 00000100:00100000:2.0:1789635429.754038:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635429.754143:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411577088 00000100:00100000:1.0:1789635429.754156:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411577088 00000100:00100000:1.0:1789635429.754286:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 239 00000100:00100000:1.0:1789635429.754307:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+70:12449:x1876568411577088:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789635429.754338:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635429.754366:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fef6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74347 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.754456:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fef6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74347 expref: 71 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.754934:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fef6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74347 expref: 71 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.754962:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d04466ca000) 00010000:00010000:1.0:1789635429.754966:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789635429.754970:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e152a00, rc 0) 00000100:00100000:1.0:1789635429.755046:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+71:12449:x1876568411577088:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 748us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635429.755083:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 239 00000100:00100000:3.0:1789635429.758786:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635429.759376:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411577216 00000100:00100000:2.0:1789635429.759402:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411577216 00000100:00080000:3.0:1789635429.759588:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789635429.759899:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 70 00000100:00100000:0.0:1789635429.759918:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+9:2398:x1876568411577216:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789635429.760213:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+10:2398:x1876568411577216:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 303us (1451us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1789635429.760222:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 70 00000100:00100000:0.0:1789635429.763210:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635429.763496:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411577472 00000100:00100000:3.0:1789635429.763509:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411577472 00000100:00100000:3.0:1789635429.763577:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:3.0:1789635429.763589:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044881e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+71:12449:x1876568411577472:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789635429.764202:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044881e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+72:12449:x1876568411577472:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 612us (1002us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1789635429.764211:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:0.0:1789635429.767396:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635429.768031:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411577728 00000100:00100000:2.0:1789635429.768046:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411577728 00000100:00100000:2.0:1789635429.768121:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 240 00000100:00100000:2.0:1789635429.768133:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044881d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+72:12449:x1876568411577728:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789635429.768281:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044881d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+72:12449:x1876568411577728:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 150us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635429.768290:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 240 00000100:00100000:2.0:1789635429.770712:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635429.770940:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411577856 00000100:00100000:3.0:1789635429.770952:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411577856 00000100:00100000:3.0:1789635429.771022:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 241 00000100:00100000:3.0:1789635429.771033:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+72:12449:x1876568411577856:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789635429.771062:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635429.771087:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40fefd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7434e expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635429.771176:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa40ff04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635429.771193:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa40ff04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635429.771207:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa40ff04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635429.771277:0:9526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789635429.771314:0:9526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa40ff04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635429.771346:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40fefd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7434e expref: 74 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635429.771368:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa40ff04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7434e expref: 73 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635429.771378:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d04466ca000) 00010000:00010000:3.0:1789635429.771381:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789635429.771385:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05488ff000, rc 0) 00000100:00100000:3.0:1789635429.771466:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+73:12449:x1876568411577856:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 434us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635429.771473:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 241 00000100:00100000:3.0:1789635429.775044:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635429.775241:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411577984 00000100:00100000:0.0:1789635429.775255:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411577984 00000100:00100000:0.0:1789635429.775330:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 71 00000100:00100000:0.0:1789635429.775342:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447659c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+10:2396:x1876568411577984:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789635429.775366:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635429.775400:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000360dcadc/0xb0c3a59caa40ff0b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74355 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789635429.775432:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aabab65, blocks: 0x0 00010000:00010000:0.0:1789635429.775464:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1789635429.775476:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635429.775488:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000360dcadc/0xb0c3a59caa40ff0b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74355 expref: 11 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.775508:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000360dcadc/0xb0c3a59caa40ff0b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74355 expref: 11 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.775525:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1ae00, rc 0) 00000100:00100000:0.0:1789635429.775639:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447659c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+11:2396:x1876568411577984:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 299us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635429.775666:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 71 00000100:00100000:0.0:1789635429.780724:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635429.781083:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411578240 00000100:00100000:1.0:1789635429.781097:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411578240 00000100:00100000:1.0:1789635429.781243:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 242 00000100:00100000:1.0:1789635429.781255:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044881d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+73:12449:x1876568411578240:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789635429.781477:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044881d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+73:12449:x1876568411578240:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 224us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635429.781486:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 242 00000100:00100000:3.0:1789635429.791900:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635429.792094:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411578368 00000100:00100000:0.0:1789635429.792108:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411578368 00000100:00100000:0.0:1789635429.792190:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 72 00000100:00100000:0.0:1789635429.792202:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447659180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+11:12449:x1876568411578368:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789635429.792227:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635429.792251:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7215836/0xb0c3a59caa40ff12 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7435c expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.792289:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000360dcadc/0xb0c3a59caa40ff0b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74355 expref: 12 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.792300:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635429.792306:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635429.792313:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7215836/0xb0c3a59caa40ff12 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7435c expref: 12 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.792355:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000360dcadc/0xb0c3a59caa40ff0b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74355 expref: 12 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.792370:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000360dcadc/0xb0c3a59caa40ff0b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74355 expref: 12 pid: 8431 timeout: 548 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635429.792397:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044881f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8432:1876568427361664:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789635429.792529:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0545287c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789635429.796997:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635429.797108:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411578496 00000100:00100000:1.0:1789635429.797120:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411578496 00000100:00100000:0.0:1789635429.797146:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044881f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8432:1876568427361664:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789635429.797192:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a7215836/0xb0c3a59caa40ff12 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7435c expref: 13 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.797220:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1a800, rc 0) 00010000:00010000:1.0:1789635429.797237:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000360dcadc/0xb0c3a59caa40ff0b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74355 expref: 13 pid: 8431 timeout: 548 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635429.797296:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447659180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+13:12449:x1876568411578368:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 5096us (5409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635429.797305:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 72 00000100:00100000:1.0:1789635429.797349:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 99 00000100:00100000:1.0:1789635429.797360:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b401c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+13:2397:x1876568411578496:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635429.797376:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635429.797413:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000360dcadc/0xb0c3a59caa40ff0b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74355 expref: 13 pid: 8431 timeout: 548 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.797427:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000360dcadc/0xb0c3a59caa40ff0b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74355 expref: 13 pid: 8431 timeout: 548 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.797455:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000360dcadc/0xb0c3a59caa40ff0b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74355 expref: 13 pid: 8431 timeout: 548 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.797501:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635429.797507:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635429.797516:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a7215836/0xb0c3a59caa40ff12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7435c expref: 12 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.797529:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7215836/0xb0c3a59caa40ff12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7435c expref: 12 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.797569:0:6499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a7215836/0xb0c3a59caa40ff12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7435c expref: 12 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635429.797589:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bf8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6499:1876568427361792:192.168.203.20@tcp:105: 00000100:00100000:1.0:1789635429.797708:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0548dc6000 going to sleep for 11 seconds 00000100:00100000:1.0:1789635429.801536:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bf8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6499:1876568427361792:192.168.203.20@tcp:105: 00010000:00010000:1.0:1789635429.801574:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635429.801675:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b401c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+11:2397:x1876568411578496:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 4315us (4691us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635429.801689:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 99 00000100:00100000:0.0:1789635429.805912:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635429.810145:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411578624 00000100:00100000:2.0:1789635429.810179:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411578624 00002000:00100000:2.0:1789635429.810259:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8d044881f480 x1876568411578624/t0(0) o4->6e1c17f2-a595-4ed0-97c8-b9260d0850ab@192.168.203.20@tcp:50/0 lens 504/0 e 0 to 0 dl 1789635440 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789635429.810272:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d044881f480 with x1876568411578624 ext(0->12) 00002000:00010000:2.0:1789635429.810279:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d044881f480 00000100:00100000:2.0:1789635429.810334:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:2.0:1789635429.810355:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044881f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+11:2396:x1876568411578624:12345-192.168.203.20@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789635429.813034:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044881f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+13:2396:x1876568411578624:12345-192.168.203.20@tcp:4:lhsmtool_posix.0 Request processed in 2677us (7121us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789635429.813052:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 6 00002000:00100000:2.0:1789635429.813068:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8d044881f480 x1876568411578624/t4294967321(0) o4->6e1c17f2-a595-4ed0-97c8-b9260d0850ab@192.168.203.20@tcp:50/0 lens 504/448 e 0 to 0 dl 1789635440 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789635429.813078:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d044881f480 with x1876568411578624 ext(0->12) 00002000:00010000:2.0:1789635429.813086:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d044881f480 00000100:00100000:3.0:1789635429.822460:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635429.822747:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411578752 00000100:00100000:0.0:1789635429.822761:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411578752 00000100:00100000:0.0:1789635429.822841:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 243 00000100:00100000:0.0:1789635429.822855:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+73:12449:x1876568411578752:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789635429.825520:0:6493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:3.0:1789635429.825542:0:6493:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000004:00080000:3.0:1789635429.825585:0:6493:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:3.0:1789635429.825644:0:6493:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d05489c29c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1789635429.825650:0:6493:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d0548e6b400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d0579b3e840 00000020:00080000:3.0:1789635429.825654:0:6493:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d0548e6ba00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d054518e400 00000004:00080000:3.0:1789635429.825699:0:6493:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:3.0:1789635429.825730:0:6493:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d057ae00c00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1789635429.825733:0:6493:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d056e09ec00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d057ae00a80 00000020:00080000:3.0:1789635429.825737:0:6493:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d056e09ee00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d0447ad9400 00000020:00080000:3.0:1789635429.825750:0:6493:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00010000:00010000:2.0:1789635429.826026:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40fc17 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826041:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40fc17 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826050:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40fc17 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826058:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540030c00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635429.826063:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40fc17 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826084:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40fc17 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826104:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d04466cae00) 00010000:00010000:2.0:1789635429.826108:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635429.826114:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40fc17 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826119:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540030c00/0xb0c3a59caa40fc17 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826169:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fcbf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826175:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fcbf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826181:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fcbf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826186:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152e00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635429.826189:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fcbf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826195:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fcbf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826203:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d0447667200) 00010000:00010000:2.0:1789635429.826206:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635429.826209:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fcbf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826226:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40fcbf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826245:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fd3d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826251:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fd3d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826257:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fd3d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826262:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3a00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635429.826265:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fd3d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826270:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fd3d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826278:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d0543c44a00) 00000100:00100000:1.0:1789635429.826278:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427361920:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789635429.826281:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635429.826284:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fd3d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826288:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40fd3d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826300:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b200/0xb0c3a59caa40fd60 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826305:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b200/0xb0c3a59caa40fd60 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826317:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b200/0xb0c3a59caa40fd60 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826321:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1b200 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635429.826323:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b200/0xb0c3a59caa40fd60 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826329:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b200/0xb0c3a59caa40fd60 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826336:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d0543c44a00) 00010000:00010000:2.0:1789635429.826338:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635429.826340:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b200/0xb0c3a59caa40fd60 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826345:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1b200/0xb0c3a59caa40fd60 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826362:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40fe32 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826368:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40fe32 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826373:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40fe32 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826378:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a2e00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635429.826381:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40fe32 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826406:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40fe32 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826415:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d04466ca700) 00010000:00010000:2.0:1789635429.826417:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635429.826420:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40fe32 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826425:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40fe32 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635429.826430:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789635429.826438:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40feef lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826444:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40feef lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826449:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40feef lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826454:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3000 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635429.826456:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40feef lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826462:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40feef lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826479:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d04466ca000) 00010000:00010000:2.0:1789635429.826482:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789635429.826485:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40feef lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635429.826494:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427362048:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1789635429.826501:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40feef lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635429.826519:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635429.826549:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427361920 00000100:00100000:2.0:1789635429.826558:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427361920 00000100:00100000:2.0:1789635429.826654:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427362048 00000100:00100000:2.0:1789635429.826657:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427362048 00000020:00080000:0.0:1789635429.826670:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:2.0:1789635429.826680:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789635429.826689:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3641:x1876568427361920:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789635429.826942:0:8430:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:2.0:1789635429.826971:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000deaab9c2/0xb0c3a59caa40ff19 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.826994:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7e1938c/0xb0c3a59caa40fccd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742b4 expref: 12 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.827003:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789635429.827009:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789635429.827014:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000deaab9c2/0xb0c3a59caa40ff19 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.827048:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d7e1938c/0xb0c3a59caa40fccd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742b4 expref: 12 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.827066:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d7e1938c/0xb0c3a59caa40fccd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742b4 expref: 12 pid: 8432 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635429.827094:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447974a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1876568427362304:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789635429.827290:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0550647780 going to sleep for 11 seconds 00000100:00100000:2.0:1789635429.827312:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789635429.827323:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3642:x1876568427362048:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789635429.827540:0:10116:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789635429.827544:0:10116:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1789635430 00002000:00010000:2.0:1789635429.827547:0:10116:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789635429.827550:0:10116:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1789635429 -> 1789635430 00002000:00010000:2.0:1789635429.827553:0:10116:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1789635429.827620:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3642:x1876568427362048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 299us (1100us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1789635429.827627:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1789635429.828050:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789635429.829123:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+21:12449:x1876568411578752:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 Request processed in 6264us (6668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635429.829294:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 243 00000004:00080000:1.0:1789635429.830049:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d0550bf8700/2, rc 0, transno 4294967322 00000100:00100000:1.0:1789635429.830060:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427362048:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789635429.830075:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789635429.830086:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044881c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427362176:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789635429.830148:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635429.830213:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427362176 00000100:00100000:1.0:1789635429.830221:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427362176 00000100:00100000:1.0:1789635429.830270:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789635429.830280:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3642:x1876568427362176:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789635429.830314:0:10116:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:1.0:1789635429.830364:0:10116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aabab65, atime: 0x6aabab65, ctime: 0x6aabab65, blocks: 0x8 00010000:00010000:1.0:1789635429.830373:0:10116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d20db3fa/0xb0c3a59caa40ff20 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789635429.830524:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:1.0:1789635429.830537:0:10116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=448s v=(0 0) 00010000:00010000:1.0:1789635429.830544:0:10116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635429.830552:0:10116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d20db3fa/0xb0c3a59caa40ff20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.830570:0:10116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d20db3fa/0xb0c3a59caa40ff20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.830581:0:10116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d20db3fa/0xb0c3a59caa40ff20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.830590:0:10116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d20db3fa/0xb0c3a59caa40ff20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.830652:0:10116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789635429.830686:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635429.830696:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d20db3fa/0xb0c3a59caa40ff20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.830707:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e153000 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:0.0:1789635429.830712:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d20db3fa/0xb0c3a59caa40ff20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.830723:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d20db3fa/0xb0c3a59caa40ff20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.830760:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d20db3fa/0xb0c3a59caa40ff20 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.830768:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d20db3fa/0xb0c3a59caa40ff20 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.830793:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635429.830795:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635429.830798:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635429.830803:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3642:x1876568427362176:12345-0@lo:6:osp-syn-0-0.0 Request processed in 521us (651us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789635429.830811:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:1.0:1789635429.830856:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d044881c000/2, rc 0, transno 4294967311 00000100:00100000:1.0:1789635429.830862:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044881c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427362176:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789635429.832734:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635429.832869:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635429.833053:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411578880 00000100:00100000:0.0:1789635429.833064:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411578880 00000100:00100000:0.0:1789635429.833197:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 76 00000100:00100000:0.0:1789635429.833211:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447658700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+13:2396:x1876568411578880:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789635429.833230:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411579008 00000100:00100000:1.0:1789635429.833236:0:7457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411579008 00010000:00010000:1.0:1789635429.833264:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d7e1938c/0xb0c3a59caa40fccd lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742b4 expref: 14 pid: 8432 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635429.833293:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 100 00000100:00100000:1.0:1789635429.833300:0:7457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447659880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+14:2396:x1876568411579008:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635429.833311:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635429.833316:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d7e1938c/0xb0c3a59caa40fccd lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742b4 expref: 14 pid: 8432 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.833330:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d7e1938c/0xb0c3a59caa40fccd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742b4 expref: 14 pid: 8432 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.834072:0:7457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789635429.834080:0:7457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789635429.834086:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000deaab9c2/0xb0c3a59caa40ff19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.834115:0:7457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000deaab9c2/0xb0c3a59caa40ff19 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.834140:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635429.834455:0:7457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447659880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+14:2396:x1876568411579008:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 1151us (1582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635429.834464:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 100 00010000:00010000:2.0:1789635429.834544:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7e1938c/0xb0c3a59caa40fccd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab742b4 expref: 13 pid: 8432 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635429.834564:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447974a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1876568427362304:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789635429.834591:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000deaab9c2/0xb0c3a59caa40ff19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.834631:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000deaab9c2/0xb0c3a59caa40ff19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.834648:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000deaab9c2/0xb0c3a59caa40ff19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.834660:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000deaab9c2/0xb0c3a59caa40ff19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.834668:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000deaab9c2/0xb0c3a59caa40ff19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.834692:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789635429.834824:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635429.834832:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000deaab9c2/0xb0c3a59caa40ff19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.834841:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3e00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:1.0:1789635429.834846:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000deaab9c2/0xb0c3a59caa40ff19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.834856:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000deaab9c2/0xb0c3a59caa40ff19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.834870:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000deaab9c2/0xb0c3a59caa40ff19 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.834878:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000deaab9c2/0xb0c3a59caa40ff19 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.834900:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635429.834908:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635429.834910:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635429.836382:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3641:x1876568427361920:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9688us (9946us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1789635429.836404:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000004:00080000:1.0:1789635429.836454:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d0550bfa300/2, rc 0, transno 4294967323 00000100:00100000:1.0:1789635429.836462:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427361920:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1789635429.838173:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:0.0:1789635429.838189:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:2.0:1789635429.839179:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447658700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:2396:x1876568411578880:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 Request processed in 5962us (6446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635429.839193:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 76 00000100:00100000:3.0:1789635429.846107:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635429.847035:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411579264 00000100:00100000:2.0:1789635429.847047:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411579264 00000100:00100000:3.0:1789635429.847273:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 244 00000100:00100000:3.0:1789635429.847283:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+21:12449:x1876568411579264:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789635429.847361:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635429.847399:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa40ff04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7434e expref: 21 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635429.847422:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d04466ca000) 00010000:00010000:3.0:1789635429.847427:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789635429.847473:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40ff27 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635429.847490:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40ff27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635429.847502:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40ff27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789635429.847670:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f02cffdd reply state 00000000029c1153 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40ff27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635429.847705:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40ff27 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635429.847712:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d04466ca000) 00010000:00010000:3.0:1789635429.847714:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789635429.847717:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789635429.848104:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+22:12449:x1876568411579264:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 819us (2007us total) trans 4294967509 rc 0/0 00000100:00100000:3.0:1789635429.848123:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 244 00000100:00100000:2.0:1789635429.850744:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635429.850804:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411579392 00000100:00100000:1.0:1789635429.850815:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411579392 00000100:00100000:1.0:1789635429.850881:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 77 00000100:00100000:1.0:1789635429.850893:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:2397:x1876568411579392:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789635429.851224:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789635429.851229:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1789635430 -> 1789635429 00002000:00010000:1.0:1789635429.851232:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1789635429 00002000:00010000:1.0:1789635429.851235:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1789635430 -> 1789635429 00002000:00010000:1.0:1789635429.851238:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1789635429.851330:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:2397:x1876568411579392:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 439us (596us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1789635429.851338:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 77 00000100:00100000:0.0:1789635429.853418:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635429.853675:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411579648 00000100:00100000:1.0:1789635429.853687:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411579648 00000100:00100000:1.0:1789635429.853754:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 245 00000100:00100000:1.0:1789635429.853830:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044881c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+22:12449:x1876568411579648:12345-192.168.203.20@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789635429.853972:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40ff2e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.853994:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fee8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74340 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.854005:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40ff2e lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.854069:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fee8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74340 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.854085:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fee8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74340 expref: 22 pid: 6515 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635429.854103:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bfaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6516:1876568427362432:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789635429.854895:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05746cf600 going to sleep for 11 seconds 00000100:00100000:3.0:1789635429.857829:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635429.858015:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411579776 00000100:00100000:2.0:1789635429.858027:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411579776 00010000:00010000:2.0:1789635429.858076:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fee8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74340 expref: 23 pid: 6515 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635429.858126:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 101 00000100:00100000:2.0:1789635429.858137:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+23:2397:x1876568411579776:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635429.858173:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635429.858181:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fee8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74340 expref: 23 pid: 6515 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.858196:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fee8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74340 expref: 23 pid: 6515 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.858224:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d04466ca000) 00010000:00010000:2.0:1789635429.858229:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40ff2e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.858240:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40ff2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.858249:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40ff2e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.858273:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635429.858338:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+23:2397:x1876568411579776:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 202us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635429.858346:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 101 00010000:00010000:1.0:1789635429.858463:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40fee8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74340 expref: 22 pid: 6515 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635429.858489:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bfaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6516:1876568427362432:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789635429.858514:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40ff2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.858524:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40ff2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.858530:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40ff2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.858580:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40ff2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.858588:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40ff2e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.858632:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40ff2e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.858646:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e153000 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635429.858651:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40ff2e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.858659:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40ff2e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.858670:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d04466ca000) 00010000:00010000:1.0:1789635429.858672:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789635429.858677:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40ff2e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.858683:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40ff2e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635429.858736:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044881c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+21:12449:x1876568411579648:12345-192.168.203.20@tcp:55:lhsmtool_posix.0 Request processed in 4972us (5330us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789635429.858743:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 245 00000100:00100000:3.0:1789635429.860898:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635429.861011:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411579904 00000100:00100000:2.0:1789635429.861022:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411579904 00000100:00100000:2.0:1789635429.861299:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 78 00000100:00100000:2.0:1789635429.861313:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447658380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:2396:x1876568411579904:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789635429.861371:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002fc91803/0xb0c3a59caa40ff35 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.861430:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a7215836/0xb0c3a59caa40ff12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7435c expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.861439:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635429.861444:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789635429.861550:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fc91803/0xb0c3a59caa40ff35 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.861685:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a7215836/0xb0c3a59caa40ff12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7435c expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.861702:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a7215836/0xb0c3a59caa40ff12 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7435c expref: 8 pid: 8432 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635429.861718:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447975180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1876568427362560:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789635429.861940:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0550647b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789635429.867334:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635429.868648:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411580032 00000100:00100000:1.0:1789635429.868665:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411580032 00010000:00010000:1.0:1789635429.868726:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a7215836/0xb0c3a59caa40ff12 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7435c expref: 9 pid: 8432 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635429.868951:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 102 00000100:00100000:1.0:1789635429.868965:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044881fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+9:2397:x1876568411580032:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635429.868985:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635429.869015:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a7215836/0xb0c3a59caa40ff12 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7435c expref: 9 pid: 8432 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.869063:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a7215836/0xb0c3a59caa40ff12 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7435c expref: 9 pid: 8432 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.869102:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789635429.869107:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789635429.869114:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002fc91803/0xb0c3a59caa40ff35 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.869127:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fc91803/0xb0c3a59caa40ff35 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.869156:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635429.869250:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044881fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+9:2397:x1876568411580032:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 287us (1929us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635429.869258:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 102 00010000:00010000:2.0:1789635429.870726:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7215836/0xb0c3a59caa40ff12 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7435c expref: 8 pid: 8432 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635429.870757:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447975180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1876568427362560:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789635429.871044:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002fc91803/0xb0c3a59caa40ff35 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.871059:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002fc91803/0xb0c3a59caa40ff35 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.871088:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fc91803/0xb0c3a59caa40ff35 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.871126:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002fc91803/0xb0c3a59caa40ff35 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.871140:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fc91803/0xb0c3a59caa40ff35 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.871149:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fc91803/0xb0c3a59caa40ff35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.871158:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3000 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635429.871162:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fc91803/0xb0c3a59caa40ff35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.871439:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fc91803/0xb0c3a59caa40ff35 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.871462:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fc91803/0xb0c3a59caa40ff35 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.871470:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fc91803/0xb0c3a59caa40ff35 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635429.871634:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447658380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:2396:x1876568411579904:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 Request processed in 10284us (10709us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635429.871646:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 78 00000100:00100000:0.0:1789635429.874190:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635429.874321:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411580288 00000100:00100000:2.0:1789635429.874335:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411580288 00000100:00100000:2.0:1789635429.874535:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 246 00000100:00100000:2.0:1789635429.874548:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044881ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+21:12449:x1876568411580288:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789635429.874685:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40ff3c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.874703:0:9526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fe2b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74308 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.874714:0:9526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40ff3c lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.874757:0:9526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fe2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74308 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.874772:0:9526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fe2b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74308 expref: 21 pid: 6516 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635429.874787:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447975180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9526:1876568427362688:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789635429.874888:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0550647b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789635429.877925:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447975180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9526:1876568427362688:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789635429.878048:0:9526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40ff3c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635429.880158:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635429.880335:0:13189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411580416 00000100:00100000:1.0:1789635429.880353:0:13189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411580416 00010000:00010000:1.0:1789635429.880410:0:13189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fe2b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74308 expref: 22 pid: 6516 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635429.880459:0:13189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 103 00000100:00100000:1.0:1789635429.880576:0:13189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044881df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+22:2396:x1876568411580416:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635429.880692:0:13189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635429.880700:0:13189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fe2b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74308 expref: 22 pid: 6516 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.880729:0:13189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fe2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74308 expref: 22 pid: 6516 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.880752:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40fe2b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74308 expref: 22 pid: 6516 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.880926:0:13189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d04466ca700) 00010000:00010000:1.0:1789635429.880934:0:13189:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40fe8d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7432b expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.880946:0:13189:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40ff3c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.880954:0:13189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40ff3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.881031:0:13189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40ff3c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.881113:0:13189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635429.881197:0:13189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044881df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+21:2396:x1876568411580416:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 729us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635429.881205:0:13189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 103 00010000:00010000:2.0:1789635429.881901:0:9526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40ff3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.881912:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40ff3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.883066:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40ff43 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.883091:0:9526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fef6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74347 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.883102:0:9526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40ff43 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.883151:0:9526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fef6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74347 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.883170:0:9526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fef6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74347 expref: 21 pid: 6516 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635429.883189:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447975180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9526:1876568427362816:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789635429.883355:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0550647180 going to sleep for 11 seconds 00000100:00100000:2.0:1789635429.886547:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447975180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9526:1876568427362816:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789635429.886590:0:9526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40ff43 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635429.887136:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635429.887218:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411580544 00000100:00100000:2.0:1789635429.887228:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411580544 00010000:00010000:2.0:1789635429.887275:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fef6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74347 expref: 22 pid: 6516 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635429.887632:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 104 00000100:00100000:2.0:1789635429.887645:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044881f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+22:2397:x1876568411580544:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635429.887665:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635429.887673:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fef6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74347 expref: 22 pid: 6516 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.887687:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fef6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74347 expref: 22 pid: 6516 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.887714:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40fef6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74347 expref: 22 pid: 6516 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.887733:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d04466ca000) 00010000:00010000:2.0:1789635429.887738:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40ff43 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.887749:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40ff43 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.887757:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40ff43 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.888007:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789635429.888060:0:9526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40ff43 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.888068:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40ff43 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635429.888098:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044881f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+21:2397:x1876568411580544:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 455us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635429.888106:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 104 00000001:00080000:0.0:1789635429.888423:0:9526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:0.0:1789635429.888578:0:9526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:0.0:1789635429.889344:0:9526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:0.0:1789635429.889719:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044881e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9526:1876568427362944:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789635429.890636:0:9526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635429.890686:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05489c2900 going to sleep for 11 seconds 00000100:00100000:3.0:1789635429.891124:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427362944 00000100:00100000:3.0:1789635429.891136:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427362944 00000100:00100000:3.0:1789635429.891205:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789635429.891216:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e015180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:9526:x1876568427362944:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789635429.891354:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e015180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:9526:x1876568427362944:12345-0@lo:1000:mdt00_003.0 Request processed in 140us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635429.891362:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789635429.891490:0:9526:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1789635429.891690:0:9526:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:2.0:1789635429.891716:0:9526:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d0550bf8700, transno 4294967322 00000100:00100000:2.0:1789635429.891781:0:9526:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8d0550bfa300 x1876568427361920/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789635445 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635429.891795:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044881e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9526:1876568427362944:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1789635429.891967:0:9526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1789635429.892057:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447975180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9526:1876568427363072:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789635429.892098:0:9526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635429.892126:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0550647e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789635429.892313:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427363072 00000100:00100000:3.0:1789635429.892320:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427363072 00000100:00100000:3.0:1789635429.892359:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789635429.892368:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9526:x1876568427363072:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789635429.892525:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:9526:x1876568427363072:12345-0@lo:1000:mdt00_003.0 Request processed in 157us (425us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1789635429.892531:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789635429.892661:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447975180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9526:1876568427363072:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1789635429.892704:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40ff43 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.892714:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40ff43 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.892722:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40ff43 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.892729:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3000 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635429.892735:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40ff43 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.892743:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40ff43 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.892763:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d04466ca000) 00010000:00010000:0.0:1789635429.892766:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789635429.892772:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40ff43 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.892778:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa40ff43 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.892806:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fe86 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.892830:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fe86 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.892836:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fe86 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.892841:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e153a00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635429.892844:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fe86 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.892850:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fe86 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.892858:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d04466ca700) 00010000:00010000:0.0:1789635429.892861:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789635429.892868:0:9526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40fe8d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7432b expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.892880:0:9526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40fe8d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7432b expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.892891:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40fe8d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7432b expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.892933:0:9526:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40fe8d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7432b expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635429.892946:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e015c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9526:1876568427363200:192.168.203.20@tcp:105: 00000100:00100000:0.0:1789635429.893034:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b570000 going to sleep for 11 seconds 00000100:00100000:0.0:1789635429.896707:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635429.897045:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e015c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9526:1876568427363200:192.168.203.20@tcp:105: 00010000:00010000:2.0:1789635429.897085:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fe86 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.897098:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa40fe86 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635429.897110:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411580672 00000100:00100000:3.0:1789635429.897137:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411580672 00010000:00010000:2.0:1789635429.897138:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40ff4a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.897153:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40ff4a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.897177:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40ff4a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635429.897199:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 61 00010000:00010000:2.0:1789635429.897199:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40ff4a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.897206:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40ff4a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635429.897209:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+25:12448:x1876568411580672:12345-192.168.203.20@tcp:49:lfs.0 00010000:00010000:2.0:1789635429.897213:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40ff4a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.897219:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3a00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635429.897222:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40ff4a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.897229:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40ff4a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.897242:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d04466ca700) 00010000:00010000:2.0:1789635429.897245:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635429.897249:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40ff4a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.897255:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40ff4a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.897264:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40ff3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.897270:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40ff3c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.897275:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40ff3c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.897284:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a2e00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635429.897287:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40ff3c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.897293:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40ff3c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.897300:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d04466ca700) 00010000:00010000:2.0:1789635429.897302:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789635429.897305:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40ff3c lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.897309:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40ff3c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635429.897367:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+25:12448:x1876568411580672:12345-192.168.203.20@tcp:49:lfs.0 Request processed in 159us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635429.897376:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 61 00000100:00100000:2.0:1789635429.897909:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044881ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+24:12449:x1876568411580288:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 23361us (23730us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1789635429.897919:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 246 00000020:00080000:2.0:1789635429.897923:0:9526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789635429.898204:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789635429.898210:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789635429.898794:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:3.0:1789635429.898804:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789635429.901888:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635429.902047:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411580928 00000100:00100000:3.0:1789635429.902060:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411580928 00000100:00100000:3.0:1789635429.902137:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 62 00000100:00100000:3.0:1789635429.902149:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b746450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+24:12449:x1876568411580928:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789635429.903698:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000004:00080000:3.0:1789635429.903785:0:6517:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789635429.903840:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:3.0:1789635429.903900:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa40ff51 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635429.903929:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa40ff51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635429.903942:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa40ff51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635429.903955:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa40ff51 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635429.903962:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa40ff51 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635429.903985:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa40ff51 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635429.904009:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789635429.904062:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635429.904070:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa40ff51 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.904078:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488fea00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635429.904082:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa40ff51 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.904090:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa40ff51 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635429.904117:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d04466ca000) 00000100:00100000:3.0:1789635429.904120:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b746450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+26:12449:x1876568411580928:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 1973us (2245us total) trans 4294967516 rc 0/0 00010000:00010000:2.0:1789635429.904120:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789635429.904126:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa40ff51 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635429.904130:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 62 00010000:00010000:2.0:1789635429.904132:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa40ff51 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789635429.904136:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789635429.904145:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635429.904147:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635429.904148:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635429.906158:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411581184 00000100:00100000:1.0:1789635429.906175:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411581184 00000100:00100000:1.0:1789635429.906300:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 247 00000100:00100000:1.0:1789635429.906312:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e017480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+26:12448:x1876568411581184:12345-192.168.203.20@tcp:58:lfs.0 00000040:00080000:1.0:1789635429.906562:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1789635429.906680:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e017480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+26:12448:x1876568411581184:12345-192.168.203.20@tcp:58:lfs.0 Request processed in 370us (2989us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635429.906689:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 247 00000100:00100000:0.0:1789635429.936638:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635429.936940:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411581312 00000100:00100000:1.0:1789635429.936955:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411581312 00000100:00100000:1.0:1789635429.937041:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 248 00000100:00100000:1.0:1789635429.937056:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e014e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+26:12452:x1876568411581312:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789635429.937092:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635429.937119:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40ff58 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74363 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.937199:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40ff5f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.937216:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40ff5f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.937231:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40ff5f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.937248:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40ff66 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.937256:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40ff66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.937264:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40ff66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.937546:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40ff6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.937560:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fe78 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74324 expref: 27 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.937569:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40ff6d lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.937660:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fe78 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74324 expref: 27 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.937676:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fe78 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74324 expref: 27 pid: 6515 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635429.937694:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bf8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6516:1876568427363328:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789635429.937909:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05746cf600 going to sleep for 11 seconds 00000100:00100000:1.0:1789635429.945077:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bf8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6516:1876568427363328:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789635429.945118:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40ff6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635429.945549:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635429.945816:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411581568 00000100:00100000:1.0:1789635429.945827:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411581568 00000100:00100000:1.0:1789635429.945977:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00100000:1.0:1789635429.945990:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+28:11391:x1876568411581568:12345-192.168.203.20@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789635429.946440:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+29:11391:x1876568411581568:12345-192.168.203.20@tcp:35:ldlm_bl.0 Request processed in 450us (889us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1789635429.946459:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00100000:0.0:1789635429.948301:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635429.948416:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411581696 00000100:00100000:1.0:1789635429.948428:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411581696 00010000:00010000:1.0:1789635429.948480:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fe78 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74324 expref: 29 pid: 6515 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635429.948536:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 105 00000100:00100000:1.0:1789635429.948546:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e014000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+29:2396:x1876568411581696:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635429.948574:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635429.948582:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fe78 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74324 expref: 29 pid: 6515 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.948634:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fe78 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74324 expref: 29 pid: 6515 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.948664:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153600/0xb0c3a59caa40fe78 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74324 expref: 29 pid: 6515 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.948685:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d04466ca700) 00010000:00010000:1.0:1789635429.948690:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40ff6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.948701:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40ff6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635429.948709:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40ff6d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.948792:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40ff6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.948801:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40ff6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635429.948867:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789635429.948872:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789635429.948896:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40ff6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.948911:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40ff6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.948922:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40ff5f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.948929:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40ff5f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.948937:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40ff5f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.948944:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e153000 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635429.948949:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40ff5f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.948966:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40ff5f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.948977:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d0544e2e500) 00010000:00010000:0.0:1789635429.948980:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635429.948985:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40ff5f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.948992:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153000/0xb0c3a59caa40ff5f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.949003:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40ff66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.949009:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40ff66 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.949015:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40ff66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.949020:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152800 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635429.949023:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40ff66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.949029:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40ff66 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.949036:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d04466ca200) 00010000:00010000:0.0:1789635429.949038:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635429.949041:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40ff66 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.949059:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152800/0xb0c3a59caa40ff66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.949102:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152400/0xb0c3a59caa40ff58 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74363 expref: 29 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.949116:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40ff6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74363 expref: 28 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635429.949124:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d04466ca700) 00010000:00010000:0.0:1789635429.949126:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789635429.949129:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e152e00, rc 0) 00000100:00100000:0.0:1789635429.949253:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e014e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+28:12452:x1876568411581312:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 12199us (12626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635429.949262:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 248 00010000:00010000:1.0:1789635429.949527:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635429.949554:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e014000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+27:2396:x1876568411581696:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 1009us (1267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635429.949563:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 105 00010000:00010000:1.0:1789635430.570567:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789635430.628428:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:3.0:1789635430.694071:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:3.0:1789635430.694228:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:2.0:1789635430.820115:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427363456:0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.820219:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635430.820274:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0558968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427363968:0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.820308:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635430.820331:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0558969f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427364480:0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.820358:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635430.820389:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d055896b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427364992:0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.820416:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635430.820446:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789635430.820454:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427363584:0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.820483:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635430.820505:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d055896bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427364096:0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.820526:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635430.820546:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d055896aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427364608:0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.820625:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635430.820672:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044881e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427363840:0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.820701:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635430.820727:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d055896b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427364352:0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.820748:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635430.820767:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0558968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427364864:0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.820789:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635430.820808:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789635430.820815:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044881e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427363712:0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.820838:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635430.820859:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d055896b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427364224:0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.820880:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635430.820898:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d055896ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1876568427364736:0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.820919:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635430.820950:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427363456 00000100:00100000:2.0:1789635430.820961:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427363456 00000100:00100000:2.0:1789635430.821027:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1789635430.821038:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3640:x1876568427363456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.821102:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3640:x1876568427363456:12345-0@lo:400:kworker.0 Request processed in 66us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635430.821110:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1789635430.821152:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427363968 00000100:00100000:2.0:1789635430.821157:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427363968 00000100:00100000:2.0:1789635430.821179:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427363584 00000100:00100000:2.0:1789635430.821182:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427363584 00000100:00100000:2.0:1789635430.821194:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427364096 00000100:00100000:2.0:1789635430.821206:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427364096 00000100:00100000:2.0:1789635430.821239:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427364608 00000100:00100000:2.0:1789635430.821242:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427364608 00000100:00100000:2.0:1789635430.821262:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427364224 00000100:00100000:2.0:1789635430.821264:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427364224 00000100:00100000:2.0:1789635430.821279:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427364736 00000100:00100000:2.0:1789635430.821281:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427364736 00000100:00100000:2.0:1789635430.821295:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1789635430.821302:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d055896a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427363968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.821336:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d055896a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427363968:12345-0@lo:400:kworker.0 Request processed in 36us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635430.821342:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1789635430.821353:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1789635430.821358:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0558969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427363584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.821395:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0558969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427363584:12345-0@lo:400:kworker.0 Request processed in 36us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635430.821400:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1789635430.821411:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1789635430.821416:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0558969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427364096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.821446:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0558969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427364096:12345-0@lo:400:kworker.0 Request processed in 29us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635430.821452:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1789635430.821467:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1789635430.821474:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427364608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.821505:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427364608:12345-0@lo:400:kworker.0 Request processed in 33us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635430.821510:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1789635430.821531:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1789635430.821537:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876568427364224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.821627:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876568427364224:12345-0@lo:400:kworker.0 Request processed in 90us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635430.821633:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1789635430.821647:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1789635430.821658:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876568427364736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.821688:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876568427364736:12345-0@lo:400:kworker.0 Request processed in 35us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635430.821694:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1789635430.821717:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427364480 00000100:00100000:2.0:1789635430.821721:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427364480 00000100:00100000:2.0:1789635430.821742:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427364992 00000100:00100000:2.0:1789635430.821745:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427364992 00000100:00100000:2.0:1789635430.821756:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427364352 00000100:00100000:2.0:1789635430.821758:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427364352 00000100:00100000:2.0:1789635430.821769:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427364864 00000100:00100000:2.0:1789635430.821772:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427364864 00000100:00100000:2.0:1789635430.821786:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789635430.821791:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0558968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427364480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.821824:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0558968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427364480:12345-0@lo:400:kworker.0 Request processed in 32us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635430.821830:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789635430.821842:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789635430.821847:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d055896a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3640:x1876568427364992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.821874:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d055896a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3640:x1876568427364992:12345-0@lo:400:kworker.0 Request processed in 27us (1459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635430.821890:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789635430.821902:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789635430.821907:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427364352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.821940:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427364352:12345-0@lo:400:kworker.0 Request processed in 33us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635430.821947:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789635430.821958:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789635430.821963:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427364864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.821990:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427364864:12345-0@lo:400:kworker.0 Request processed in 27us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635430.821995:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789635430.822025:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427363840 00000100:00100000:2.0:1789635430.822030:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427363840 00000100:00100000:2.0:1789635430.822056:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427363712 00000100:00100000:2.0:1789635430.822059:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427363712 00000100:00100000:2.0:1789635430.822071:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789635430.822077:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427363840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.822110:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427363840:12345-0@lo:400:kworker.0 Request processed in 33us (1408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635430.822117:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789635430.822128:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1789635430.822133:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427363712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.822160:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427363712:12345-0@lo:400:kworker.0 Request processed in 26us (1320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635430.822165:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1789635430.822402:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044881e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427363712:0@lo:400:kworker.0 00010000:00080000:2.0:1789635430.822423:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d055896b800 x1876568427364224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635430.822435:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d055896b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427364224:0@lo:400:kworker.0 00010000:00080000:2.0:1789635430.822448:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d055896ad80 x1876568427364736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635430.822458:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d055896ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1876568427364736:0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.822470:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044881e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427363840:0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.822481:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d055896b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427364352:0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.822491:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0558968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427364864:0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.822542:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427363584:0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.822555:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d055896bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427364096:0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.822568:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d055896aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427364608:0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.822578:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427363456:0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.822592:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0558968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427363968:0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.822630:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1789635430.822637:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:2.0:1789635430.822674:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d0446c3f100, transno 4294967308 00000004:00080000:2.0:1789635430.822691:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1789635430.822711:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d044881c000, transno 4294967311 00000100:00100000:2.0:1789635430.822717:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0558969f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427364480:0@lo:400:kworker.0 00000100:00100000:2.0:1789635430.822742:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d055896b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427364992:0@lo:400:kworker.0 00000100:00100000:0.0:1789635430.824818:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044765a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427365120:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789635430.824930:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789635430.824942:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789635430.824952:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789635430.824957:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789635430.824962:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635430.825020:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427365120 00000100:00100000:0.0:1789635430.825040:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427365120 00000100:00100000:0.0:1789635430.825109:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789635430.825119:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427365120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789635430.825146:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:0.0:1789635430.825195:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427365120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635430.825203:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789635430.825255:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044765a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427365120:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789635430.826470:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427365248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789635430.826530:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635430.826732:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427365248 00000100:00100000:3.0:1789635430.826741:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427365248 00000100:00100000:3.0:1789635430.826789:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789635430.826798:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e016d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1876568427365248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789635430.826831:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:3.0:1789635430.827393:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e016d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1876568427365248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 594us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635430.827403:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789635430.827481:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427365248:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1789635430.955238:0:14660:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789635430.955247:0:14660:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789635430.955285:0:14660:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 6 00000040:00080000:1.0:1789635430.955292:0:14660:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789635430.956444:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789635430.956451:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789635430.956551:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789635430.956559:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789635430.956709:0:13797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e9500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1876568427365376:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789635430.956983:0:13797:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05506470c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635430.974062:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635430.974177:0:13797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e9500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1876568427365376:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789635430.976507:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411581824 00000100:00100000:0.0:1789635430.976522:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411581824 00000100:00100000:0.0:1789635430.976905:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 249 00000100:00100000:0.0:1789635430.976916:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+27:12463:x1876568411581824:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789635430.976952:0:9526:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789635430.977073:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+27:12463:x1876568411581824:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 158us (3018us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635430.977081:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 249 00000100:00100000:3.0:1789635430.987065:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635430.991004:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411582080 00000100:00100000:3.0:1789635430.991019:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411582080 00000100:00100000:3.0:1789635430.991087:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 250 00000100:00100000:3.0:1789635430.991097:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+27:12463:x1876568411582080:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789635430.991117:0:10094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635430.991149:0:10094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa40ff74 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7436a expref: -99 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635430.991264:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffa00/0xb0c3a59caa40ff7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635430.991279:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffa00/0xb0c3a59caa40ff7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635430.991291:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffa00/0xb0c3a59caa40ff7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635430.991302:0:10094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789635430.991415:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa40ff74 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7436a expref: 30 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635430.991432:0:10094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffa00/0xb0c3a59caa40ff7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7436a expref: 29 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635430.991440:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d04466ca700) 00010000:00010000:3.0:1789635430.991443:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789635430.991446:0:10094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05488ffa00, rc 0) 00000100:00100000:3.0:1789635430.991521:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+29:12463:x1876568411582080:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 425us (4463us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1789635430.991528:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 250 00000100:00100000:3.0:1789635430.999653:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635430.999695:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635430.999758:0:13189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411582464 00000100:00100000:2.0:1789635430.999769:0:13189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411582464 00000100:00100000:2.0:1789635430.999835:0:13189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:2.0:1789635430.999845:0:13189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b402850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+29:2397:x1876568411582464:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635430.999860:0:13189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635430.999884:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffa00/0xb0c3a59caa40ff7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7436a expref: 29 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635430.999911:0:13189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d04466ca700) 00010000:00010000:2.0:1789635430.999917:0:13189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635430.999920:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411582336 00000100:00100000:0.0:1789635430.999926:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411582336 00000100:00100000:0.0:1789635430.999964:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 251 00000100:00100000:2.0:1789635430.999971:0:13189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b402850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+29:2397:x1876568411582464:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 125us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635430.999978:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+29:12463:x1876568411582336:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789635430.999986:0:13189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 19 00010000:00010000:0.0:1789635431.000048:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40ff89 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635431.000063:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40ff89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635431.000074:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40ff89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635431.000231:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40ff89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635431.000250:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40ff89 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635431.000257:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40ff89 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635431.000263:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1a400 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635431.000268:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40ff89 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635431.000275:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40ff89 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635431.000285:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d04466ca700) 00010000:00010000:0.0:1789635431.000288:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789635431.000292:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40ff89 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635431.000298:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1a400/0xb0c3a59caa40ff89 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635431.000412:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+29:12463:x1876568411582336:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 437us (815us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1789635431.000420:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 251 00000040:00080000:2.0:1789635431.000539:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789635431.000544:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789635431.001072:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789635431.001081:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789635431.006286:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635431.006576:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411582720 00000100:00100000:2.0:1789635431.006592:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411582720 00000100:00100000:2.0:1789635431.006683:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 64 00000100:00100000:2.0:1789635431.006694:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+29:12463:x1876568411582720:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789635431.006910:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+30:12463:x1876568411582720:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 217us (633us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1789635431.006918:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 64 00000100:00080000:3.0:1789635431.008038:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789635431.588073:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635431.843996:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044765b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427365504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789635431.844068:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635431.844294:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427365504 00000100:00100000:3.0:1789635431.844329:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427365504 00000100:00100000:3.0:1789635431.844442:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789635431.844453:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427365504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789635431.844480:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635431.844541:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427365504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635431.844548:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789635431.844638:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044765b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427365504:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789635431.844782:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789635432.359701:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789635432.359724:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427365632:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789635432.359792:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635432.360724:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427365632 00000100:00100000:3.0:1789635432.360735:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427365632 00000100:00100000:3.0:1789635432.360814:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789635432.360937:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427365632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789635432.360967:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635432.361095:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427365632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 273us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635432.361103:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789635432.361153:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427365632:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789635432.361226:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789635432.618996:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789635432.821694:0:14711:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789635432.821702:0:14711:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789635432.821733:0:14711:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789635432.821739:0:14711:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789635432.981872:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635432.982515:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411582976 00000100:00100000:2.0:1789635432.982528:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411582976 00000100:00100000:2.0:1789635432.982589:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 252 00000100:00100000:2.0:1789635432.982623:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+30:12484:x1876568411582976:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1789635432.982649:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635432.982669:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40ff90 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74371 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635432.982777:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40ff97 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635432.982792:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40ff97 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635432.982803:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40ff97 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635432.982829:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789635432.982926:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40ff90 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74371 expref: 33 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635432.982941:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40ff97 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74371 expref: 32 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635432.982949:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d04466ca700) 00010000:00010000:2.0:1789635432.982952:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789635432.982955:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a3a00, rc 0) 00000100:00100000:2.0:1789635432.983012:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+32:12484:x1876568411582976:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 392us (1150us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1789635432.983019:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 252 00000100:00100000:1.0:1789635432.987968:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635432.988010:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411583104 00000100:00100000:1.0:1789635432.988021:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411583104 00000100:00100000:1.0:1789635432.988071:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 253 00000100:00100000:1.0:1789635432.988081:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+32:12484:x1876568411583104:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:1.0:1789635432.988147:0:10094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40ffa5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635432.988164:0:10094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40ffa5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635432.988176:0:10094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40ffa5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635432.988222:0:10094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40ffa5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635432.988230:0:10094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40ffa5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635432.988236:0:10094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40ffa5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635432.988242:0:10094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152a00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635432.988246:0:10094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40ffa5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635432.988253:0:10094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40ffa5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635432.988265:0:10094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d04466ca700) 00010000:00010000:1.0:1789635432.988268:0:10094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789635432.988273:0:10094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40ffa5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635432.988279:0:10094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa40ffa5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635432.989650:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+32:12484:x1876568411583104:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 1561us (1682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635432.989663:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 253 00000100:00100000:2.0:1789635433.096125:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635433.096245:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411583232 00000100:00100000:3.0:1789635433.096255:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411583232 00000100:00100000:3.0:1789635433.096330:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 79 00000100:00100000:3.0:1789635433.096340:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:2396:x1876568411583232:12345-192.168.203.20@tcp:101:cat.0 00010000:00010000:3.0:1789635433.096358:0:10116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635433.096389:0:10116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec6d8b51/0xb0c3a59caa40ffac lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74378 expref: -99 pid: 10116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789635433.096413:0:10116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6aabab65, atime: 0x6aabab65, ctime: 0x6aabab65, blocks: 0x8 00010000:00010000:3.0:1789635433.096432:0:10116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=451s v=(0 0) 00010000:00010000:3.0:1789635433.096457:0:10116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635433.096467:0:10116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec6d8b51/0xb0c3a59caa40ffac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74378 expref: 8 pid: 10116 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635433.096485:0:10116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ec6d8b51/0xb0c3a59caa40ffac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74378 expref: 8 pid: 10116 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635433.096498:0:10116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05488ff000, rc 0) 00000100:00100000:3.0:1789635433.096555:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:2396:x1876568411583232:12345-192.168.203.20@tcp:101:cat.0 Request processed in 217us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635433.096562:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 79 00000100:00080000:2.0:1789635433.097177:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789635433.104716:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635433.105262:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411583360 00000100:00100000:3.0:1789635433.105277:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411583360 00002000:00100000:3.0:1789635433.105345:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8d0550bfaa00 x1876568411583360/t0(0) o3->6e1c17f2-a595-4ed0-97c8-b9260d0850ab@192.168.203.20@tcp:54/0 lens 488/0 e 0 to 0 dl 1789635444 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789635433.105359:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0550bfaa00 with x1876568411583360 ext(0->4095) 00002000:00010000:3.0:1789635433.105379:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d0550bfaa00 00000100:00100000:3.0:1789635433.105414:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:3.0:1789635433.105426:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:2397:x1876568411583360:12345-192.168.203.20@tcp:3:cat.0 00000100:00100000:3.0:1789635433.106221:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:2397:x1876568411583360:12345-192.168.203.20@tcp:3:cat.0 Request processed in 791us (1512us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789635433.106232:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00002000:00100000:3.0:1789635433.106242:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8d0550bfaa00 x1876568411583360/t0(0) o3->6e1c17f2-a595-4ed0-97c8-b9260d0850ab@192.168.203.20@tcp:54/0 lens 488/4536 e 0 to 0 dl 1789635444 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789635433.106253:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0550bfaa00 with x1876568411583360 ext(0->4095) 00002000:00010000:3.0:1789635433.106265:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d0550bfaa00 00010000:00010000:1.0:1789635433.635859:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635433.892032:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427365760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789635433.892102:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635433.892590:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427365760 00000100:00100000:1.0:1789635433.892630:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427365760 00000100:00100000:1.0:1789635433.892675:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789635433.892684:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427365760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789635433.892718:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789635433.892896:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427365760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 212us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635433.892903:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789635433.892949:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427365760:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789635433.893069:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789635433.893080:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e015500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427365888:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789635433.893114:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635433.893146:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427365888 00000100:00100000:0.0:1789635433.893151:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427365888 00000100:00100000:0.0:1789635433.893176:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789635433.893183:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e016300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427365888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789635433.893207:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789635433.893243:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e016300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427365888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635433.893249:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789635433.893277:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e015500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427365888:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789635433.917581:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635433.917646:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411583488 00000100:00100000:3.0:1789635433.917657:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411583488 00000100:00100000:1.0:1789635433.917668:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635433.917748:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411583616 00000100:00100000:0.0:1789635433.917762:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411583616 00000100:00100000:3.0:1789635433.917817:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 402 00000100:00100000:0.0:1789635433.917822:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 376 00000100:00100000:3.0:1789635433.917832:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2399:x1876568411583488:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635433.917839:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+32:2399:x1876568411583616:12345-192.168.203.20@tcp:400:kworker.0 00000100:00080000:1.0:1789635433.917908:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635433.917980:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+32:2399:x1876568411583616:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 148us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635433.917987:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 376 00000100:00100000:3.0:1789635433.920727:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2399:x1876568411583488:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 2888us (3144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635433.920741:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 402 00000100:00100000:3.0:1789635433.923101:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635433.925697:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411583744 00000100:00100000:2.0:1789635433.925712:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411583744 00000100:00100000:2.0:1789635433.925800:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 377 00000100:00100000:2.0:1789635433.925813:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411583744:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635433.925892:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2399:x1876568411583744:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 83us (2800us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635433.925910:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 377 00000100:00080000:1.0:1789635433.926632:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789635433.927207:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635433.927246:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635433.927439:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411584000 00000100:00100000:2.0:1789635433.927446:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411584000 00000100:00100000:2.0:1789635433.927638:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 144 00000100:00100000:2.0:1789635433.927648:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447659880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:2399:x1876568411584000:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635433.927723:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447659880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+8:2399:x1876568411584000:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 77us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635433.927732:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 144 00000100:00100000:3.0:1789635433.928152:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635433.928202:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635433.928204:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411583872 00000100:00100000:2.0:1789635433.928211:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411583872 00000100:00100000:2.0:1789635433.928256:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 145 00000100:00100000:2.0:1789635433.928263:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411583872:12345-192.168.203.20@tcp:400:kworker.0 00000100:00080000:0.0:1789635433.928374:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789635433.928423:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2398:x1876568411583872:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 159us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635433.928430:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 145 00000100:00100000:1.0:1789635433.932550:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411584256 00000100:00100000:1.0:1789635433.932567:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411584256 00000100:00100000:0.0:1789635433.932621:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411584128 00000100:00100000:0.0:1789635433.932627:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411584128 00000100:00080000:2.0:1789635433.932677:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789635433.932684:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635433.932703:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 378 00000100:00100000:0.0:1789635433.932774:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411584128:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635433.932847:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2398:x1876568411584128:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 78us (4647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635433.933126:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 379 00000100:00100000:2.0:1789635433.933137:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044765bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2399:x1876568411584256:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635433.933166:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044765bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2399:x1876568411584256:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 33us (5920us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635433.933174:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 379 00000100:00100000:0.0:1789635433.935548:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 378 00010000:00010000:1.0:1789635434.663822:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789635435.430220:0:6493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:3.0:1789635435.430274:0:6493:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d0550647300 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1789635435.430280:0:6493:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d0548e6b100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d0550647180 00000020:00080000:3.0:1789635435.430284:0:6493:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d0548e6bf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d056f403200 00000020:00080000:3.0:1789635435.430319:0:6493:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1789635435.430326:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 5 00000020:00080000:0.0:1789635435.430413:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1789635435.430941:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40ff27 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635435.430955:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40ff27 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635435.430963:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40ff27 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635435.430970:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488fe400 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635435.430986:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40ff27 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635435.430994:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40ff27 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635435.431013:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d04466ca000) 00010000:00010000:2.0:1789635435.431015:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635435.431020:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40ff27 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635435.431027:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fe400/0xb0c3a59caa40ff27 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789635435.444244:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:0.0:1789635435.444266:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00010000:00010000:1.0:1789635435.684398:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635435.939910:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427366016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635435.939979:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635435.940139:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427366016 00000100:00100000:3.0:1789635435.940148:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427366016 00000100:00100000:3.0:1789635435.940201:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789635435.940212:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427366016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789635435.940243:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789635435.940294:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427366016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635435.940308:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789635435.940360:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427366144:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789635435.940388:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789635435.940422:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789635435.940431:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427366144 00000100:00100000:3.0:1789635435.940435:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427366144 00000100:00100000:3.0:1789635435.940459:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789635435.940465:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447659180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427366144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789635435.940475:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789635435.940504:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447659180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427366144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635435.940510:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:3.0:1789635435.940526:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789635435.940553:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427366144:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789635435.940575:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1789635435.940580:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d0550bfa300, transno 4294967323 00000004:00080000:3.0:1789635435.940589:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:3.0:1789635435.941219:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427366016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635435.941806:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876568427366400:0@lo:400:kworker.0 00000100:00100000:1.0:1789635435.941854:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635435.941885:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1876568427366912:0@lo:400:kworker.0 00000100:00100000:3.0:1789635435.941904:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427366656:0@lo:400:kworker.0 00000100:00100000:1.0:1789635435.941912:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635435.941937:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1876568427367424:0@lo:400:kworker.0 00000100:00100000:3.0:1789635435.941947:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635435.941968:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635435.941984:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427367168:0@lo:400:kworker.0 00000100:00100000:1.0:1789635435.941996:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789635435.942005:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427366528:0@lo:400:kworker.0 00000100:00100000:3.0:1789635435.942014:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635435.942041:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789635435.942049:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427366272:0@lo:400:kworker.0 00000100:00100000:1.0:1789635435.942050:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635435.942078:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427367040:0@lo:400:kworker.0 00000100:00100000:3.0:1789635435.942086:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635435.942105:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635435.942130:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427366784:0@lo:400:kworker.0 00000100:00100000:1.0:1789635435.942133:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1876568427367552:0@lo:400:kworker.0 00000100:00100000:3.0:1789635435.942166:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635435.942189:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427367296:0@lo:400:kworker.0 00000100:00100000:3.0:1789635435.942212:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635435.942244:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427366656 00000100:00100000:3.0:1789635435.942249:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427366656 00000100:00100000:3.0:1789635435.942282:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427366528 00000100:00100000:3.0:1789635435.942285:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427366528 00000100:00100000:3.0:1789635435.942302:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789635435.942385:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427366656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635435.942434:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427366656:12345-0@lo:400:kworker.0 Request processed in 126us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635435.942441:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789635435.942457:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789635435.942464:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427366528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635435.942489:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427366528:12345-0@lo:400:kworker.0 Request processed in 28us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635435.942494:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789635435.942512:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427367168 00000100:00100000:3.0:1789635435.942516:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427367168 00000100:00100000:3.0:1789635435.942545:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427367296 00000100:00100000:3.0:1789635435.942549:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427367296 00000100:00100000:3.0:1789635435.942569:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789635435.942576:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427367168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635435.942814:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427367168:12345-0@lo:400:kworker.0 Request processed in 239us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635435.942820:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789635435.942839:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789635435.942845:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427367296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635435.942875:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427367296:12345-0@lo:400:kworker.0 Request processed in 30us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635435.942880:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789635435.942952:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427366400 00000100:00100000:1.0:1789635435.942957:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427366400 00000100:00100000:1.0:1789635435.943022:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427366912 00000100:00100000:1.0:1789635435.943026:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427366912 00000100:00100000:1.0:1789635435.943042:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427367424 00000100:00100000:1.0:1789635435.943044:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427367424 00000100:00100000:1.0:1789635435.943055:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427367040 00000100:00100000:1.0:1789635435.943058:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427367040 00000100:00100000:1.0:1789635435.943068:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427366784 00000100:00100000:1.0:1789635435.943070:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427366784 00000100:00100000:1.0:1789635435.943082:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1789635435.943088:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876568427366400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635435.943128:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876568427366400:12345-0@lo:400:kworker.0 Request processed in 40us (1274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635435.943135:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1789635435.943148:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1789635435.943154:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876568427366912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635435.943180:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876568427366912:12345-0@lo:400:kworker.0 Request processed in 26us (1270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635435.943185:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1789635435.943197:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1789635435.943202:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876568427367424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635435.943226:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876568427367424:12345-0@lo:400:kworker.0 Request processed in 24us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635435.943238:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1789635435.943249:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1789635435.943254:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427367040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635435.943294:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427367040:12345-0@lo:400:kworker.0 Request processed in 40us (1190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635435.943299:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1789635435.944415:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1789635435.944427:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427366784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635435.944479:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427366784:12345-0@lo:400:kworker.0 Request processed in 55us (2314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635435.944485:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1789635435.944866:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635435.944910:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876568427366400:0@lo:400:kworker.0 00000100:00100000:1.0:1789635435.944921:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1876568427366912:0@lo:400:kworker.0 00000100:00100000:1.0:1789635435.944930:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1876568427367424:0@lo:400:kworker.0 00000100:00100000:1.0:1789635435.944950:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427366528:0@lo:400:kworker.0 00010000:00080000:1.0:1789635435.944961:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d044859d880 x1876568427367040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635435.944970:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427367040:0@lo:400:kworker.0 00000100:00100000:1.0:1789635435.944986:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427367552 00000100:00100000:1.0:1789635435.944991:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427367552 00000100:00100000:1.0:1789635435.945021:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1789635435.945028:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876568427367552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635435.945075:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876568427367552:12345-0@lo:400:kworker.0 Request processed in 47us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635435.945081:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00010000:00080000:1.0:1789635435.945110:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d044859ce00 x1876568427367552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635435.945119:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1876568427367552:0@lo:400:kworker.0 00000100:00100000:3.0:1789635435.945241:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427366784:0@lo:400:kworker.0 00000100:00100000:3.0:1789635435.945253:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427367296:0@lo:400:kworker.0 00000100:00100000:3.0:1789635435.945274:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427366656:0@lo:400:kworker.0 00000100:00100000:3.0:1789635435.945284:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427367168:0@lo:400:kworker.0 00000100:00080000:3.0:1789635435.945317:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789635435.945321:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789635435.945324:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789635435.946852:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427366272 00000100:00100000:3.0:1789635435.946862:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427366272 00000100:00100000:3.0:1789635435.946917:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1789635435.946927:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3640:x1876568427366272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635435.947000:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3640:x1876568427366272:12345-0@lo:400:kworker.0 Request processed in 75us (4914us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635435.947007:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1789635435.947053:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427366272:0@lo:400:kworker.0 00010000:00010000:1.0:1789635436.707722:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635436.963981:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427367680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635436.964046:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635436.964104:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427367680 00000100:00100000:3.0:1789635436.964112:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427367680 00000100:00100000:3.0:1789635436.964162:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789635436.964179:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448599500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427367680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789635436.964208:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635436.964262:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448599500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427367680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635436.964268:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789635436.964382:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427367680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635437.478146:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427367808:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789635437.478214:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635437.478263:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427367808 00000100:00100000:3.0:1789635437.478271:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427367808 00000100:00100000:3.0:1789635437.478321:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789635437.478342:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427367808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789635437.478362:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635437.478401:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427367808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635437.478407:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:3.0:1789635437.478428:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789635437.478461:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427367808:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789635437.635655:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635437.637865:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411584384 00000100:00100000:1.0:1789635437.637880:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411584384 00000100:00100000:1.0:1789635437.638039:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 254 00000100:00100000:1.0:1789635437.638053:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+18:12137:x1876568411584384:12345-192.168.203.20@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789635437.638171:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+18:12137:x1876568411584384:12345-192.168.203.20@tcp:60:lhsmtool_posix.0 Request processed in 122us (2526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635437.638179:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 254 00000100:00080000:3.0:1789635437.642041:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635437.648953:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635437.651323:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411584512 00000100:00100000:0.0:1789635437.651350:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411584512 00000100:00100000:0.0:1789635437.651433:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 255 00000100:00100000:0.0:1789635437.651448:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:12137:x1876568411584512:12345-192.168.203.20@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789635437.651557:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:12137:x1876568411584512:12345-192.168.203.20@tcp:60:lhsmtool_posix.0 Request processed in 115us (2613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635437.651566:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 255 00000100:00080000:3.0:1789635437.652342:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789635437.662014:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635437.662224:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411584768 00000100:00100000:2.0:1789635437.662234:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411584768 00000100:00100000:2.0:1789635437.662304:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 65 00000100:00100000:2.0:1789635437.662320:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e015500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+18:12137:x1876568411584768:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789635437.662589:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e015500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+19:12137:x1876568411584768:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 270us (590us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1789635437.662630:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 65 00010000:00010000:1.0:1789635437.731880:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635438.755958:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635439.013724:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789635439.013754:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427367936:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789635439.013850:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635439.013941:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427367936 00000100:00100000:2.0:1789635439.013952:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427367936 00000100:00100000:2.0:1789635439.014012:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789635439.014022:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427367936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789635439.014102:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789635439.014160:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427367936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 137us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635439.014168:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789635439.017116:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427367936:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789635439.017158:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427368064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789635439.017231:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635439.018161:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427368064 00000100:00100000:2.0:1789635439.018174:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427368064 00000100:00100000:2.0:1789635439.018250:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789635439.018262:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427368064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789635439.018330:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1789635439.018418:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427368064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 157us (1186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635439.018426:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789635439.018582:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427368064:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789635439.038622:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635439.038673:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635439.038703:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635439.038726:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635439.038748:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635439.038769:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635439.038797:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635439.038832:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411585152 00000100:00100000:2.0:1789635439.038844:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411585152 00000100:00100000:3.0:1789635439.039076:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411584896 00000100:00100000:3.0:1789635439.039081:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411584896 00000100:00100000:3.0:1789635439.039131:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 404 00000100:00100000:3.0:1789635439.039144:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b817c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2396:x1876568411584896:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635439.039234:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b817c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2396:x1876568411584896:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 93us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635439.039243:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 404 00000100:00100000:2.0:1789635439.039689:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411585664 00000100:00100000:2.0:1789635439.039695:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411585664 00000100:00100000:2.0:1789635439.039714:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411585024 00000100:00100000:2.0:1789635439.039716:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411585024 00000100:00100000:2.0:1789635439.039732:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411585536 00000100:00100000:2.0:1789635439.039735:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411585536 00000100:00100000:2.0:1789635439.039751:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 386 00000100:00100000:2.0:1789635439.039759:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2396:x1876568411585152:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635439.039815:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2396:x1876568411585152:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 56us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635439.039822:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 386 00000100:00100000:2.0:1789635439.039842:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 387 00000100:00100000:2.0:1789635439.039849:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2396:x1876568411585664:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635439.039873:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2396:x1876568411585664:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 25us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635439.039879:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 387 00000100:00100000:2.0:1789635439.041675:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 388 00000100:00100000:2.0:1789635439.041700:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+19:2396:x1876568411585024:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635439.041788:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+19:2396:x1876568411585024:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 99us (3039us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635439.041796:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 388 00000100:00100000:2.0:1789635439.041826:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 389 00000100:00100000:2.0:1789635439.041832:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2396:x1876568411585536:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635439.041857:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2396:x1876568411585536:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 25us (3060us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635439.041863:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 389 00000100:00100000:2.0:1789635439.041910:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411585408 00000100:00100000:2.0:1789635439.041919:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411585408 00000100:00100000:2.0:1789635439.041961:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411585280 00000100:00100000:2.0:1789635439.041965:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411585280 00000100:00100000:2.0:1789635439.041986:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 148 00000100:00100000:2.0:1789635439.041992:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:2396:x1876568411585408:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635439.042029:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:2396:x1876568411585408:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 38us (3327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635439.042036:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 148 00000100:00100000:2.0:1789635439.042048:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 149 00000100:00100000:2.0:1789635439.042053:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2396:x1876568411585280:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635439.042071:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2396:x1876568411585280:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 18us (3301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635439.042077:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 149 00000100:00080000:2.0:1789635439.042109:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789635439.042113:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789635439.042116:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789635439.042119:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:3.0:1789635439.480105:0:14908:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 04:57:18 (1789635438) 00010000:00010000:3.0:1789635439.781877:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789635440.227982:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789635440.228003:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789635440.228152:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:1.0:1789635440.228163:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789635440.806353:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789635440.869776:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789635441.059995:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427368192:0@lo:400:kworker.0 00000100:00100000:1.0:1789635441.060092:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635441.060148:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427368704:0@lo:400:kworker.0 00000100:00100000:1.0:1789635441.060178:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635441.060197:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543295500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427369216:0@lo:400:kworker.0 00000100:00100000:1.0:1789635441.060222:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635441.060250:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427369728:0@lo:400:kworker.0 00000100:00100000:1.0:1789635441.060272:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635441.060312:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789635441.060320:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427368320:0@lo:400:kworker.0 00000100:00100000:1.0:1789635441.060343:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635441.060362:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427368832:0@lo:400:kworker.0 00000100:00100000:1.0:1789635441.060383:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635441.060390:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427369216 00000100:00100000:1.0:1789635441.060399:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427369344:0@lo:400:kworker.0 00000100:00100000:0.0:1789635441.060404:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427369216 00000100:00100000:1.0:1789635441.060417:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635441.060449:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427368448:0@lo:400:kworker.0 00000100:00100000:0.0:1789635441.060467:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427369728 00000100:00100000:0.0:1789635441.060470:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427369728 00000100:00100000:1.0:1789635441.060473:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635441.060491:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427368960:0@lo:400:kworker.0 00000100:00100000:0.0:1789635441.060496:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789635441.060506:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427369216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635441.060511:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635441.060525:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1876568427369472:0@lo:400:kworker.0 00000100:00100000:1.0:1789635441.060544:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635441.060565:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789635441.060570:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427369216:12345-0@lo:400:kworker.0 Request processed in 66us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635441.060571:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427368576:0@lo:400:kworker.0 00000100:00100000:0.0:1789635441.060577:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789635441.060593:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635441.060625:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789635441.060632:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427369088:0@lo:400:kworker.0 00000100:00100000:0.0:1789635441.060632:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427369728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635441.060655:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635441.060658:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427369728:12345-0@lo:400:kworker.0 Request processed in 28us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635441.060665:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427369600:0@lo:400:kworker.0 00000100:00100000:0.0:1789635441.060671:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789635441.060681:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427369088 00000100:00100000:1.0:1789635441.060682:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635441.060684:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427369088 00000100:00100000:0.0:1789635441.060700:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427369600 00000100:00100000:0.0:1789635441.060702:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427369600 00000100:00100000:1.0:1789635441.060708:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427368192 00000100:00100000:1.0:1789635441.060711:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427368192 00000100:00100000:0.0:1789635441.060716:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789635441.060745:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1789635441.060752:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3640:x1876568427368192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635441.060784:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3640:x1876568427368192:12345-0@lo:400:kworker.0 Request processed in 32us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635441.060790:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1789635441.060820:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427368704 00000100:00100000:0.0:1789635441.060956:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427369088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635441.060995:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427369088:12345-0@lo:400:kworker.0 Request processed in 43us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635441.061001:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789635441.061013:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789635441.061019:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427369600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635441.061046:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427369600:12345-0@lo:400:kworker.0 Request processed in 27us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635441.061051:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:0.0:1789635441.061066:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789635441.061071:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789635441.061369:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427369856:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789635441.061404:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635441.061453:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427369856 00000100:00100000:0.0:1789635441.061458:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427369856 00000100:00100000:0.0:1789635441.061493:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789635441.061502:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e017100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427369856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789635441.061530:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789635441.061569:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e017100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427369856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635441.061586:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789635441.062008:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427369856:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789635441.062296:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427368704 00000100:00100000:1.0:1789635441.062355:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427368320 00000100:00100000:1.0:1789635441.062361:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427368320 00000100:00100000:1.0:1789635441.062374:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427368832 00000100:00100000:1.0:1789635441.062377:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427368832 00000100:00100000:1.0:1789635441.062406:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427369344 00000100:00100000:1.0:1789635441.062409:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427369344 00000100:00100000:1.0:1789635441.062424:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427368960 00000100:00100000:1.0:1789635441.062427:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427368960 00000100:00100000:1.0:1789635441.062668:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427369472 00000100:00100000:1.0:1789635441.062673:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427369472 00000100:00100000:1.0:1789635441.062691:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1789635441.062698:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427368704:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789635441.062836:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789635441.062840:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635441.062929:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427368704:12345-0@lo:400:kworker.0 Request processed in 231us (2749us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635441.062944:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1789635441.062963:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1789635441.062969:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427368320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635441.062999:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427368320:12345-0@lo:400:kworker.0 Request processed in 30us (2655us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635441.063004:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1789635441.063014:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1789635441.063021:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427368832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635441.063047:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427368832:12345-0@lo:400:kworker.0 Request processed in 27us (2664us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635441.063054:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1789635441.063064:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1789635441.063069:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427369344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635441.063095:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427369344:12345-0@lo:400:kworker.0 Request processed in 26us (2676us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635441.063100:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1789635441.063111:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1789635441.063116:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427368960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635441.063140:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427368960:12345-0@lo:400:kworker.0 Request processed in 24us (2629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635441.063146:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1789635441.063155:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1789635441.063161:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876568427369472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635441.063186:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876568427369472:12345-0@lo:400:kworker.0 Request processed in 26us (2641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635441.063198:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1789635441.063324:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427368448 00000100:00100000:1.0:1789635441.063330:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427368448 00000100:00100000:1.0:1789635441.063368:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427368576 00000100:00100000:1.0:1789635441.063372:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427368576 00000100:00100000:1.0:1789635441.063386:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789635441.063393:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427368448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635441.063428:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427368448:12345-0@lo:400:kworker.0 Request processed in 36us (2954us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635441.063446:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789635441.063458:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789635441.063464:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427368576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635441.063494:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427368576:12345-0@lo:400:kworker.0 Request processed in 30us (2900us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635441.063499:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789635441.063621:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427369984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635441.063661:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635441.063713:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427368576:0@lo:400:kworker.0 00000100:00100000:1.0:1789635441.063910:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427369088:0@lo:400:kworker.0 00000100:00100000:3.0:1789635441.063917:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427369984 00000100:00100000:3.0:1789635441.063921:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427369984 00000100:00100000:1.0:1789635441.063923:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427369600:0@lo:400:kworker.0 00000100:00100000:1.0:1789635441.063933:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427368448:0@lo:400:kworker.0 00010000:00080000:1.0:1789635441.063948:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0543296300 x1876568427368960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635441.063958:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427368960:0@lo:400:kworker.0 00000100:00100000:3.0:1789635441.063960:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789635441.063967:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427369984:12345-0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789635441.063979:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d044859ea00 x1876568427369472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00000024:3.0:1789635441.063985:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789635441.063987:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1876568427369472:0@lo:400:kworker.0 00000100:00100000:3.0:1789635441.064020:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427369984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635441.064026:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789635441.064033:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427369984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635441.064059:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427368320:0@lo:400:kworker.0 00000100:00100000:1.0:1789635441.064077:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427368832:0@lo:400:kworker.0 00000100:00100000:1.0:1789635441.064089:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427369344:0@lo:400:kworker.0 00000100:00100000:1.0:1789635441.064101:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427368192:0@lo:400:kworker.0 00000100:00100000:1.0:1789635441.064111:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427368704:0@lo:400:kworker.0 00000100:00100000:1.0:1789635441.064123:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543295500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427369216:0@lo:400:kworker.0 00000100:00100000:1.0:1789635441.064133:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427369728:0@lo:400:kworker.0 00000001:00080000:1.0:1789635441.067459:0:6493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:1.0:1789635441.067479:0:6493:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1789635441.067643:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1789635441.067666:0:6546:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1789635441.828003:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635441.831832:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635441.831920:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411585792 00000100:00100000:2.0:1789635441.831933:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411585792 00000100:00100000:2.0:1789635441.832797:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 256 00000100:00100000:2.0:1789635441.832812:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:407040af-7178-437e-ab3a-40e7ebc2aa86+5:13156:x1876568411585792:12345-192.168.203.20@tcp:101:lsof.0 00010000:00010000:2.0:1789635441.832855:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635441.832887:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40ffb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7437f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635441.832979:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40ffba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635441.832997:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40ffba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635441.833012:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40ffba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635441.833100:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789635441.833105:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789635441.833158:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40ffba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635441.833192:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa40ffb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7437f expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635441.833218:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40ffba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7437f expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635441.833229:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0544e2ed00) 00010000:00010000:2.0:1789635441.833233:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789635441.833238:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a2600, rc 0) 00000100:00100000:2.0:1789635441.833340:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:407040af-7178-437e-ab3a-40e7ebc2aa86+6:13156:x1876568411585792:12345-192.168.203.20@tcp:101:lsof.0 Request processed in 530us (1534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635441.833348:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 256 00000100:00080000:0.0:1789635441.834628:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635442.090320:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427370112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635442.090429:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635442.090554:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427370112 00000100:00100000:3.0:1789635442.090565:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427370112 00000100:00100000:3.0:1789635442.090659:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789635442.090670:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e014380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427370112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789635442.090709:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635442.090891:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e014380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427370112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 222us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635442.090899:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789635442.091481:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427370112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635442.598144:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789635442.605150:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427370240:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789635442.605337:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635442.605536:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427370240 00000100:00100000:3.0:1789635442.605549:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427370240 00000100:00100000:3.0:1789635442.610203:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789635442.610248:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427370240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789635442.610297:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635442.610866:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427370240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 646us (5525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635442.610876:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789635442.611032:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427370240:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789635442.853364:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635443.371467:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635443.371641:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411586048 00000100:00100000:2.0:1789635443.371652:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411586048 00000100:00100000:2.0:1789635443.371721:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 66 00000100:00100000:2.0:1789635443.371731:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e017b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+18:13157:x1876568411586048:12345-192.168.203.20@tcp:35:umount.0 00000100:00100000:2.0:1789635443.371981:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e017b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+19:13157:x1876568411586048:12345-192.168.203.20@tcp:35:umount.0 Request processed in 250us (523us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1789635443.371989:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 66 00000100:00080000:0.0:1789635443.372051:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635443.379149:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635443.379318:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411586304 00000100:00100000:2.0:1789635443.379328:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411586304 00000100:00100000:2.0:1789635443.379417:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 67 00000100:00100000:2.0:1789635443.379429:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+19:13157:x1876568411586304:12345-192.168.203.20@tcp:35:umount.0 00000100:00100000:2.0:1789635443.379756:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+20:13157:x1876568411586304:12345-192.168.203.20@tcp:35:umount.0 Request processed in 329us (615us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1789635443.379765:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 67 00000100:00100000:1.0:1789635443.386868:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635443.388824:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411586560 00000100:00100000:2.0:1789635443.388839:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411586560 00000100:00100000:2.0:1789635443.388963:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 68 00000100:00100000:2.0:1789635443.388975:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b744c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+20:13157:x1876568411586560:12345-192.168.203.20@tcp:35:umount.0 00000100:00100000:2.0:1789635443.389218:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b744c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+21:13157:x1876568411586560:12345-192.168.203.20@tcp:35:umount.0 Request processed in 243us (2358us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1789635443.389225:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 68 00000100:00100000:0.0:1789635443.404353:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635443.407830:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411586816 00000100:00100000:3.0:1789635443.407845:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411586816 00000100:00100000:3.0:1789635443.407913:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 69 00000100:00100000:3.0:1789635443.407923:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e015f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+21:13157:x1876568411586816:12345-192.168.203.20@tcp:35:umount.0 00000100:00100000:3.0:1789635443.408236:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e015f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+22:13157:x1876568411586816:12345-192.168.203.20@tcp:35:umount.0 Request processed in 313us (3890us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1789635443.408243:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 69 00000100:00100000:0.0:1789635443.418485:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635443.418528:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635443.418726:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411586944 00000100:00100000:1.0:1789635443.418736:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411586944 00000100:00100000:1.0:1789635443.418801:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411587072 00000100:00100000:1.0:1789635443.418805:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411587072 00000100:00100000:1.0:1789635443.418836:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:1.0:1789635443.418846:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e015500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd20b267-9db1-4540-8a6a-0af57c4f3581+14:2398:x1876568411586944:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635443.418875:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635443.418893:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056f6e9400/0xb0c3a59caa40ef9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ed9 expref: 14 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635443.418911:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635443.418963:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e015500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd20b267-9db1-4540-8a6a-0af57c4f3581+13:2398:x1876568411586944:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 118us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635443.418971:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:1.0:1789635443.418988:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:1.0:1789635443.418995:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e017b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd20b267-9db1-4540-8a6a-0af57c4f3581+12:2398:x1876568411587072:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635443.419003:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635443.419012:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d058214b800/0xb0c3a59caa40eee2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73e9a expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635443.419023:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635443.419042:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e017b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd20b267-9db1-4540-8a6a-0af57c4f3581+11:2398:x1876568411587072:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 47us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635443.419049:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:1.0:1789635443.421373:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635443.421506:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411587584 00000100:00100000:0.0:1789635443.421516:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411587584 00000100:00100000:0.0:1789635443.421591:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 80 00000100:00080000:2.0:1789635443.421804:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789635443.421872:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+7:2395:x1876568411587584:12345-192.168.203.20@tcp:9:umount.0 00000020:00000080:0.0:1789635443.421905:0:8430:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40f533 00000020:00010000:0.0:1789635443.421913:0:8430:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d0447982000: total 0 00000100:00080000:0.0:1789635443.421918:0:8430:0:(import.c:65:import_set_state_nolock()) ffff8d0447983800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789635443.421973:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000020:00010000:2.0:1789635443.422312:0:6503:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d0447982000: total 0 00010000:00010000:2.0:1789635443.422355:0:6503:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d0447982000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1789635443.422419:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8876d51/0xb0c3a59caa40f8eb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7419c expref: 5 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635443.422455:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec6d8b51/0xb0c3a59caa40ffac lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74378 expref: 4 pid: 10116 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635443.422469:0:6503:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d0447982000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1789635443.422482:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635443.422484:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635443.422486:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635443.422523:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+2:2395:x1876568411587584:12345-192.168.203.20@tcp:9:umount.0 Request processed in 657us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635443.422532:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 80 00000100:00100000:3.0:1789635443.434945:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635443.441926:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411587200 00000100:00100000:2.0:1789635443.441961:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411587200 00000100:00100000:2.0:1789635443.442040:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:2.0:1789635443.442050:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd20b267-9db1-4540-8a6a-0af57c4f3581+11:2399:x1876568411587200:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635443.442066:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635443.442088:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056e1a2c00/0xb0c3a59caa40f1f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fb2 expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635443.442104:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635443.442172:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:2399:x1876568411587200:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 123us (7236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635443.442180:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:1.0:1789635443.450423:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635443.451661:0:10116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411587712 00000100:00100000:0.0:1789635443.451673:0:10116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411587712 00000100:00100000:0.0:1789635443.451757:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 81 00000100:00100000:0.0:1789635443.451770:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2395:x1876568411587712:12345-192.168.203.20@tcp:9:umount.0 00000020:00000080:0.0:1789635443.451800:0:10116:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40f2bd 00000100:00080000:0.0:1789635443.451809:0:10116:0:(import.c:65:import_set_state_nolock()) ffff8d0447ba3800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789635443.451863:0:10116:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1789635443.452031:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+2:2395:x1876568411587712:12345-192.168.203.20@tcp:9:umount.0 Request processed in 264us (1617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635443.452040:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 81 00010000:00010000:3.0:1789635443.452266:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789635443.452326:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789635443.482541:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635443.482713:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411588736 00000100:00100000:1.0:1789635443.482724:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411588736 00000100:00100000:1.0:1789635443.482792:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 257 00000100:00100000:1.0:1789635443.482802:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+22:2395:x1876568411588736:12345-192.168.203.20@tcp:39:umount.0 00000020:00000080:1.0:1789635443.482835:0:9526:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40eef0 00000020:00010000:1.0:1789635443.482855:0:9526:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d057603a000: total 0 00000100:00080000:1.0:1789635443.482874:0:9526:0:(import.c:65:import_set_state_nolock()) ffff8d057603b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789635443.482904:0:9526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:1.0:1789635443.483062:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+21:2395:x1876568411588736:12345-192.168.203.20@tcp:39:umount.0 Request processed in 261us (529us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1789635443.483069:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 257 00000020:00010000:3.0:1789635443.483540:0:7456:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d057603a000: total 0 00010000:00010000:3.0:1789635443.483592:0:7456:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d057603a000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1789635443.483739:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d04466ca700) 00010000:00010000:3.0:1789635443.483743:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789635443.483752:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa40fe8d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7432b expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.483773:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d04466cab00) 00010000:00010000:3.0:1789635443.483775:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789635443.483780:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0446d1ac00/0xb0c3a59caa40f7cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7414f expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.483793:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d056f407a00) 00010000:00010000:3.0:1789635443.483796:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789635443.483800:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3600/0xb0c3a59caa40f21c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fc0 expref: 18 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.483836:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d0544e2e500) 00010000:00010000:3.0:1789635443.483838:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789635443.483842:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff800/0xb0c3a59caa40f962 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741b8 expref: 17 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.483854:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d0558d1c900) 00010000:00010000:3.0:1789635443.483856:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789635443.483860:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3c00/0xb0c3a59caa40f293 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fdc expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.483873:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d04466cab00) 00010000:00010000:3.0:1789635443.483875:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789635443.483879:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153e00/0xb0c3a59caa40f8d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74195 expref: 15 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.483892:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d0558d1c900) 00010000:00010000:3.0:1789635443.483894:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789635443.483898:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056f6e8800/0xb0c3a59caa40f58e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab740b5 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.483915:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d04466ca700) 00010000:00010000:3.0:1789635443.483918:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789635443.483922:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152e00/0xb0c3a59caa40ff6d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74363 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.483934:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d044766d300) 00010000:00010000:3.0:1789635443.483937:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635443.483947:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d054139de00/0xb0c3a59caa40f238 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fc7 expref: 12 pid: 10094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.483968:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d04466cab00) 00010000:00010000:3.0:1789635443.483971:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789635443.483975:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fec00/0xb0c3a59caa40f8ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74187 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.483989:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d04466ca700) 00010000:00010000:3.0:1789635443.483992:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789635443.483996:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa40ff97 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74371 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.484009:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d0544e2e500) 00010000:00010000:3.0:1789635443.484012:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789635443.484016:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031c00/0xb0c3a59caa40fc4f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74291 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.484031:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0544e2ed00) 00010000:00010000:3.0:1789635443.484034:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789635443.484037:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0540031800/0xb0c3a59caa40f946 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab741b1 expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.484046:0:7456:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d057603a000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1789635443.484065:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635443.484067:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635443.484069:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635443.505833:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635443.505923:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411588864 00000100:00100000:1.0:1789635443.505933:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411588864 00000100:00100000:1.0:1789635443.506009:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 258 00000100:00100000:1.0:1789635443.506020:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+5:2395:x1876568411588864:12345-192.168.203.20@tcp:39:umount.0 00000020:00000080:1.0:1789635443.506052:0:6514:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40eef7 00000100:00080000:1.0:1789635443.506069:0:6514:0:(import.c:65:import_set_state_nolock()) ffff8d0576039000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789635443.506098:0:6514:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789635443.506248:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e1c17f2-a595-4ed0-97c8-b9260d0850ab+3:2395:x1876568411588864:12345-192.168.203.20@tcp:39:umount.0 Request processed in 230us (425us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789635443.506256:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 258 00010000:00010000:0.0:1789635443.506542:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789635443.506590:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789635443.879302:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635444.132129:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789635444.132152:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427370496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789635444.132234:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635444.132633:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427370496 00000100:00100000:3.0:1789635444.132658:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427370496 00000100:00100000:3.0:1789635444.132718:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1789635444.132728:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427370496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789635444.132763:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789635444.132828:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427370496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635444.132835:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1789635444.132857:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789635444.132866:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427370368:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789635444.132891:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635444.133323:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427370368 00000100:00100000:1.0:1789635444.133330:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427370368 00000100:00100000:1.0:1789635444.133370:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789635444.133378:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427370368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789635444.133398:0:7800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789635444.133442:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427370368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635444.133448:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789635444.133509:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427370368:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789635444.133702:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427370496:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789635444.162497:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635444.162550:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635444.162586:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635444.162665:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411589248 00000100:00100000:0.0:1789635444.162674:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411589248 00000100:00100000:0.0:1789635444.162740:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411589120 00000100:00100000:0.0:1789635444.162743:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411589120 00000100:00100000:0.0:1789635444.162765:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 396 00000100:00100000:0.0:1789635444.162777:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2397:x1876568411589248:12345-192.168.203.20@tcp:400:kworker.0 00000100:00080000:3.0:1789635444.162791:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789635444.162797:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789635444.162869:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2397:x1876568411589248:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 95us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635444.162877:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 396 00000100:00100000:0.0:1789635444.162909:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 397 00000100:00100000:0.0:1789635444.162917:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e015c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:407040af-7178-437e-ab3a-40e7ebc2aa86+6:2397:x1876568411589120:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635444.162955:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e015c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:407040af-7178-437e-ab3a-40e7ebc2aa86+6:2397:x1876568411589120:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 38us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635444.162961:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 397 00000100:00100000:1.0:1789635444.164421:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411588992 00000100:00100000:1.0:1789635444.164431:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411588992 00000100:00100000:1.0:1789635444.164487:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 406 00000100:00100000:1.0:1789635444.164519:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:2397:x1876568411588992:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789635444.164587:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:2397:x1876568411588992:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 71us (2101us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635444.164631:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 406 00010000:00010000:3.0:1789635444.899828:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635445.493502:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635445.493551:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635445.493680:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635445.493780:0:13189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411589376 00000100:00100000:3.0:1789635445.493790:0:13189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411589376 00000100:00100000:3.0:1789635445.493850:0:13189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411589504 00000100:00100000:3.0:1789635445.493854:0:13189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411589504 00000100:00100000:3.0:1789635445.493870:0:13189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411589632 00000100:00100000:3.0:1789635445.493873:0:13189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411589632 00000100:00100000:3.0:1789635445.493892:0:13189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:3.0:1789635445.493901:0:13189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543291c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd20b267-9db1-4540-8a6a-0af57c4f3581+12:2396:x1876568411589376:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635445.493914:0:13189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635445.493933:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d054139c200/0xb0c3a59caa40eff3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73eee expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635445.493949:0:13189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635445.494063:0:13189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543291c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd20b267-9db1-4540-8a6a-0af57c4f3581+11:2396:x1876568411589376:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 163us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635445.494071:0:13189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:3.0:1789635445.494102:0:13189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:3.0:1789635445.494109:0:13189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543293100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd20b267-9db1-4540-8a6a-0af57c4f3581+10:2396:x1876568411589504:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635445.494117:0:13189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635445.494138:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056f6e8000/0xb0c3a59caa40effa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73f1f expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635445.494148:0:13189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635445.494166:0:13189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543293100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd20b267-9db1-4540-8a6a-0af57c4f3581+9:2396:x1876568411589504:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 58us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635445.494172:0:13189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:3.0:1789635445.494184:0:13189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:3.0:1789635445.494189:0:13189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543290000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd20b267-9db1-4540-8a6a-0af57c4f3581+8:2398:x1876568411589632:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635445.494196:0:13189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635445.494204:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056e153200/0xb0c3a59caa40f1eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73fab expref: 8 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635445.494213:0:13189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635445.494229:0:13189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543290000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fd20b267-9db1-4540-8a6a-0af57c4f3581+7:2398:x1876568411589632:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 39us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635445.494235:0:13189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:2.0:1789635445.501865:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635445.502261:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411589888 00000100:00100000:3.0:1789635445.502282:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411589888 00000100:00100000:3.0:1789635445.502347:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 259 00000100:00100000:3.0:1789635445.502357:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:407040af-7178-437e-ab3a-40e7ebc2aa86+6:2395:x1876568411589888:12345-192.168.203.20@tcp:39:umount.0 00000020:00000080:3.0:1789635445.502401:0:6516:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40f008 00000020:00010000:3.0:1789635445.502421:0:6516:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d0446d98800: total 0 00000100:00080000:3.0:1789635445.502442:0:6516:0:(import.c:65:import_set_state_nolock()) ffff8d0446d9a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789635445.502476:0:6516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:3.0:1789635445.502679:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2395:x1876568411589888:12345-192.168.203.20@tcp:39:umount.0 Request processed in 322us (821us total) trans 4294967528 rc 0/0 00000100:00100000:3.0:1789635445.502688:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 259 00000020:00010000:2.0:1789635445.503325:0:6503:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d0446d98800: total 0 00010000:00010000:2.0:1789635445.503330:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635445.503382:0:6503:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d0446d98800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789635445.503417:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0544e2ed00) 00010000:00010000:2.0:1789635445.503421:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789635445.503429:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa40ffba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7437f expref: 4 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635445.503450:0:6503:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d0446d98800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1789635445.503461:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635445.503472:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635445.503474:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635445.513676:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635445.513977:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411590016 00000100:00100000:2.0:1789635445.513988:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411590016 00000100:00100000:2.0:1789635445.514057:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 260 00000100:00100000:2.0:1789635445.514067:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+5:2395:x1876568411590016:12345-192.168.203.20@tcp:39:umount.0 00000020:00000080:2.0:1789635445.514105:0:10094:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40f00f 00000100:00080000:2.0:1789635445.514118:0:10094:0:(import.c:65:import_set_state_nolock()) ffff8d0447653000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789635445.514147:0:10094:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:3.0:1789635445.514331:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635445.514499:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:407040af-7178-437e-ab3a-40e7ebc2aa86+3:2395:x1876568411590016:12345-192.168.203.20@tcp:39:umount.0 Request processed in 432us (831us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789635445.514508:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 260 00000100:00100000:1.0:1789635445.552691:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635445.552775:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411590272 00000100:00100000:3.0:1789635445.552786:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411590272 00000100:00100000:3.0:1789635445.552843:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 407 00000100:00100000:3.0:1789635445.552853:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+7:2395:x1876568411590272:12345-192.168.203.20@tcp:251:umount.0 00000020:00000080:3.0:1789635445.552895:0:6506:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40eecd 00000020:00010000:3.0:1789635445.552903:0:6506:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d0447833000: total 0 00000100:00080000:3.0:1789635445.552908:0:6506:0:(import.c:65:import_set_state_nolock()) ffff8d0447832000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789635445.552991:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd20b267-9db1-4540-8a6a-0af57c4f3581+3:2395:x1876568411590272:12345-192.168.203.20@tcp:251:umount.0 Request processed in 139us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635445.553000:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 407 00000020:00010000:0.0:1789635445.553173:0:7456:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d0447833000: total 0 00010000:00010000:0.0:1789635445.553225:0:7456:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d0447833000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789635445.553258:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d054139c800/0xb0c3a59caa40efa6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab73ee0 expref: 2 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635445.553282:0:7456:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d0447833000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1789635445.553294:0:7456:0:(genops.c:885:class_export_put()) final put ffff8d0447833000/fd20b267-9db1-4540-8a6a-0af57c4f3581 00010000:00010000:0.0:1789635445.553308:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635445.553311:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635445.553312:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789635445.553474:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0447833000/fd20b267-9db1-4540-8a6a-0af57c4f3581 for MGS 00000020:00000080:3.0:1789635445.553519:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d0447832000 for MGS 00010000:00010000:2.0:1789635445.923733:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635446.180191:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789635446.180215:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427370624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635446.180288:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635446.180943:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447659500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876568427370880:0@lo:400:kworker.0 00000100:00100000:2.0:1789635446.180978:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635446.181005:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d055896aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1876568427371392:0@lo:400:kworker.0 00000100:00100000:2.0:1789635446.181036:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635446.181057:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d055896ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1876568427371904:0@lo:400:kworker.0 00000100:00100000:2.0:1789635446.181075:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635446.181097:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789635446.181102:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427370752:0@lo:400:kworker.0 00000100:00100000:2.0:1789635446.181126:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635446.181145:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0558968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876568427371264:0@lo:400:kworker.0 00000100:00100000:2.0:1789635446.181164:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635446.181177:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d055896b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427371776:0@lo:400:kworker.0 00000100:00100000:2.0:1789635446.181198:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635446.181243:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427370880 00000100:00100000:2.0:1789635446.181251:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427370880 00000100:00100000:2.0:1789635446.181306:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427371392 00000100:00100000:2.0:1789635446.181310:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427371392 00000100:00100000:2.0:1789635446.181332:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427371904 00000100:00100000:2.0:1789635446.181335:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427371904 00000100:00100000:1.0:1789635446.181844:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d055896b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427371008:0@lo:400:kworker.0 00000100:00100000:1.0:1789635446.181886:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635446.181910:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d055896bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427371520:0@lo:400:kworker.0 00000100:00100000:1.0:1789635446.181930:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635446.181941:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d055896b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1876568427372032:0@lo:400:kworker.0 00000100:00100000:1.0:1789635446.181957:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635446.181968:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789635446.181973:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0558969f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427371136:0@lo:400:kworker.0 00000100:00100000:1.0:1789635446.181990:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635446.182007:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0558968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427371648:0@lo:400:kworker.0 00000100:00100000:1.0:1789635446.182024:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635446.182040:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044881fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427372160:0@lo:400:kworker.0 00000100:00100000:1.0:1789635446.182058:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635446.182086:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427370624 00000100:00100000:1.0:1789635446.182091:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427370624 00000100:00100000:1.0:1789635446.182122:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789635446.182131:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427370624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789635446.182166:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789635446.182207:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427370624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (1918us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635446.182214:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789635446.182233:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427371264 00000100:00100000:1.0:1789635446.182236:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427371264 00000100:00100000:1.0:1789635446.182252:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427371520 00000100:00100000:1.0:1789635446.182255:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427371520 00000100:00100000:1.0:1789635446.182280:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427372032 00000100:00100000:1.0:1789635446.182282:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427372032 00000100:00100000:1.0:1789635446.182294:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1789635446.182302:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044881df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876568427370880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635446.182341:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044881df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876568427370880:12345-0@lo:400:kworker.0 Request processed in 39us (1361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635446.182347:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1789635446.182359:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1789635446.182365:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044881f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876568427371392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635446.182839:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427372288:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789635446.182882:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635446.183146:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427372288 00000100:00100000:3.0:1789635446.183153:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427372288 00000100:00100000:3.0:1789635446.183195:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789635446.183202:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427372288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789635446.183217:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789635446.183253:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427372288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635446.183272:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789635446.183386:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427372288:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789635446.184649:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1789635446.184661:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044881e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876568427371264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635446.184726:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044881e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876568427371264:12345-0@lo:400:kworker.0 Request processed in 68us (3561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635446.184733:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1789635446.184750:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1789635446.184757:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427371520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635446.184787:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427371520:12345-0@lo:400:kworker.0 Request processed in 32us (2856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635446.184793:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1789635446.184804:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1789635446.184812:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876568427372032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635446.184842:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876568427372032:12345-0@lo:400:kworker.0 Request processed in 31us (2883us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635446.184858:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1789635446.184871:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1789635446.184877:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044881c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876568427371904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635446.184908:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044881c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876568427371904:12345-0@lo:400:kworker.0 Request processed in 31us (3831us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635446.184914:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1789635446.184944:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427370752 00000100:00100000:2.0:1789635446.184961:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427370752 00000100:00100000:2.0:1789635446.184997:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:2.0:1789635446.185005:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3641:x1876568427370752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635446.185039:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3641:x1876568427370752:12345-0@lo:400:kworker.0 Request processed in 37us (3912us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635446.185045:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:2.0:1789635446.185084:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427371776 00000100:00100000:2.0:1789635446.185089:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427371776 00000100:00100000:2.0:1789635446.185127:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427371648 00000100:00100000:2.0:1789635446.185130:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427371648 00000100:00100000:2.0:1789635446.185149:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427372160 00000100:00100000:2.0:1789635446.185152:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427372160 00000100:00100000:2.0:1789635446.185166:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789635446.185172:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044881e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427371776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635446.185201:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044881e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427371776:12345-0@lo:400:kworker.0 Request processed in 29us (4002us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635446.185207:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789635446.185218:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789635446.185223:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427371648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635446.185249:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427371648:12345-0@lo:400:kworker.0 Request processed in 26us (3224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635446.185254:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789635446.185275:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789635446.185283:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427372160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635446.185316:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427372160:12345-0@lo:400:kworker.0 Request processed in 35us (3257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635446.185322:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:2.0:1789635446.185351:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789635446.185356:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789635446.185358:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789635446.185360:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635446.185804:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044881f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876568427371392:12345-0@lo:400:kworker.0 Request processed in 3437us (4765us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635446.185813:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1789635446.185836:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427371008 00000100:00100000:1.0:1789635446.185841:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427371008 00000100:00100000:1.0:1789635446.185876:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427371136 00000100:00100000:1.0:1789635446.185880:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427371136 00000100:00100000:1.0:1789635446.185894:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789635446.185900:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427371008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635446.185935:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427371008:12345-0@lo:400:kworker.0 Request processed in 35us (4048us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635446.185949:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789635446.185962:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789635446.185968:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427371136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635446.185999:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427371136:12345-0@lo:400:kworker.0 Request processed in 31us (4007us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635446.186004:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789635446.186065:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427370752:0@lo:400:kworker.0 00000100:00100000:1.0:1789635446.186079:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0558968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876568427371264:0@lo:400:kworker.0 00000100:00100000:1.0:1789635446.186090:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d055896b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427371776:0@lo:400:kworker.0 00000100:00100000:1.0:1789635446.186100:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447659500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876568427370880:0@lo:400:kworker.0 00000100:00100000:1.0:1789635446.186110:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d055896aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1876568427371392:0@lo:400:kworker.0 00000100:00100000:1.0:1789635446.186120:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d055896ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1876568427371904:0@lo:400:kworker.0 00000100:00100000:1.0:1789635446.186164:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0558969f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427371136:0@lo:400:kworker.0 00000100:00100000:1.0:1789635446.186175:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0558968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427371648:0@lo:400:kworker.0 00000100:00100000:1.0:1789635446.186186:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044881fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427372160:0@lo:400:kworker.0 00000100:00100000:1.0:1789635446.186195:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d055896b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427371008:0@lo:400:kworker.0 00010000:00080000:1.0:1789635446.186208:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d055896bb80 x1876568427371520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635446.186219:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d055896bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427371520:0@lo:400:kworker.0 00010000:00080000:1.0:1789635446.186229:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d055896b800 x1876568427372032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635446.186244:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d055896b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1876568427372032:0@lo:400:kworker.0 00000100:00100000:1.0:1789635446.186278:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427370624:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789635446.950157:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789635447.158440:0:15104:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789635447.184231:0:15104:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1789635447.184299:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152200/0xb0c3a59caa40ef75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ef7c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635447.184314:0:15104:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152200/0xb0c3a59caa40ef75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ef7c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635447.184323:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152200/0xb0c3a59caa40ef75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xb0c3a59caa40ef7c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635447.184331:0:15104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff8d056e152200/0xb0c3a59caa40ef75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xb0c3a59caa40ef7c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635447.184393:0:15104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789635447.184399:0:15104:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789635447.184422:0:15104:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789635447.184426:0:15104:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789635447.184432:0:15104:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789635447.184457:0:15104:0:(import.c:65:import_set_state_nolock()) ffff8d056e01c800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789635447.184556:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044881fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876568427372416:0@lo:39:umount.0 00000100:00100000:3.0:1789635447.184687:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635447.185856:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427372416 00000100:00100000:2.0:1789635447.185867:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427372416 00000100:00100000:2.0:1789635447.185937:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789635447.185955:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876568427372416:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789635447.185983:0:6516:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40eae4 00000100:00080000:2.0:1789635447.185993:0:6516:0:(import.c:65:import_set_state_nolock()) ffff8d05501e2000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789635447.189694:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635447.189709:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d056e152200/0xb0c3a59caa40ef75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xb0c3a59caa40ef7c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635447.189721:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152200 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:0.0:1789635447.189726:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d056e152200/0xb0c3a59caa40ef75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xb0c3a59caa40ef7c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635447.189756:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056e152200/0xb0c3a59caa40ef75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xb0c3a59caa40ef7c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789635447.189764:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056e152200/0xb0c3a59caa40ef75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xb0c3a59caa40ef7c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635447.189771:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789635447.189774:0:7456:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789635447.189776:0:7456:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789635447.189896:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d056e152200/0xb0c3a59caa40ef75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xb0c3a59caa40ef7c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635447.189903:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789635447.189939:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d056e152200/0xb0c3a59caa40ef75 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xb0c3a59caa40ef7c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635447.190003:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056e152200/0xb0c3a59caa40ef75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xb0c3a59caa40ef7c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635447.190012:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543290e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427372544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789635447.190086:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789635447.190098:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635447.190102:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635447.190104:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635447.190154:0:13189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427372544 00000100:00100000:3.0:1789635447.190163:0:13189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427372544 00000100:00100000:3.0:1789635447.190219:0:13189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789635447.190227:0:13189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b400450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6356ed01-c755-4f9e-b839-20feb7c3f098+24:3641:x1876568427372544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789635447.190240:0:13189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635447.190266:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056f6e8e00/0xb0c3a59caa40ef7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb0c3a59caa40ef75 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635447.190279:0:13189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635447.190317:0:13189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b400450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6356ed01-c755-4f9e-b839-20feb7c3f098+23:3641:x1876568427372544:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635447.190325:0:13189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789635447.190398:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543290e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427372544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789635447.190720:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3639:x1876568427372416:12345-0@lo:39:umount.0 Request processed in 4773us (6031us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635447.190731:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000020:00000080:2.0:1789635447.190743:0:6516:0:(genops.c:885:class_export_put()) final put ffff8d05501e5000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:3.0:1789635447.191130:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d056e01c800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789635447.191150:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044881fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876568427372416:0@lo:39:umount.0 00000020:00000080:1.0:1789635447.191289:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d05501e5000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1789635447.191334:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d05501e2000 for lustre-MDT0000 00000100:00080000:2.0:1789635447.192134:0:15104:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789635447.192140:0:15104:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789635447.192146:0:15104:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789635447.193272:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8a00/0xb0c3a59caa40ef83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ef8a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635447.193289:0:15104:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8a00/0xb0c3a59caa40ef83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ef8a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635447.193296:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8a00/0xb0c3a59caa40ef83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xb0c3a59caa40ef8a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635447.193302:0:15104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8a00/0xb0c3a59caa40ef83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xb0c3a59caa40ef8a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635447.196011:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635447.196132:0:15104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789635447.196225:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635447.196233:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8a00/0xb0c3a59caa40ef83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xb0c3a59caa40ef8a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635447.196245:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056f6e8a00 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:0.0:1789635447.196249:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8a00/0xb0c3a59caa40ef83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xb0c3a59caa40ef8a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635447.196290:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8a00/0xb0c3a59caa40ef83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xb0c3a59caa40ef8a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789635447.196298:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8a00/0xb0c3a59caa40ef83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xb0c3a59caa40ef8a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635447.196304:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789635447.196306:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1789635447.196343:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8a00/0xb0c3a59caa40ef83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xb0c3a59caa40ef8a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635447.196350:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789635447.196392:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8a00/0xb0c3a59caa40ef83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xb0c3a59caa40ef8a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635447.196399:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056f6e8a00/0xb0c3a59caa40ef83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xb0c3a59caa40ef8a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635447.196412:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635447.196414:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635447.196415:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635447.196527:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543291f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427372672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789635447.196626:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635447.196795:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427372672 00000100:00100000:0.0:1789635447.196812:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427372672 00000100:00100000:0.0:1789635447.196871:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789635447.196881:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044881fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+23:3642:x1876568427372672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789635447.196893:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635447.196907:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056f6e9200/0xb0c3a59caa40ef8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb0c3a59caa40ef83 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635447.196932:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635447.196988:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044881fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+22:3642:x1876568427372672:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635447.196996:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789635447.197028:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543291f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427372672:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789635447.197321:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d058214a000/0xb0c3a59caa40ee87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ee8e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635447.197331:0:15104:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d058214a000/0xb0c3a59caa40ee87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ee8e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635447.197338:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d058214a000/0xb0c3a59caa40ee87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb0c3a59caa40ee8e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635447.197345:0:15104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff8d058214a000/0xb0c3a59caa40ee87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb0c3a59caa40ee8e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635447.197393:0:15104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789635447.197400:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152c00/0xb0c3a59caa40f1dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40f1e4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635447.197406:0:15104:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152c00/0xb0c3a59caa40f1dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40f1e4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635447.197411:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152c00/0xb0c3a59caa40f1dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb0c3a59caa40f1e4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635447.197417:0:15104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff8d056e152c00/0xb0c3a59caa40f1dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb0c3a59caa40f1e4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635447.197451:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789635447.197456:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d058214a000/0xb0c3a59caa40ee87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb0c3a59caa40ee8e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635447.197462:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d058214a000 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:0.0:1789635447.197465:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d058214a000/0xb0c3a59caa40ee87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb0c3a59caa40ee8e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635447.197472:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d058214a000/0xb0c3a59caa40ee87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb0c3a59caa40ee8e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789635447.197479:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d058214a000/0xb0c3a59caa40ee87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb0c3a59caa40ee8e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635447.197484:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789635447.197487:0:7456:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1789635447.197489:0:7456:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789635447.197508:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d058214a000/0xb0c3a59caa40ee87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb0c3a59caa40ee8e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635447.197525:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789635447.197569:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1789635447.197589:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d058214a000/0xb0c3a59caa40ee87 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb0c3a59caa40ee8e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635447.197616:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d058214a000/0xb0c3a59caa40ee87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb0c3a59caa40ee8e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635447.197634:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635447.197637:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d056e152c00/0xb0c3a59caa40f1dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb0c3a59caa40f1e4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635447.197643:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152c00 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:0.0:1789635447.197646:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d056e152c00/0xb0c3a59caa40f1dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb0c3a59caa40f1e4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635447.197653:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056e152c00/0xb0c3a59caa40f1dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xb0c3a59caa40f1e4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789635447.197658:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056e152c00/0xb0c3a59caa40f1dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xb0c3a59caa40f1e4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635447.197663:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789635447.197664:0:7456:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1789635447.197679:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d056e152c00/0xb0c3a59caa40f1dd lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb0c3a59caa40f1e4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635447.197684:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789635447.197708:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d056e152c00/0xb0c3a59caa40f1dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb0c3a59caa40f1e4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635447.197716:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635447.197717:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635447.197718:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635447.197725:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789635447.197735:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427372928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789635447.197769:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635447.197818:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427372928 00000100:00100000:0.0:1789635447.197823:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427372928 00000100:00100000:0.0:1789635447.197857:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789635447.197865:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543292680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+22:3641:x1876568427372928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789635447.197874:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635447.197885:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056e1a2400/0xb0c3a59caa40f1e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb0c3a59caa40f1dd expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635447.197894:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635447.197922:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543292680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6356ed01-c755-4f9e-b839-20feb7c3f098+21:3641:x1876568427372928:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635447.197929:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789635447.198304:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:3641:1876568427372928:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789635447.198370:0:15104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789635447.198376:0:15104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056e152c00/0xb0c3a59caa40f1dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb0c3a59caa40f1e4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635447.198386:0:15104:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789635447.198392:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d0540031a00/0xb0c3a59caa40ea43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ea4a expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635447.198400:0:15104:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d0540031a00/0xb0c3a59caa40ea43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ea4a expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635447.198405:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d0540031a00/0xb0c3a59caa40ea43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb0c3a59caa40ea4a expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635447.198411:0:15104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff8d0540031a00/0xb0c3a59caa40ea43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb0c3a59caa40ea4a expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635447.198514:0:15104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789635447.198518:0:15104:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1789635447.198522:0:15104:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1789635447.198557:0:15104:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1789635447.198566:0:15104:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1789635447.198571:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789635447.198577:0:15104:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:1.0:1789635447.198582:0:15104:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8d056f457000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789635447.198588:0:15104:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8d056e355800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789635447.198592:0:15104:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8d056f6f5000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789635447.198611:0:15104:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8d056f552800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:1.0:1789635447.198624:0:15104:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8d0446d98800 407040af-7178-437e-ab3a-40e7ebc2aa86 192.168.203.20@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789635447.198629:0:15104:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8d057603a000 6e1c17f2-a595-4ed0-97c8-b9260d0850ab 192.168.203.20@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:1.0:1789635447.198634:0:15104:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8d0558614d40) has exports, disconnecting them 00000020:00080000:1.0:1789635447.198638:0:15104:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d056f457000), last request at 1789635446 00000020:00000080:1.0:1789635447.198645:0:15104:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40edf4 00000100:00080000:1.0:1789635447.198663:0:15104:0:(import.c:65:import_set_state_nolock()) ffff8d0576048800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789635447.198905:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543292300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427372800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789635447.198946:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635447.199227:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427372800 00000100:00100000:2.0:1789635447.199234:0:7457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427372800 00000100:00100000:2.0:1789635447.199285:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789635447.199292:0:7457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6356ed01-c755-4f9e-b839-20feb7c3f098+21:3642:x1876568427372800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789635447.199312:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635447.199324:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056e1a2200/0xb0c3a59caa40ee8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb0c3a59caa40ee87 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635447.199335:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635447.199363:0:7457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6356ed01-c755-4f9e-b839-20feb7c3f098+20:3642:x1876568427372800:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635447.199369:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789635447.199398:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543292300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427372800:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789635447.199461:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635447.199468:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d0540031a00/0xb0c3a59caa40ea43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb0c3a59caa40ea4a expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635447.199476:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540031a00 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:0.0:1789635447.199480:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d0540031a00/0xb0c3a59caa40ea43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb0c3a59caa40ea4a expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635447.199487:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d0540031a00/0xb0c3a59caa40ea43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb0c3a59caa40ea4a expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789635447.199494:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d0540031a00/0xb0c3a59caa40ea43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb0c3a59caa40ea4a expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635447.199499:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789635447.199501:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1789635447.199518:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1789635447.199542:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d0540031a00/0xb0c3a59caa40ea43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb0c3a59caa40ea4a expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635447.199548:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789635447.199575:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d0540031a00/0xb0c3a59caa40ea43 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb0c3a59caa40ea4a expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635447.199582:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d0540031a00/0xb0c3a59caa40ea43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb0c3a59caa40ea4a expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635447.199591:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635447.199593:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635447.199610:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635447.199616:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789635447.199624:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427373056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789635447.199653:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635447.199681:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427373056 00000100:00100000:0.0:1789635447.199685:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427373056 00000100:00100000:0.0:1789635447.199713:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789635447.199720:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543291500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+20:3640:x1876568427373056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789635447.199727:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635447.199736:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0540031000/0xb0c3a59caa40ea4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb0c3a59caa40ea43 expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635447.199745:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635447.199771:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543291500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6356ed01-c755-4f9e-b839-20feb7c3f098+19:3640:x1876568427373056:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635447.199776:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789635447.199970:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427373056:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789635447.200851:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789635447.200981:0:15104:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d056f457000): rc 0 00000020:00000080:1.0:1789635447.200985:0:15104:0:(genops.c:885:class_export_put()) final put ffff8d056f457000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1789635447.201012:0:15104:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d056e355800), last request at 1789635446 00000020:00000080:1.0:1789635447.201020:0:15104:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40ecce 00000100:00080000:1.0:1789635447.201030:0:15104:0:(import.c:65:import_set_state_nolock()) ffff8d04465c3800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1789635447.201061:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d056f457000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1789635447.201117:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d0576048800 for lustre-MDT0000 00010000:00010000:0.0:1789635447.201205:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789635447.201281:0:15104:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d056e355800): rc 0 00000020:00000080:1.0:1789635447.201284:0:15104:0:(genops.c:885:class_export_put()) final put ffff8d056e355800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1789635447.201302:0:15104:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d056f6f5000), last request at 1789635198 00000020:00000080:1.0:1789635447.201305:0:15104:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40ec0a 00000100:00080000:1.0:1789635447.201310:0:15104:0:(import.c:65:import_set_state_nolock()) ffff8d056f6f7800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789635447.201328:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789635447.201342:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d056e355800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789635447.201390:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d04465c3800 for lustre-MDT0000 00000020:00080000:1.0:1789635447.201431:0:15104:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d056f6f5000): rc 0 00000020:00000080:1.0:1789635447.201434:0:15104:0:(genops.c:885:class_export_put()) final put ffff8d056f6f5000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1789635447.201446:0:15104:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d056f552800), last request at 1789635198 00000020:00000080:1.0:1789635447.201450:0:15104:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40ebbd 00000100:00080000:1.0:1789635447.201454:0:15104:0:(import.c:65:import_set_state_nolock()) ffff8d056f6d7000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1789635447.201477:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d056f6f5000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1789635447.201528:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d056f6f7800 for lustre-MDT0000 00010000:00010000:0.0:1789635447.201657:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1789635447.201740:0:15104:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:1.0:1789635447.201821:0:15104:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d056f552800): rc 0 00000004:00000080:1.0:1789635447.201828:0:15104:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa6bb41cf7ae0 00000100:00080000:1.0:1789635447.201846:0:15104:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789635447.201850:0:15104:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:1.0:1789635447.203209:0:15104:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789635447.203265:0:15104:0:(import.c:65:import_set_state_nolock()) ffff8d056f551800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789635447.203373:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427373184:0@lo:39:umount.0 00000100:00100000:3.0:1789635447.203434:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635447.203572:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427373184 00000100:00100000:1.0:1789635447.203579:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427373184 00000100:00100000:1.0:1789635447.203647:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789635447.203657:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876568427373184:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789635447.203684:0:7800:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40ec18 00000100:00080000:1.0:1789635447.203691:0:7800:0:(import.c:65:import_set_state_nolock()) ffff8d056f6d2000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789635447.203792:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1789635447.203920:0:7800:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1789635447.204002:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789635447.204011:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427373312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635447.204043:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635447.204075:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427373312 00000100:00100000:3.0:1789635447.204079:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427373312 00000100:00100000:1.0:1789635447.204084:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3639:x1876568427373184:12345-0@lo:39:umount.0 Request processed in 426us (647us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789635447.204092:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789635447.204113:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789635447.204121:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427373312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789635447.204143:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1789635447.204174:0:15104:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789635447.204176:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427373312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635447.204182:0:15104:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d0448598000 x1876568427373312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635463 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635447.204187:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789635447.204199:0:15104:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:1.0:1789635447.204212:0:15104:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789635447.204218:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427373312:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789635447.204264:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d056f551800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789635447.204271:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427373184:0@lo:39:umount.0 00000100:00080000:1.0:1789635447.204285:0:15104:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1789635447.204296:0:15104:0:(import.c:65:import_set_state_nolock()) ffff8d056f553800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1789635447.204312:0:15104:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789635447.204314:0:15104:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:1.0:1789635447.204323:0:15104:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789635447.204384:0:15104:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1789635447.204392:0:15104:0:(import.c:65:import_set_state_nolock()) ffff8d057603f000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1789635447.204416:0:15104:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8d0558614d40) has no exports 00000100:00100000:3.0:1789635447.205087:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427373440:0@lo:9:umount.0 00000100:00100000:3.0:1789635447.205127:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635447.205191:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427373568:0@lo:9:umount.0 00000100:00100000:3.0:1789635447.205210:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789635447.206324:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635447.214961:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427373440 00000100:00100000:1.0:1789635447.214977:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427373440 00000100:00100000:0.0:1789635447.215140:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427373568 00000100:00100000:0.0:1789635447.215146:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427373568 00000100:00100000:1.0:1789635447.215207:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789635447.215220:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448598000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876568427373440:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789635447.215278:0:8431:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40ed84 00000100:00080000:1.0:1789635447.215289:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8d0445994000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789635447.215341:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00010000:00010000:3.0:1789635447.215426:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635447.216145:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448598000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3639:x1876568427373440:12345-0@lo:9:umount.0 Request processed in 926us (11015us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635447.216154:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789635447.216176:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789635447.216185:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876568427373568:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789635447.216200:0:8431:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40eeb8 00000100:00080000:1.0:1789635447.216206:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8d0447833800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789635447.216234:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1789635447.216331:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3639:x1876568427373568:12345-0@lo:9:umount.0 Request processed in 148us (11118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635447.216337:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1789635447.216411:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d056f553800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789635447.216425:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789635447.216428:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789635447.216432:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427373440:0@lo:9:umount.0 00000100:00080000:3.0:1789635447.216456:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d057603f000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789635447.216466:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789635447.216468:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789635447.216470:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427373568:0@lo:9:umount.0 00010000:00010000:0.0:1789635447.224051:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789635447.240974:0:15104:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8d0558614d40) has no exports 00000020:00000080:1.0:1789635447.305066:0:15104:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40ea9e 00000020:00000080:1.0:1789635447.305083:0:15104:0:(genops.c:885:class_export_put()) final put ffff8d055862d800/lustre-QMT0000_UUID 00000020:01000000:1.0:1789635447.305143:0:15104:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1789635447.306663:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789635447.306676:0:15104:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789635447.306681:0:15104:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8d057ae499c0) has no exports 00000020:00000080:0.0:1789635447.307303:0:15104:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40ea97 00000020:00000080:0.0:1789635447.307321:0:15104:0:(genops.c:885:class_export_put()) final put ffff8d05446bd000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789635447.307385:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789635447.307393:0:15104:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789635447.308286:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d055862d800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789635447.308295:0:36:0:(genops.c:885:class_export_put()) final put ffff8d05446bc000/lustre-QMT0000_UUID 00000020:00000080:2.0:1789635447.308298:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d05446bc000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789635447.308306:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1789635447.308874:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d05446bd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1789635447.717289:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427373696:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789635447.717360:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635447.717578:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427373696 00000100:00100000:1.0:1789635447.717587:0:10329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427373696 00000100:00100000:1.0:1789635447.717679:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789635447.717690:0:10329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427373696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789635447.717714:0:10329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789635447.717770:0:10329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427373696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635447.717777:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789635447.717863:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427373696:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789635447.971851:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635448.995869:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635449.251848:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789635449.251871:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427373824:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789635449.251942:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635449.252190:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427373824 00000100:00100000:2.0:1789635449.252198:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427373824 00000100:00100000:2.0:1789635449.252251:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789635449.252258:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1876568427373824:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1789635449.252266:0:6519:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789635449.252307:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1876568427373824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 48us (364us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789635449.252313:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:02020000:3.0:1789635449.252402:0:3641:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000001:00100000:2.0:1789635449.264940:0:7446:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1789635449.264955:0:7446:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:2.0:1789635449.264961:0:7446:0:(genops.c:885:class_export_put()) final put ffff8d056f6d3000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789635449.265033:0:7446:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 407040af-7178-437e-ab3a-40e7ebc2aa86 00000001:00080000:2.0:1789635449.265040:0:7446:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:2.0:1789635449.265043:0:7446:0:(genops.c:885:class_export_put()) final put ffff8d0447651800/407040af-7178-437e-ab3a-40e7ebc2aa86 00000001:00100000:0.0:1789635449.265872:0:6493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789635449.265878:0:6493:0:(genops.c:885:class_export_put()) final put ffff8d056f552800/lustre-MDT0001-mdtlov_UUID 00000100:00080000:3.0:1789635449.266420:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789635449.266428:0:3641:0:(import.c:65:import_set_state_nolock()) ffff8d056f457800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789635449.266431:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000020:00000080:1.0:1789635449.267249:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d056f6d3000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1789635449.267330:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d056f6d2000 for lustre-MDT0001 00000020:00000080:1.0:1789635449.268989:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0447651800/407040af-7178-437e-ab3a-40e7ebc2aa86 for lustre-MDT0001 00000001:00100000:2.0:1789635449.269072:0:7446:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6e1c17f2-a595-4ed0-97c8-b9260d0850ab 00000001:00080000:2.0:1789635449.269083:0:7446:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:2.0:1789635449.269087:0:7446:0:(genops.c:885:class_export_put()) final put ffff8d057603d000/6e1c17f2-a595-4ed0-97c8-b9260d0850ab 00000020:00000080:1.0:1789635449.269182:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d057603d000/6e1c17f2-a595-4ed0-97c8-b9260d0850ab for lustre-MDT0001 00000020:00000080:1.0:1789635449.269205:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d0447653000 for lustre-MDT0001 00000020:00000080:1.0:1789635449.269209:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d0576039000 for lustre-MDT0001 00000001:00100000:0.0:1789635449.269795:0:6493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 407040af-7178-437e-ab3a-40e7ebc2aa86 00000001:00080000:0.0:1789635449.269803:0:6493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1789635449.269806:0:6493:0:(genops.c:885:class_export_put()) final put ffff8d0446d98800/407040af-7178-437e-ab3a-40e7ebc2aa86 00000001:00100000:0.0:1789635449.269812:0:6493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6e1c17f2-a595-4ed0-97c8-b9260d0850ab 00000001:00080000:0.0:1789635449.269816:0:6493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1789635449.269823:0:6493:0:(genops.c:885:class_export_put()) final put ffff8d057603a000/6e1c17f2-a595-4ed0-97c8-b9260d0850ab 00000020:00000080:2.0:1789635449.269892:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d056f552800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1789635449.269938:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0446d98800/407040af-7178-437e-ab3a-40e7ebc2aa86 for lustre-MDT0000 00000020:00000080:2.0:1789635449.269960:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d057603a000/6e1c17f2-a595-4ed0-97c8-b9260d0850ab for lustre-MDT0000 00000020:00000080:2.0:1789635449.269982:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d056f6d7000 for lustre-MDT0000 00000020:00000080:2.0:1789635449.269986:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d0446d9a800 for lustre-MDT0000 00000020:00000080:2.0:1789635449.269989:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d057603b000 for lustre-MDT0000 00000001:00100000:1.0:1789635449.270156:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789635449.270160:0:9509:0:(genops.c:885:class_export_put()) final put ffff8d0447837000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789635449.270178:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e1c17f2-a595-4ed0-97c8-b9260d0850ab 00000020:00000080:1.0:1789635449.270181:0:9509:0:(genops.c:885:class_export_put()) final put ffff8d0447982000/6e1c17f2-a595-4ed0-97c8-b9260d0850ab 00000020:00000080:0.0:1789635449.270233:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0447837000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789635449.270275:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0447982000/6e1c17f2-a595-4ed0-97c8-b9260d0850ab for lustre-OST0001 00000020:00000080:0.0:1789635449.270304:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d0447833800 for lustre-OST0001 00000020:00000080:0.0:1789635449.270308:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d0447983800 for lustre-OST0001 00000001:00100000:2.0:1789635449.271079:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789635449.271084:0:8425:0:(genops.c:885:class_export_put()) final put ffff8d0445993800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789635449.271134:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e1c17f2-a595-4ed0-97c8-b9260d0850ab 00000020:00000080:2.0:1789635449.271137:0:8425:0:(genops.c:885:class_export_put()) final put ffff8d0447ba5800/6e1c17f2-a595-4ed0-97c8-b9260d0850ab 00000020:00000080:1.0:1789635449.273469:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0445993800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1789635449.273527:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d0445994000 for lustre-OST0000 00000020:00000080:0.0:1789635449.275657:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0447ba5800/6e1c17f2-a595-4ed0-97c8-b9260d0850ab for lustre-OST0000 00000100:00080000:3.0:1789635449.276176:0:3641:0:(import.c:65:import_set_state_nolock()) ffff8d056f457800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789635449.276186:0:3641:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 217 00000100:00080000:3.0:1789635449.276201:0:3641:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8d056f457800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789635449.276270:0:3641:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d044859bb80 x1876568427373952/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789635449.277011:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1876568427373952:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1789635449.277079:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635449.277171:0:7800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427373952 00000100:00100000:3.0:1789635449.277180:0:7800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427373952 00000100:00100000:3.0:1789635449.277209:0:7800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789635449.277216:0:7800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3639:x1876568427373952:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1789635449.277232:0:7800:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000020:00000080:0.0:1789635449.281380:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d0447ba3800 for lustre-OST0000 00000100:00100000:3.0:1789635449.283255:0:7800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3639:x1876568427373952:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 6031us (6169us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789635449.283285:0:7800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00080000:0.0:1789635449.283443:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d056f457800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789635449.283450:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789635449.283453:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1876568427373952:0@lo:38:ptlrpcd_00_01.0 00000020:01000000:0.0:1789635449.315747:0:15104:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d0447787900 - data ffff8d0445cd2870/ffff8d044790d000 00000020:01000000:0.0:1789635449.315925:0:15104:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d05450cef60 - data ffff8d057b04a798/ffff8d057af18c00 00000001:00000004:0.0:1789635449.328736:0:15104:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:3.0:1789635449.381676:0:15104:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789635449.381684:0:15104:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1789635449.381700:0:15104:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8d0447ac0700 x1876568427373184/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789635457 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635449.381725:0:15104:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1789635449.383088:0:15104:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789635449.383092:0:15104:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:0.0:1789635449.383113:0:15104:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789635449.383115:0:15104:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789635449.383892:0:8865:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789635449.383898:0:8865:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1789635449.383908:0:8865:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1789635449.384372:0:15104:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789635449.384376:0:15104:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1789635449.384395:0:15104:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789635449.384397:0:15104:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789635449.387054:0:9894:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789635449.387061:0:9894:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1789635449.387070:0:9894:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1789635449.390341:0:15104:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40ea66 00000020:00000080:3.0:1789635449.390352:0:15104:0:(genops.c:885:class_export_put()) final put ffff8d057b5c7000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789635449.390660:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d057b5c7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789635449.394774:0:15104:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40ea7b 00000020:00000080:3.0:1789635449.394788:0:15104:0:(genops.c:885:class_export_put()) final put ffff8d055862c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789635449.394801:0:15104:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1789635449.394806:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789635449.394814:0:15104:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789635449.394817:0:15104:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8d05586119c0) has no exports 00000004:01000000:3.0:1789635449.394986:0:15104:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789635449.394995:0:15104:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40eeb1 00000020:00000080:3.0:1789635449.394999:0:15104:0:(genops.c:885:class_export_put()) final put ffff8d0446450000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789635449.395003:0:15104:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789635449.395006:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789635449.395014:0:15104:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789635449.395017:0:15104:0:(genops.c:1557:class_disconnect_exports()) OBD device 28 (ffff8d04478a0000) has no exports 00000020:00000080:3.0:1789635449.395022:0:15104:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40eeaa 00000020:00000080:3.0:1789635449.395025:0:15104:0:(genops.c:885:class_export_put()) final put ffff8d057603e000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1789635449.395360:0:15104:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789635449.395365:0:15104:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789635449.395368:0:15104:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1789635449.395374:0:15104:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789635449.395376:0:15104:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789635449.395405:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789635449.395413:0:15104:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789635449.395426:0:15104:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40ed6f 00000020:00000080:3.0:1789635449.395431:0:15104:0:(genops.c:885:class_export_put()) final put ffff8d0445997800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789635449.395435:0:15104:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789635449.395438:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789635449.395443:0:15104:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789635449.395445:0:15104:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff8d0579bdb380) has no exports 00000020:00000080:3.0:1789635449.395449:0:15104:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40ed68 00000020:00000080:3.0:1789635449.395451:0:15104:0:(genops.c:885:class_export_put()) final put ffff8d056f550800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1789635449.395825:0:15104:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789635449.395830:0:15104:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789635449.395832:0:15104:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1789635449.395836:0:15104:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789635449.395837:0:15104:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789635449.395859:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789635449.395865:0:15104:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1789635449.395874:0:15104:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1789635449.395879:0:15104:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40ebb6 00000020:00000080:3.0:1789635449.395884:0:15104:0:(genops.c:885:class_export_put()) final put ffff8d056f452000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789635449.395888:0:15104:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1789635449.395893:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789635449.395897:0:15104:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789635449.395900:0:15104:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff8d056f5599c0) has no exports 00000020:00000080:3.0:1789635449.395903:0:15104:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40eba8 00000020:00000080:3.0:1789635449.395906:0:15104:0:(genops.c:885:class_export_put()) final put ffff8d056f555800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789635449.396308:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d055862c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1789635449.396319:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0446450000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789635449.396324:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d057603e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789635449.396329:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d057603f000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789635449.396337:0:36:0:(genops.c:885:class_export_put()) final put ffff8d0447657000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789635449.396339:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0447657000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789635449.396344:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789635449.396424:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0445997800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789635449.396438:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d056f550800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789635449.396442:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d056f553800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789635449.396449:0:36:0:(genops.c:885:class_export_put()) final put ffff8d0446451800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789635449.396452:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0446451800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1789635449.396458:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789635449.396495:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d056f452000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1789635449.396500:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d056f555800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789635449.400786:0:15104:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1789635449.400794:0:15104:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789635449.400798:0:15104:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789635449.400806:0:15104:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789635449.400859:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789635449.400871:0:15104:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789635449.400902:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789635449.400905:0:15104:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789635449.400910:0:15104:0:(genops.c:885:class_export_put()) final put ffff8d05501e3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789635449.400914:0:15104:0:(genops.c:844:class_export_destroy()) destroying export ffff8d05501e3000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789635449.400921:0:15104:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789635449.401016:0:15104:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40ea82 00000020:00000080:0.0:1789635449.401022:0:15104:0:(genops.c:885:class_export_put()) final put ffff8d055862b800/lustre-MDD0000_UUID 00000020:01000000:0.0:1789635449.401027:0:15104:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789635449.401031:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789635449.401036:0:15104:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789635449.401040:0:15104:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8d0558613380) has no exports 00000020:00000080:1.0:1789635449.401148:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d056f551800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789635449.401155:0:36:0:(genops.c:885:class_export_put()) final put ffff8d056f554800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789635449.401157:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d056f554800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1789635449.401162:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789635449.401215:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d055862b800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1789635449.401260:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789635449.401265:0:15104:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789635449.401268:0:15104:0:(genops.c:885:class_export_put()) final put ffff8d055862a800/lustre-MDD0000_UUID 00000020:00000080:0.0:1789635449.401271:0:15104:0:(genops.c:844:class_export_destroy()) destroying export ffff8d055862a800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1789635449.401275:0:15104:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1789635449.401316:0:15104:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40ea89 00000020:00000080:0.0:1789635449.401321:0:15104:0:(genops.c:885:class_export_put()) final put ffff8d055862f000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789635449.401339:0:15104:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d0558960000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789635449.401344:0:15104:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d0558960000 3 00000020:01000004:0.0:1789635449.401347:0:15104:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d0558960000 from lustre-MDT0000 00000020:00000080:0.0:1789635449.401368:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789635449.401372:0:15104:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789635449.401374:0:15104:0:(genops.c:885:class_export_put()) final put ffff8d057b5c3800/lustre-MDT0000_UUID 00000020:00000080:0.0:1789635449.401376:0:15104:0:(genops.c:844:class_export_destroy()) destroying export ffff8d057b5c3800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789635449.401382:0:15104:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:1.0:1789635449.401486:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d055862f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1789635449.401798:0:15104:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1789635449.401803:0:15104:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789635449.401806:0:15104:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789635449.401809:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789635449.401811:0:15104:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789635449.401818:0:15104:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8d057b5cf800 6356ed01-c755-4f9e-b839-20feb7c3f098 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789635449.401823:0:15104:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8d055806cd40) has exports, disconnecting them 00000020:00080000:0.0:1789635449.401828:0:15104:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8d057b5cf800), last request at 1789635181 00000020:00000080:0.0:1789635449.401841:0:15104:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40ea27 00000020:00010000:0.0:1789635449.401845:0:15104:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d057b5cf800: total 0 00000100:00080000:0.0:1789635449.401848:0:15104:0:(import.c:65:import_set_state_nolock()) ffff8d057b5ce800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789635449.401857:0:15104:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d057b5cf800): rc 0 00000020:00080000:0.0:1789635449.401861:0:15104:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8d055806cd40) has no exports 00000100:00100000:2.0:1789635449.401970:0:6509:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff8d0549f2d200:6509] 2 exiting: rc = 0 00000020:00010000:1.0:1789635449.402216:0:7456:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d057b5cf800: total 0 00010000:00010000:1.0:1789635449.402255:0:7456:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d057b5cf800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1789635449.402283:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d054139d200/0xb0c3a59caa40f1ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb0c3a59caa40f1b3 expref: 14 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635449.402301:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056e153c00/0xb0c3a59caa40ef6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb0c3a59caa40ef67 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635449.402320:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d05820d2a00/0xb0c3a59caa40eb23 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb0c3a59caa40eb1c expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635449.402336:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d058214ae00/0xb0c3a59caa40eb31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb0c3a59caa40eb2a expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635449.402349:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d054139c400/0xb0c3a59caa40f1c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb0c3a59caa40f1c1 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635449.402359:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d054139ce00/0xb0c3a59caa40ef98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb0c3a59caa40ef91 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635449.402368:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056e153400/0xb0c3a59caa40ef28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb0c3a59caa40ef21 expref: 8 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635449.402378:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d054139d000/0xb0c3a59caa40f1d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb0c3a59caa40f1cf expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635449.402389:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056f6e8c00/0xb0c3a59caa40ef36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb0c3a59caa40ef2f expref: 6 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635449.402399:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056f6e9e00/0xb0c3a59caa40ee48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb0c3a59caa40ee41 expref: 5 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635449.402411:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056f6e8200/0xb0c3a59caa40ef44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb0c3a59caa40ef3d expref: 4 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635449.402421:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056f6e9600/0xb0c3a59caa40ef60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb0c3a59caa40ef59 expref: 3 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635449.402444:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056e153800/0xb0c3a59caa40ef52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb0c3a59caa40ef4b expref: 2 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635449.402454:0:7456:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d057b5cf800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1789635449.402467:0:7456:0:(genops.c:885:class_export_put()) final put ffff8d057b5cf800/6356ed01-c755-4f9e-b839-20feb7c3f098 00010000:00010000:1.0:1789635449.402483:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635449.402486:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635449.402488:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635449.402525:0:6508:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff8d0549f2c800:6508] 1 exiting: rc = 0 00000020:00000080:0.0:1789635449.402950:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d057b5cf800/6356ed01-c755-4f9e-b839-20feb7c3f098 for MGS 00000020:00000080:0.0:1789635449.402982:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d057b5ce800 for MGS 00000100:00100000:0.0:1789635449.404703:0:6506:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff8d0549f2c600:6506] 0 exiting: rc = 1 00000100:00100000:1.0:1789635449.404910:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.404921:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.404928:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.404934:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.404940:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.404945:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.404951:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.404960:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.404967:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.404974:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.404980:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.404986:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.404991:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.404998:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405004:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405010:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405014:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405020:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405026:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405032:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405038:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405044:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405050:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405078:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405083:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405089:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405094:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405100:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405106:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405112:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405116:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405122:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405128:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405133:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405139:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405144:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405150:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405155:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405160:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405165:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405170:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405176:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405181:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405186:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405192:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405197:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405203:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405209:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405214:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405219:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405224:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405229:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405247:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405253:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405262:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405267:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405273:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405278:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405290:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405295:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405300:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405305:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405311:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635449.405316:0:15104:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1789635449.413943:0:15104:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d055860ba20 - data ffff8d0445c931b0/ffff8d056e1a8400 00000020:01000000:1.0:1789635449.414835:0:15104:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d05677b3960 - data ffff8d0551be16c0/ffff8d0549fd9400 00000020:00000080:1.0:1789635449.415991:0:15104:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40ea0b 00000020:00000080:1.0:1789635449.416001:0:15104:0:(genops.c:885:class_export_put()) final put ffff8d054643b800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789635449.416055:0:15104:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d0558960000 from MGS, refs=2 00000020:01000004:1.0:1789635449.416066:0:15104:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d0558960000 2 00000020:01000004:1.0:1789635449.416070:0:15104:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d0558960000 from MGS 00000020:00000080:1.0:1789635449.416093:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789635449.416099:0:15104:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789635449.416101:0:15104:0:(genops.c:885:class_export_put()) final put ffff8d055882c800/MGS 00000020:00000080:1.0:1789635449.416104:0:15104:0:(genops.c:844:class_export_destroy()) destroying export ffff8d055882c800/MGS for MGS 00000020:01000000:1.0:1789635449.416110:0:15104:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789635449.416172:0:15104:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789635449.416175:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789635449.416180:0:15104:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789635449.416187:0:15104:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8d056e01e000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789635449.416193:0:15104:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff8d05747299c0) has exports, disconnecting them 00000020:00080000:1.0:1789635449.416197:0:15104:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8d056e01e000), last request at 1789635181 00000020:00000080:1.0:1789635449.416202:0:15104:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40ead6 00000020:00080000:1.0:1789635449.416211:0:15104:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d056e01e000): rc 0 00000020:00000080:1.0:1789635449.416215:0:15104:0:(genops.c:885:class_export_put()) final put ffff8d056e01e000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789635449.417749:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d054643b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789635449.421511:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d056e01e000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1789635449.440750:0:15104:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1789635449.440759:0:15104:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789635449.440763:0:15104:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789635449.440770:0:15104:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789635449.441018:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789635449.441030:0:15104:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1789635449.441038:0:15104:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d0558960000 1 00000020:00000080:1.0:1789635449.441044:0:15104:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40e9fd 00000020:00000080:1.0:1789635449.441052:0:15104:0:(genops.c:885:class_export_put()) final put ffff8d054c118000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789635449.441077:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d056e01c800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789635449.441084:0:37:0:(genops.c:885:class_export_put()) final put ffff8d056e01e800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789635449.441093:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d056e01e800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1789635449.441105:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:1.0:1789635449.441261:0:15104:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1789635449.441265:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789635449.441271:0:15104:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789635449.441274:0:15104:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8d05580699c0) has no exports 00000020:00000080:0.0:1789635449.444194:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d054c118000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789635449.609999:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789635449.610011:0:15104:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1789635449.610017:0:15104:0:(genops.c:885:class_export_put()) final put ffff8d054b802000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789635449.610862:0:15104:0:(genops.c:844:class_export_destroy()) destroying export ffff8d054b802000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789635449.610872:0:15104:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1789635449.610989:0:15104:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d0558961800 00000020:02000400:0.0:1789635449.611882:0:15104:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1789635450.019755:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789635450.089846:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789635451.046499:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635451.299955:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427374080:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789635451.300025:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635451.300074:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427374080 00000100:00100000:0.0:1789635451.300083:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427374080 00000100:00080000:2.0:1789635451.300116:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789635451.300140:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00080000:1.0:1789635451.300144:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789635451.300149:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1789635451.300153:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427374080:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789635451.300154:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d056f457800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789635451.300165:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 467 00000100:00080000:1.0:1789635451.300171:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789635451.300179:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8d056f457800 using connection 192.168.203.120@tcp/0@lo 00002000:00000024:0.0:1789635451.300186:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789635451.300202:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0447ac0000 x1876568427374336/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789635451.300247:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427374080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635451.300254:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789635451.300257:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1876568427374336:0@lo:38:kworker.0 00000100:00100000:2.0:1789635451.300289:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635451.300379:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427374336 00000100:00100000:0.0:1789635451.300385:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427374336 00000100:00100000:0.0:1789635451.300412:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789635451.300419:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3639:x1876568427374336:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1789635451.300437:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427374208:0@lo:400:kworker.0 00010000:00020000:0.0:1789635451.300439:0:6520:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000400:00000100:1.0:1789635451.300474:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876568427374208 offset 0 length 224: 4 00000100:00100000:1.0:1789635451.300495:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d055896b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427374848:0@lo:400:kworker.0 00000100:00100000:1.0:1789635451.300520:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635451.300540:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789635451.302087:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447659500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876568427374464:0@lo:400:kworker.0 00000100:00100000:1.0:1789635451.302168:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635451.302206:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0558968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1876568427374976:0@lo:400:kworker.0 00000100:00100000:1.0:1789635451.302240:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635451.302288:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d055896b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427374592:0@lo:400:kworker.0 00000100:00100000:1.0:1789635451.302310:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635451.302328:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0558969f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1876568427375104:0@lo:400:kworker.0 00000100:00100000:1.0:1789635451.302348:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635451.302877:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789635451.302887:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d055896bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1876568427374720:0@lo:400:kworker.0 00000100:00100000:1.0:1789635451.302918:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635451.302956:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427374848 00000100:00100000:1.0:1789635451.302964:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427374848 00000100:00100000:1.0:1789635451.303022:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789635451.303032:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d055896ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427374848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635451.303090:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d055896ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427374848:12345-0@lo:400:kworker.0 Request processed in 60us (2569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635451.303097:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789635451.303118:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427374464 00000100:00100000:1.0:1789635451.303122:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427374464 00000100:00100000:1.0:1789635451.303139:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427374976 00000100:00100000:1.0:1789635451.303141:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427374976 00000100:00100000:1.0:1789635451.303148:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427374592 00000100:00100000:1.0:1789635451.303150:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427374592 00000100:00100000:1.0:1789635451.303158:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427375104 00000100:00100000:1.0:1789635451.303159:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427375104 00000100:00100000:1.0:1789635451.303171:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427374720 00000100:00100000:1.0:1789635451.303172:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427374720 00000100:00100000:1.0:1789635451.303184:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1789635451.303198:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876568427375104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635451.303247:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876568427375104:12345-0@lo:400:kworker.0 Request processed in 49us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635451.303253:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1789635451.303266:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1789635451.303272:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876568427374720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635451.303298:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876568427374720:12345-0@lo:400:kworker.0 Request processed in 27us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635451.303304:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1789635451.303316:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789635451.303321:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d055896aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1876568427374464:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789635451.303326:0:6515:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789635451.303350:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d055896aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1876568427374464:12345-0@lo:400:kworker.0 Request processed in 28us (1182us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789635451.303356:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789635451.303367:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789635451.303371:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d055896b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1876568427374976:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789635451.303375:0:6515:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789635451.303396:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d055896b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1876568427374976:12345-0@lo:400:kworker.0 Request processed in 23us (1155us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789635451.303400:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789635451.303411:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789635451.303414:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0558968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1876568427374592:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789635451.303419:0:6515:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789635451.303438:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0558968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1876568427374592:12345-0@lo:400:kworker.0 Request processed in 23us (1127us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789635451.303452:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:1.0:1789635451.303477:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789635451.303482:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789635451.303526:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427374080:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1789635451.304475:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8d055896bb80 x1876568427374720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635451.304485:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3639:x1876568427374336:12345-0@lo:38:kworker.0 Request processed in 4061us (4191us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789635451.304492:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d055896bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1876568427374720:0@lo:400:kworker.0 00000100:00100000:0.0:1789635451.304499:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00080000:1.0:1789635451.304508:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789635451.304513:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8d056e352000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789635451.304517:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789635451.304734:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789635451.304749:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8d056f6f4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789635451.304753:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789635451.304829:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8d056f6f4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789635451.304835:0:3642:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 217 00000100:00080000:0.0:1789635451.304846:0:3642:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8d056f6f4000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1789635451.304876:0:3642:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0543290a80 x1876568427375232/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789635451.304894:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447659500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876568427374464:0@lo:400:kworker.0 00000100:00080000:0.0:1789635451.304909:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789635451.304913:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8d0447569800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789635451.304916:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789635451.304919:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8d0447569800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789635451.304922:0:3642:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 253 00000100:00080000:0.0:1789635451.304927:0:3642:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d0447569800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1789635451.304941:0:3642:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0543291880 x1876568427375360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789635451.304953:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0558968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1876568427374976:0@lo:400:kworker.0 00000100:00100000:0.0:1789635451.305132:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d055896b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427374848:0@lo:400:kworker.0 00000100:00080000:2.0:1789635451.305950:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d056f457800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789635451.305957:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789635451.305960:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1876568427374336:0@lo:38:kworker.0 00000100:00100000:2.0:1789635451.306162:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543290a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876568427375232:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789635451.306243:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635451.306526:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427375232 00000100:00100000:3.0:1789635451.306535:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427375232 00000100:00100000:3.0:1789635451.306575:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789635451.306582:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1876568427375232:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1789635451.306636:0:10094:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789635451.306679:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1876568427375232:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 95us (435us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789635451.306696:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:2.0:1789635451.307190:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d056f6f4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789635451.307203:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789635451.307207:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543290a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876568427375232:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1789635451.309364:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1876568427375360:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1789635451.309431:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635451.314067:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427375360 00000100:00100000:0.0:1789635451.314084:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427375360 00000100:00100000:0.0:1789635451.314186:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789635451.314194:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1876568427375360:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1789635451.314216:0:9526:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789635451.314586:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1876568427375360:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 154us (4916us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789635451.314613:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:0.0:1789635451.314662:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d0447569800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789635451.314667:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789635451.314671:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1876568427375360:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1789635451.339754:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8d056e352000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789635451.339770:0:3640:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 233 00000100:00080000:1.0:1789635451.339787:0:3640:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d056e352000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1789635451.343044:0:3640:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d044859ea00 x1876568427375488/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789635451.343087:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d055896b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427374592:0@lo:400:kworker.0 00010000:00080000:1.0:1789635451.343120:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8d0558969f80 x1876568427375104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635451.343133:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0558969f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1876568427375104:0@lo:400:kworker.0 00000100:00100000:0.0:1789635451.343181:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1876568427375488:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1789635451.343264:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635451.343332:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427375488 00000100:00100000:1.0:1789635451.343340:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427375488 00000100:00100000:1.0:1789635451.343395:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789635451.343402:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1876568427375488:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1789635451.343432:0:10094:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789635451.343489:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1876568427375488:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 86us (225us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789635451.343498:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:0.0:1789635451.343644:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d056e352000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789635451.343650:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789635451.343653:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1876568427375488:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:1.0:1789635452.067852:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635452.840172:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789635452.840197:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427375616:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789635452.840285:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635452.840461:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427375616 00000100:00100000:3.0:1789635452.840471:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427375616 00000100:00100000:3.0:1789635452.840528:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789635452.840539:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543292300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427375616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789635452.840571:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789635452.840663:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543292300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427375616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 125us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635452.840670:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789635452.841813:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427375616:0@lo:13:osp-pre-0-1.0 00000020:01000004:3.0:1789635453.085236:0:15305:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00010000:00010000:0.0:1789635453.098330:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789635453.122057:0:15305:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1789635453.122114:0:15305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2800/0xb0c3a59caa40ef59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ef60 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635453.122131:0:15305:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2800/0xb0c3a59caa40ef59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ef60 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635453.122139:0:15305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2800/0xb0c3a59caa40ef59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xb0c3a59caa40ef60 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635453.122147:0:15305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2800/0xb0c3a59caa40ef59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xb0c3a59caa40ef60 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635453.122174:0:15305:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789635453.122180:0:15305:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789635453.122204:0:15305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789635453.122234:0:15305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789635453.122241:0:15305:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789635453.122248:0:15305:0:(import.c:65:import_set_state_nolock()) ffff8d056f6f4000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789635453.122253:0:15305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789635453.122255:0:15305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789635453.122258:0:15305:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789635453.122695:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635453.122703:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2800/0xb0c3a59caa40ef59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xb0c3a59caa40ef60 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635453.122711:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a2800 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:1.0:1789635453.122715:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2800/0xb0c3a59caa40ef59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xb0c3a59caa40ef60 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635453.122724:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2800/0xb0c3a59caa40ef59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xb0c3a59caa40ef60 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789635453.122731:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2800/0xb0c3a59caa40ef59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xb0c3a59caa40ef60 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635453.122738:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789635453.122740:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789635453.122743:0:6502:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789635453.122781:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2800/0xb0c3a59caa40ef59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb0c3a59caa40ef60 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635453.122788:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789635453.122825:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2800/0xb0c3a59caa40ef59 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb0c3a59caa40ef60 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635453.122832:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2800/0xb0c3a59caa40ef59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb0c3a59caa40ef60 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635453.122853:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635453.122855:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635453.122857:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635453.122912:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789635453.122930:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427375744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789635453.123004:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635453.123161:0:13189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427375744 00000100:00100000:1.0:1789635453.123169:0:13189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427375744 00000100:00100000:1.0:1789635453.123223:0:13189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789635453.123230:0:13189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3643:x1876568427375744:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789635453.123237:0:13189:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789635453 with bad export cookie 12737206263423756839 00010000:00010000:3.0:1789635453.126731:0:15305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05820d3e00/0xb0c3a59caa40ef67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ef6e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635453.126750:0:15305:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05820d3e00/0xb0c3a59caa40ef67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ef6e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635453.126759:0:15305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05820d3e00/0xb0c3a59caa40ef67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xb0c3a59caa40ef6e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635453.126766:0:15305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff8d05820d3e00/0xb0c3a59caa40ef67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xb0c3a59caa40ef6e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635453.126853:0:15305:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789635453.126859:0:15305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2a00/0xb0c3a59caa40ee41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ee48 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635453.126865:0:15305:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2a00/0xb0c3a59caa40ee41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ee48 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635453.126871:0:15305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2a00/0xb0c3a59caa40ee41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb0c3a59caa40ee48 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635453.126878:0:15305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2a00/0xb0c3a59caa40ee41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb0c3a59caa40ee48 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635453.132701:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789635453.132716:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d05820d3e00/0xb0c3a59caa40ef67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xb0c3a59caa40ef6e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635453.132730:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05820d3e00 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:0.0:1789635453.132735:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d05820d3e00/0xb0c3a59caa40ef67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xb0c3a59caa40ef6e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635453.132738:0:15305:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789635453.132746:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d05820d3e00/0xb0c3a59caa40ef67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xb0c3a59caa40ef6e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789635453.132780:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d05820d3e00/0xb0c3a59caa40ef67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xb0c3a59caa40ef6e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635453.132786:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789635453.132788:0:7456:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:3.0:1789635453.133150:0:15305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3200/0xb0c3a59caa40f1cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40f1d6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635453.133163:0:15305:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3200/0xb0c3a59caa40f1cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40f1d6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635453.133170:0:15305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3200/0xb0c3a59caa40f1cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb0c3a59caa40f1d6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635453.133178:0:15305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3200/0xb0c3a59caa40f1cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb0c3a59caa40f1d6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635453.133251:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635453.133261:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2a00/0xb0c3a59caa40ee41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb0c3a59caa40ee48 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635453.133268:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a2a00 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:2.0:1789635453.133271:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2a00/0xb0c3a59caa40ee41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb0c3a59caa40ee48 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635453.133278:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2a00/0xb0c3a59caa40ee41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb0c3a59caa40ee48 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789635453.133284:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2a00/0xb0c3a59caa40ee41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb0c3a59caa40ee48 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635453.133298:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789635453.133300:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789635453.133302:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789635453.133347:0:15305:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789635453.133356:0:15305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d0540030400/0xb0c3a59caa40eb2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40eb31 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635453.133363:0:15305:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d0540030400/0xb0c3a59caa40eb2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40eb31 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635453.133369:0:15305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d0540030400/0xb0c3a59caa40eb2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb0c3a59caa40eb31 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635453.133376:0:15305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff8d0540030400/0xb0c3a59caa40eb2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb0c3a59caa40eb31 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635453.133384:0:15305:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789635453.133388:0:15305:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:3.0:1789635453.133398:0:15305:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1789635453.133445:0:15305:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1789635453.133450:0:15305:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1789635453.133455:0:15305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789635453.133461:0:15305:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1789635453.133467:0:15305:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff8d044756d000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789635453.133474:0:15305:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff8d0446450800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789635453.133479:0:15305:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff8d057472b380) has exports, disconnecting them 00000020:00080000:3.0:1789635453.133484:0:15305:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8d044756d000), last request at 1789635451 00000020:00000080:3.0:1789635453.133491:0:15305:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40ee09 00000100:00080000:3.0:1789635453.133508:0:15305:0:(import.c:65:import_set_state_nolock()) ffff8d044756f800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789635453.134647:0:15305:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d044756d000): rc 0 00000020:00000080:3.0:1789635453.134654:0:15305:0:(genops.c:885:class_export_put()) final put ffff8d044756d000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1789635453.134674:0:15305:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8d0446450800), last request at 1789635451 00000020:00000080:3.0:1789635453.134681:0:15305:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40ece3 00000100:00080000:3.0:1789635453.134692:0:15305:0:(import.c:65:import_set_state_nolock()) ffff8d0446454800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789635453.134704:0:15305:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d0446450800): rc 0 00000020:00000080:3.0:1789635453.134706:0:15305:0:(genops.c:885:class_export_put()) final put ffff8d0446450800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1789635453.134713:0:15305:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa6bb41e13ae0 00000100:00080000:3.0:1789635453.134734:0:15305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789635453.134744:0:15305:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8d05759d2a00 x1876568427373824/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789635465 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635453.134761:0:15305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:1.0:1789635453.136382:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00000080:1.0:1789635453.136420:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d044756d000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1789635453.136474:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0446450800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1789635453.136494:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d044756f800 for lustre-MDT0001 00000020:00000080:1.0:1789635453.136500:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d0446454800 for lustre-MDT0001 00000100:00100000:1.0:1789635453.136522:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427373824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789635453.136782:0:13189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3643:x1876568427375744:12345-0@lo:103:ldlm_bl.0 Request processed in 13549us (13776us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789635453.136793:0:13189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:1.0:1789635453.136877:0:15306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635453.136886:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3200/0xb0c3a59caa40f1cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb0c3a59caa40f1d6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635453.136896:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3200 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:1.0:1789635453.136900:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3200/0xb0c3a59caa40f1cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb0c3a59caa40f1d6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635453.136909:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3200/0xb0c3a59caa40f1cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb0c3a59caa40f1d6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789635453.136924:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3200/0xb0c3a59caa40f1cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb0c3a59caa40f1d6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635453.136930:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789635453.136933:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789635453.136936:0:6502:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789635453.136967:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3200/0xb0c3a59caa40f1cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb0c3a59caa40f1d6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635453.136973:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789635453.136998:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3200/0xb0c3a59caa40f1cf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb0c3a59caa40f1d6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635453.137005:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3200/0xb0c3a59caa40f1cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb0c3a59caa40f1d6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635453.137017:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635453.137019:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635453.137021:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789635453.137396:0:15305:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789635453.137402:0:15305:0:(import.c:65:import_set_state_nolock()) ffff8d056f457800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:0.0:1789635453.137500:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789635453.137516:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427375872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789635453.137562:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789635453.137634:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d05820d3e00/0xb0c3a59caa40ef67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb0c3a59caa40ef6e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635453.137641:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789635453.137656:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d05820d3e00/0xb0c3a59caa40ef67 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb0c3a59caa40ef6e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635453.137663:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d05820d3e00/0xb0c3a59caa40ef67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb0c3a59caa40ef6e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635453.137681:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543290e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427376000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789635453.137706:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635453.137736:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427375872 00000100:00100000:0.0:1789635453.137743:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427375872 00000100:00100000:0.0:1789635453.137770:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427376000 00000100:00100000:0.0:1789635453.137773:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427376000 00000100:00100000:0.0:1789635453.137790:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789635453.137797:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543291f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3642:x1876568427375872:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789635453.137803:0:6499:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789635453 with bad export cookie 12737206263423756839 00000100:00100000:0.0:1789635453.137838:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543291f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3642:x1876568427375872:12345-0@lo:103:ldlm_bl.0 Request processed in 40us (275us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789635453.137853:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789635453.137867:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789635453.137872:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057b402c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3640:x1876568427376000:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789635453.137876:0:6499:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789635453 with bad export cookie 12737206263423756839 00000100:00100000:0.0:1789635453.137909:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057b402c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3640:x1876568427376000:12345-0@lo:103:ldlm_bl.0 Request processed in 35us (201us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789635453.137915:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1789635453.137973:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.120@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789635453.137977:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8d057b5c0800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1789635453.137980:0:3642:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.120@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1789635453.138174:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.120@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:1.0:1789635453.144705:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635453.144712:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635453.144714:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635453.144806:0:15307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635453.144818:0:15306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d0540030400/0xb0c3a59caa40eb2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb0c3a59caa40eb31 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635453.144831:0:15306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0540030400 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:1.0:1789635453.144836:0:15306:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d0540030400/0xb0c3a59caa40eb2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb0c3a59caa40eb31 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635453.144871:0:15306:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d0540030400/0xb0c3a59caa40eb2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb0c3a59caa40eb31 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789635453.144878:0:15306:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d0540030400/0xb0c3a59caa40eb2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb0c3a59caa40eb31 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635453.144886:0:15306:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1789635453.144889:0:15306:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1789635453.144894:0:15306:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:0.0:1789635453.147707:0:3642:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.120@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1789635453.147713:0:3642:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789635453.147724:0:3642:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d0447ac1180 x1876568427374208/t0(0) o400->MGC192.168.203.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789635467 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635453.147739:0:3642:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d044859f100 x1876568427375744/t0(0) o103->MGC192.168.203.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789635469 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635453.147750:0:3642:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d044859ea00 x1876568427375872/t0(0) o103->MGC192.168.203.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789635469 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635453.147759:0:3642:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d0543290e00 x1876568427376000/t0(0) o103->MGC192.168.203.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789635469 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789635453.147768:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789635453.147771:0:3642:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789635453.147772:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789635453.149727:0:3643:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8d057b5c0800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1789635453.149898:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:3643:1876568427375744:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789635453.150076:0:15305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789635453.150081:0:15305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 3 00000004:00080000:3.0:1789635453.150102:0:15305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789635453.150183:0:15305:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789635453.150224:0:15305:0:(import.c:65:import_set_state_nolock()) ffff8d05746d5000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789635453.150248:0:15305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789635453.150251:0:15305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:3.0:1789635453.150259:0:15305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789635453.150322:0:15305:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789635453.150331:0:15305:0:(import.c:65:import_set_state_nolock()) ffff8d0447652800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789635453.150355:0:15305:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8d057472b380) has no exports 00010000:00010000:2.0:1789635453.150547:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2a00/0xb0c3a59caa40ee41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb0c3a59caa40ee48 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635453.150558:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789635453.150577:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2a00/0xb0c3a59caa40ee41 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb0c3a59caa40ee48 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635453.150584:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2a00/0xb0c3a59caa40ee41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb0c3a59caa40ee48 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635453.150638:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6356ed01-c755-4f9e-b839-20feb7c3f098:0:1876568427376384:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789635453.150657:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635453.150659:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635453.150660:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635453.150954:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1876568427376128:0@lo:9:umount.0 00000100:00100000:3.0:1789635453.151097:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635453.151132:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1876568427376256:0@lo:9:umount.0 00000100:00100000:3.0:1789635453.151155:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635453.151220:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543290e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6356ed01-c755-4f9e-b839-20feb7c3f098:3640:1876568427376000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789635453.151258:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427376128 00000100:00100000:3.0:1789635453.151266:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427376128 00000100:00100000:3.0:1789635453.151318:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427376256 00000100:00100000:3.0:1789635453.151321:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427376256 00000100:00100000:3.0:1789635453.151951:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789635453.151965:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e015500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876568427376128:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789635453.152354:0:8431:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40ed30 00000100:00080000:3.0:1789635453.152365:0:8431:0:(import.c:65:import_set_state_nolock()) ffff8d0445995000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789635453.152414:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00080000:1.0:1789635453.152489:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789635453.152493:0:6510:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789635453.152549:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8d057b5c0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789635453.152555:0:3642:0:(import.c:545:import_select_connection()) MGC192.168.203.120@tcp: connect to NID 0@lo last attempt 200 00000100:00080000:0.0:1789635453.152565:0:3642:0:(import.c:666:import_select_connection()) MGC192.168.203.120@tcp: import ffff8d057b5c0800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1789635453.152621:0:3642:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0543292680 x1876568427376512/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789635453.152666:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427374208:0@lo:400:kworker.0 00000100:00100000:3.0:1789635453.152672:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e015500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3639:x1876568427376128:12345-0@lo:9:umount.0 Request processed in 712us (1575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635453.152685:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6356ed01-c755-4f9e-b839-20feb7c3f098:3642:1876568427375872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789635453.153677:0:10116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789635453.153696:0:10116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e017b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876568427376256:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789635453.153720:0:10116:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40ee72 00000100:00080000:2.0:1789635453.153726:0:10116:0:(import.c:65:import_set_state_nolock()) ffff8d0549fb0800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789635453.153781:0:10116:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1789635453.153988:0:10116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e017b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3639:x1876568427376256:12345-0@lo:9:umount.0 Request processed in 301us (2832us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635453.154131:0:10116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:2.0:1789635453.154160:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635453.154669:0:15307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635453.154673:0:15307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635453.155175:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635453.155195:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789635453.155239:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6356ed01-c755-4f9e-b839-20feb7c3f098:3639:1876568427376512:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1789635453.155281:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876568427376512 offset 0 length 520: 4 00000100:00080000:3.0:1789635453.155335:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d05746d5000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789635453.155385:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789635453.155443:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789635453.155448:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1876568427376128:0@lo:9:umount.0 00000100:00080000:3.0:1789635453.155463:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d0447652800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789635453.155471:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789635453.155473:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789635453.155475:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1876568427376256:0@lo:9:umount.0 00010000:00010000:1.0:1789635453.155821:0:15306:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d0540030400/0xb0c3a59caa40eb2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb0c3a59caa40eb31 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635453.155832:0:15306:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789635453.155863:0:15306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d0540030400/0xb0c3a59caa40eb2a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb0c3a59caa40eb31 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635453.155871:0:15306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d0540030400/0xb0c3a59caa40eb2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb0c3a59caa40eb31 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635453.155889:0:15306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635453.155891:0:15306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635453.155893:0:15306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635453.155897:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789635453.155907:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543295500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6356ed01-c755-4f9e-b839-20feb7c3f098:0:1876568427376640:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1789635453.159221:0:15305:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8d057472b380) has no exports 00000020:01000000:3.0:1789635453.225160:0:15305:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d04477874e0 - data ffff8d057b286288/ffff8d057591a800 00000020:01000000:3.0:1789635453.225339:0:15305:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d056f535960 - data ffff8d057b0b1870/ffff8d056f323400 00000001:00000004:3.0:1789635453.237865:0:15305:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:0.0:1789635453.291350:0:15305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789635453.291358:0:15305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1789635453.291366:0:15305:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1789635453.295200:0:15305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789635453.295222:0:15305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 4 00000004:00080000:0.0:1789635453.295282:0:15305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789635453.295292:0:15305:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789635453.295985:0:8859:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789635453.295990:0:8859:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:2.0:1789635453.296014:0:8859:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1789635453.300108:0:15305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789635453.300115:0:15305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:0.0:1789635453.300158:0:15305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789635453.300161:0:15305:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789635453.300496:0:9888:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789635453.300500:0:9888:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:2.0:1789635453.300519:0:9888:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1789635453.302127:0:15305:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40eb4d 00000020:00000080:0.0:1789635453.302138:0:15305:0:(genops.c:885:class_export_put()) final put ffff8d056e353800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789635453.302348:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d056e353800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789635453.306313:0:15305:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40eb62 00000020:00000080:0.0:1789635453.306328:0:15305:0:(genops.c:885:class_export_put()) final put ffff8d056e350800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1789635453.306349:0:15305:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1789635453.306354:0:15305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789635453.306362:0:15305:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789635453.306366:0:15305:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff8d057472cd40) has no exports 00000020:00000080:2.0:1789635453.306379:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d056e350800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:0.0:1789635453.306543:0:15305:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789635453.306551:0:15305:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40ee6b 00000020:00000080:0.0:1789635453.306556:0:15305:0:(genops.c:885:class_export_put()) final put ffff8d0447655800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1789635453.306568:0:15305:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1789635453.306571:0:15305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789635453.306578:0:15305:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789635453.306580:0:15305:0:(genops.c:1557:class_disconnect_exports()) OBD device 27 (ffff8d04478a3380) has no exports 00000020:00000080:0.0:1789635453.306585:0:15305:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40ee64 00000020:00000080:0.0:1789635453.306615:0:15305:0:(genops.c:885:class_export_put()) final put ffff8d0447651000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789635453.306666:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0447655800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1789635453.308117:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0447651000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789635453.308639:0:15305:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1789635453.308643:0:15305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789635453.308647:0:15305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:0.0:1789635453.308654:0:15305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789635453.308656:0:15305:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789635453.308721:0:15305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789635453.308733:0:15305:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789635453.308740:0:15305:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40ed29 00000020:00000080:0.0:1789635453.308754:0:15305:0:(genops.c:885:class_export_put()) final put ffff8d04465c0000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1789635453.308760:0:15305:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1789635453.308764:0:15305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789635453.308769:0:15305:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789635453.308773:0:15305:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff8d05759219c0) has no exports 00000020:00000080:0.0:1789635453.308778:0:15305:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40ed22 00000020:00000080:0.0:1789635453.308781:0:15305:0:(genops.c:885:class_export_put()) final put ffff8d0445987800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789635453.308865:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d0447652800 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1789635453.308882:0:36:0:(genops.c:885:class_export_put()) final put ffff8d0447652000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789635453.308885:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0447652000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1789635453.308889:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789635453.309149:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d04465c0000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1789635453.309154:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0445987800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789635453.309277:0:15305:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1789635453.309281:0:15305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789635453.309298:0:15305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 5 00000004:00080000:0.0:1789635453.309303:0:15305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789635453.309305:0:15305:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789635453.309332:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d05746d5000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789635453.309338:0:15305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789635453.309343:0:15305:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789635453.309347:0:15305:0:(genops.c:885:class_export_put()) final put ffff8d0445983000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789635453.309349:0:15305:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0445983000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1789635453.309353:0:15305:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1789635453.309405:0:15305:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1789635453.309411:0:15305:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40ebaf 00000020:00000080:0.0:1789635453.309415:0:15305:0:(genops.c:885:class_export_put()) final put ffff8d056e356000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1789635453.309428:0:15305:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1789635453.309431:0:15305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789635453.309439:0:15305:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789635453.309442:0:15305:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8d057ae4cd40) has no exports 00000020:00000080:0.0:1789635453.309445:0:15305:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40eb9a 00000020:00000080:0.0:1789635453.309448:0:15305:0:(genops.c:885:class_export_put()) final put ffff8d056f455000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789635453.309669:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d056e356000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1789635453.309675:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d056f455000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1789635453.312158:0:15305:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1789635453.312166:0:15305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789635453.312171:0:15305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1789635453.312178:0:15305:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789635453.312241:0:15305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789635453.312251:0:15305:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789635453.312277:0:15305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789635453.312280:0:15305:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789635453.312285:0:15305:0:(genops.c:885:class_export_put()) final put ffff8d056e0f9000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789635453.312289:0:15305:0:(genops.c:844:class_export_destroy()) destroying export ffff8d056e0f9000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1789635453.312297:0:15305:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789635453.312468:0:15305:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40eb69 00000020:00000080:2.0:1789635453.312476:0:15305:0:(genops.c:885:class_export_put()) final put ffff8d056e352800/lustre-MDD0001_UUID 00000020:01000000:2.0:1789635453.312480:0:15305:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1789635453.312485:0:15305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789635453.312490:0:15305:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789635453.312494:0:15305:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff8d0574728000) has no exports 00000020:00000080:2.0:1789635453.312511:0:15305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789635453.312514:0:15305:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1789635453.312518:0:15305:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40eb70 00000020:00000080:2.0:1789635453.312521:0:15305:0:(genops.c:885:class_export_put()) final put ffff8d056e351000/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1789635453.312540:0:15305:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d0550107000 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1789635453.312544:0:15305:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d0550107000 2 00000020:01000004:2.0:1789635453.312546:0:15305:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d0550107000 from lustre-MDT0001 00000020:00000080:2.0:1789635453.312562:0:15305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789635453.312565:0:15305:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1789635453.312567:0:15305:0:(genops.c:885:class_export_put()) final put ffff8d056e357000/lustre-MDT0001_UUID 00000020:00000080:2.0:1789635453.312569:0:15305:0:(genops.c:844:class_export_destroy()) destroying export ffff8d056e357000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1789635453.312575:0:15305:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1789635453.312632:0:15305:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1789635453.312636:0:15305:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1789635453.312639:0:15305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789635453.312642:0:15305:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789635453.312648:0:15305:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8d056f6f3000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789635453.312653:0:15305:0:(genops.c:1552:class_disconnect_exports()) OBD device 15 (ffff8d0558068000) has exports, disconnecting them 00000020:00080000:2.0:1789635453.312657:0:15305:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8d056f6f3000), last request at 1789635198 00000020:00000080:2.0:1789635453.312660:0:15305:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40ec03 00000020:00080000:2.0:1789635453.312671:0:15305:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d056f6f3000): rc 0 00000020:00000080:2.0:1789635453.312674:0:15305:0:(genops.c:885:class_export_put()) final put ffff8d056f6f3000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1789635453.313942:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d056f457800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1789635453.313963:0:36:0:(genops.c:885:class_export_put()) final put ffff8d05746d7800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789635453.313966:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d05746d7800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1789635453.313978:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789635453.314116:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d056e352800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1789635453.314124:0:36:0:(genops.c:885:class_export_put()) final put ffff8d056e353000/lustre-MDD0001_UUID 00000020:00000080:3.0:1789635453.314126:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d056e353000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1789635453.314129:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1789635453.314307:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d056e351000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789635453.314312:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d056f6f3000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1789635453.314368:0:15305:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1789635453.314372:0:15305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789635453.314376:0:15305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789635453.314381:0:15305:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789635453.314401:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d056f6f4000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1789635453.314842:0:15305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789635453.314853:0:15305:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1789635453.314858:0:15305:0:(genops.c:885:class_export_put()) final put ffff8d05746d7000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1789635453.314860:0:15305:0:(genops.c:844:class_export_destroy()) destroying export ffff8d05746d7000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1789635453.314864:0:15305:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1789635453.314898:0:15305:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d0550107000 1 00000020:00000080:3.0:1789635453.314903:0:15305:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40eb00 00000020:00000080:3.0:1789635453.314908:0:15305:0:(genops.c:885:class_export_put()) final put ffff8d056e0fc000/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1789635453.314917:0:15305:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1789635453.314925:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d056e0fc000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789635453.314934:0:15305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789635453.314939:0:15305:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789635453.314942:0:15305:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8d055806b380) has no exports 00000020:00000080:2.0:1789635453.423180:0:15305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789635453.423195:0:15305:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1789635453.423200:0:15305:0:(genops.c:885:class_export_put()) final put ffff8d0550104000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789635453.423216:0:15305:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0550104000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1789635453.423228:0:15305:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1789635453.423334:0:15305:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d0550103800 00000020:01000000:2.0:1789635453.423353:0:15305:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1789635453.423357:0:15305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789635453.423361:0:15305:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789635453.423365:0:15305:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8d057ae48000) has no exports 00000100:00100000:2.0:1789635453.423474:0:6516:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff8d0545268a00:6516] 2 exiting: rc = 0 00000100:00100000:0.0:1789635453.423944:0:9526:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff8d0446ea0e00:9526] 3 exiting: rc = 0 00000100:00100000:0.0:1789635453.424024:0:6515:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff8d0545268c00:6515] 1 exiting: rc = 0 00000100:00100000:1.0:1789635453.424353:0:6514:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff8d054341be00:6514] 0 exiting: rc = 1 00000100:00100000:1.0:1789635453.424425:0:10094:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff8d057b91ba00:10094] 4 exiting: rc = 0 00000100:00100000:0.0:1789635453.424587:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424631:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424638:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424644:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424649:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424665:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424671:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424677:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424682:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424687:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424693:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424697:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424703:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424708:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424714:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424719:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424724:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424730:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424734:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424739:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424744:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424748:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424763:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424777:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424784:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424789:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424795:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424800:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424818:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424824:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424829:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424834:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424838:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424843:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424847:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424852:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424857:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424861:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424866:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424871:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424876:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424881:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424886:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424901:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424908:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424914:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424919:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424924:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424929:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424934:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424939:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424945:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424951:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424957:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424961:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424968:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424973:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424978:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424984:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.424989:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.425222:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.425228:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.425234:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.425246:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635453.430700:0:6518:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8d0548df8400:6518] 1 exiting: rc = 0 00000100:00100000:1.0:1789635453.432828:0:6517:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8d057b676c00:6517] 0 exiting: rc = 1 00000100:00100000:0.0:1789635453.435307:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435318:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435324:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435329:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435334:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435341:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435348:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435354:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435359:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435365:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435370:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435376:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435382:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435387:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435392:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435397:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435402:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435406:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435411:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435417:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435422:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435428:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435433:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435438:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435444:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435449:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435455:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435460:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435466:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435471:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435476:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435482:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435488:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435493:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435510:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435515:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435520:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435525:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435530:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435535:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435540:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435545:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435550:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435555:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435560:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435565:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435571:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435576:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435581:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435586:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435592:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435614:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435619:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435625:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435630:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435635:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435641:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435646:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435651:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435666:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435672:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435677:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435683:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.435688:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.436525:0:6520:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff8d0572c83e00:6520] 1 exiting: rc = 0 00000100:00100000:3.0:1789635453.437016:0:7800:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff8d0551646400:7800] 2 exiting: rc = 0 00000100:00100000:3.0:1789635453.437089:0:6519:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff8d054c263000:6519] 0 exiting: rc = 1 00000100:00100000:1.0:1789635453.437708:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.437717:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.437739:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.437745:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.437750:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.437767:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.437773:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.437779:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.437798:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.437806:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.437811:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.437817:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.437824:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.437829:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.437834:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.437840:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.437845:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.437852:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.437858:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.437864:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.437886:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438122:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438130:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438136:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438142:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438148:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438155:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438162:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438170:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438176:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438181:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438187:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438218:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438225:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438231:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438237:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438242:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438257:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438262:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438268:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438274:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438280:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438295:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438301:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438322:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438328:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438334:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438340:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438346:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438351:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438357:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438363:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438369:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438374:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438380:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438386:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438404:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438411:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438416:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438422:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438427:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438432:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438437:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.438444:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635453.451282:0:6521:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8d0572c82e00:6521] 0 exiting: rc = 1 00000100:00100000:2.0:1789635453.451432:0:6522:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8d0572c82400:6522] 1 exiting: rc = 0 00000100:00100000:1.0:1789635453.451542:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451551:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451556:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451561:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451567:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451571:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451577:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451581:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451629:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451636:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451641:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451646:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451660:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451668:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451673:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451679:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451683:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451688:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451692:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451697:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451702:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451707:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451711:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451716:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451720:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451724:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451729:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451734:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451738:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451743:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451748:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451884:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451953:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451962:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451967:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451972:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451977:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451981:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.451987:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.452053:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.452060:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.452064:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.452069:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.452082:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.452087:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.452094:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.452098:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.452103:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.452107:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.452111:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.452116:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.452121:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.452125:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.452130:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.452135:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.452139:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.452144:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.452149:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.452154:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.452159:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.452163:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.452168:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.452173:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.452178:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635453.452578:0:6523:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8d0572c82200:6523] 0 exiting: rc = 1 00000100:00100000:0.0:1789635453.452986:0:6524:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8d0572c83400:6524] 1 exiting: rc = 0 00000100:00100000:1.0:1789635453.453231:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453237:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453241:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453246:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453251:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453256:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453260:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453265:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453270:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453274:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453278:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453292:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453297:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453302:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453316:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453321:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453325:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453329:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453334:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453338:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453342:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453346:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453350:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453355:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453359:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453363:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453367:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453373:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453377:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453381:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453387:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453391:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453397:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453402:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453407:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453413:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453418:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453422:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453428:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453433:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453438:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453442:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453447:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453452:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453456:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453461:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453465:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453470:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453474:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453485:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453490:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453494:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453499:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453504:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453509:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453513:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453518:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453523:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453528:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453532:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453538:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453542:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453547:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.453552:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635453.454524:0:6525:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff8d0572c82800:6525] 0 exiting: rc = 1 00000100:00100000:0.0:1789635453.455248:0:6526:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff8d0572c82000:6526] 1 exiting: rc = 0 00000100:00100000:1.0:1789635453.455419:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455426:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455432:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455436:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455441:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455446:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455452:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455457:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455463:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455468:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455473:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455478:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455483:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455488:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455493:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455499:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455504:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455509:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455514:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455520:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455536:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455541:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455546:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455551:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455556:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455561:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455566:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455571:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455576:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455580:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455585:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455590:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455732:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455740:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455745:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455819:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455828:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455834:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455839:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455844:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455849:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455854:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455860:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455865:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455870:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455875:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455880:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455886:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455891:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455962:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455967:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455972:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455976:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455981:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.455986:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.456054:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.456058:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.456063:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.456068:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.456073:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.456077:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.456082:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.456087:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.456092:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.457374:0:6528:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff8d0549fdc800:6528] 1 exiting: rc = 0 00000100:00100000:1.0:1789635453.457553:0:6529:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff8d0549fdd200:6529] 2 exiting: rc = 0 00000100:00100000:2.0:1789635453.458000:0:6527:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff8d0549fdc000:6527] 0 exiting: rc = 1 00000100:00100000:1.0:1789635453.458220:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458253:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458260:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458266:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458272:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458278:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458296:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458304:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458310:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458316:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458323:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458328:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458333:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458339:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458344:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458349:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458355:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458361:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458366:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458371:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458376:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458381:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458387:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458393:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458411:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458432:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458439:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458445:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458451:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458457:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458463:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458468:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458474:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458480:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458487:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458493:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458499:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458504:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458510:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458516:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458522:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458529:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458534:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458540:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458546:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458553:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458560:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458566:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458573:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458624:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458634:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458640:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458645:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458650:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458665:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458673:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458680:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458686:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458692:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458708:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458715:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458721:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458727:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635453.458733:0:15305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789635453.467556:0:15305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789635453.467569:0:15305:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1789635453.467575:0:15305:0:(genops.c:885:class_export_put()) final put ffff8d057b5c4800/MDS_uuid 00000020:00000080:1.0:1789635453.467579:0:15305:0:(genops.c:844:class_export_destroy()) destroying export ffff8d057b5c4800/MDS_uuid for MDS 00000020:01000000:1.0:1789635453.467585:0:15305:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1789635453.467986:0:15305:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1789635454.119402:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635455.139750:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635456.166494:0:15307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789635456.422357:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6356ed01-c755-4f9e-b839-20feb7c3f098->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789635456.422367:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6356ed01-c755-4f9e-b839-20feb7c3f098->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789635456.422370:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789635456.422383:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789635456.422387:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d056e352000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789635456.422395:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 470 00000100:00080000:0.0:1789635456.422401:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789635456.422414:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d056e352000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1789635456.422451:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0543291880 x1876568427376768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789635456.422487:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789635456.422490:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789635456.422492:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d0447569800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789635456.422495:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 469 00000100:00080000:0.0:1789635456.422497:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789635456.422502:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d0447569800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1789635456.422512:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0543291f80 x1876568427377024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789635456.422544:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789635456.422561:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543291c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1876568427377152:0@lo:400:kworker.0 00000400:00000100:0.0:1789635456.422629:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876568427377152 offset 0 length 224: 4 00000100:00100000:3.0:1789635456.424407:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1876568427376768:0@lo:38:kworker.0 00000400:00000100:3.0:1789635456.424454:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876568427376768 offset 0 length 520: 4 00000100:00100000:3.0:1789635456.424479:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543291f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1876568427377024:0@lo:38:kworker.0 00000400:00000100:3.0:1789635456.424495:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876568427377024 offset 0 length 520: 4 00000100:00100000:3.0:1789635456.424535:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427376896:0@lo:400:kworker.0 00000400:00000100:3.0:1789635456.424554:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876568427376896 offset 0 length 224: 4 00000020:01000004:3.0:1789635457.062112:0:15509:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789635457.083803:0:15509:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1789635457.083860:0:15509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9c00/0xb0c3a59caa40ef3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ef44 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635457.083875:0:15509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9c00/0xb0c3a59caa40ef3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ef44 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635457.083883:0:15509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9c00/0xb0c3a59caa40ef3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xb0c3a59caa40ef44 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635457.083889:0:15509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9c00/0xb0c3a59caa40ef3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xb0c3a59caa40ef44 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635457.083911:0:15509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789635457.083916:0:15509:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789635457.083940:0:15509:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789635457.083952:0:15509:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d0543291880 x1876568427376768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789635471 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635457.083965:0:15509:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789635457.083995:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d056e352000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789635457.083999:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:3.0:1789635457.084003:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1876568427376768:0@lo:38:kworker.0 00000100:00080000:3.0:1789635457.084032:0:15509:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789635457.084037:0:15509:0:(import.c:65:import_set_state_nolock()) ffff8d056e352000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789635457.084042:0:15509:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789635457.084043:0:15509:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789635457.084046:0:15509:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789635457.084310:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635457.084319:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9c00/0xb0c3a59caa40ef3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xb0c3a59caa40ef44 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635457.084327:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056f6e9c00 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:1.0:1789635457.084331:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9c00/0xb0c3a59caa40ef3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xb0c3a59caa40ef44 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635457.084340:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9c00/0xb0c3a59caa40ef3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xb0c3a59caa40ef44 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789635457.084348:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9c00/0xb0c3a59caa40ef3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xb0c3a59caa40ef44 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635457.084354:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789635457.084357:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789635457.084359:0:6502:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789635457.084371:0:6502:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d057b5c0800 00010000:00010000:1.0:1789635457.084375:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9c00/0xb0c3a59caa40ef3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xb0c3a59caa40ef44 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635457.084399:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056f6e9c00/0xb0c3a59caa40ef3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xb0c3a59caa40ef44 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635457.084411:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635457.084413:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635457.084415:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789635457.086075:0:15509:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789635457.086091:0:15509:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d0543291500 x1876568427376896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635472 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635457.086132:0:15509:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789635457.086140:0:15509:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789635457.086166:0:15509:0:(import.c:65:import_set_state_nolock()) ffff8d04465c5000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789635457.086428:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e014700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1876568427377280:0@lo:39:umount.0 00000400:00000100:3.0:1789635457.086479:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876568427377280 offset 0 length 224: 4 00000100:00100000:1.0:1789635457.086623:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427376896:0@lo:400:kworker.0 00010000:00010000:1.0:1789635457.187908:0:15306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789635457.444022:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6356ed01-c755-4f9e-b839-20feb7c3f098->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789635457.444033:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6356ed01-c755-4f9e-b839-20feb7c3f098->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789635457.444036:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789635457.444039:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789635457.444131:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789635457.444296:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1876568427377408:0@lo:400:kworker.0 00000400:00000100:3.0:1789635457.444350:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876568427377408 offset 0 length 224: 4 00010000:00010000:0.0:1789635458.212623:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635459.238836:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789635459.494349:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789635459.494359:0:9509:0:(genops.c:885:class_export_put()) final put ffff8d0577696000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789635459.496085:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0577696000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789635459.496164:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d0549fb0800 for lustre-OST0001 00000001:00100000:1.0:1789635459.499144:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789635459.499389:0:8425:0:(genops.c:885:class_export_put()) final put ffff8d0445993000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789635459.499482:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0445993000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789635459.500420:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d0445995000 for lustre-OST0000 00010000:00010000:2.0:1789635460.260418:0:15307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635461.283902:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789635461.476611:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6356ed01-c755-4f9e-b839-20feb7c3f098->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789635461.476621:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6356ed01-c755-4f9e-b839-20feb7c3f098->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789635461.476623:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789635461.476627:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789635461.476723:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e015180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1876568427377536:0@lo:400:kworker.0 00000400:00000100:0.0:1789635461.476773:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876568427377536 offset 0 length 224: 4 00010000:00010000:1.0:1789635462.308000:0:15306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635463.267774:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789635453/real 1789635453] req@ffff8d0543292680 x1876568427376512/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789635463 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635463.267810:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d0543292680 x1876568427376512/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789635463 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789635463.267830:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d057b5c0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789635463.267855:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1789635463.267860:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6356ed01-c755-4f9e-b839-20feb7c3f098:3639:1876568427376512:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:3.0:1789635463.267930:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6356ed01-c755-4f9e-b839-20feb7c3f098->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789635463.267940:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789635463.267946:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d057b5c0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789635463.267955:0:36:0:(import.c:545:import_select_connection()) MGC192.168.203.120@tcp: connect to NID 0@lo last attempt 471 00000100:00080000:3.0:1789635463.267963:0:36:0:(import.c:630:import_select_connection()) MGC192.168.203.120@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789635463.267978:0:36:0:(import.c:666:import_select_connection()) MGC192.168.203.120@tcp: import ffff8d057b5c0800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789635463.268026:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d056e016300 x1876568427377664/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789635463.268061:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789635463.268084:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789635463.268103:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6356ed01-c755-4f9e-b839-20feb7c3f098:3639:1876568427377664:0@lo:250:kworker.0 00000400:00000100:0.0:1789635463.268183:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876568427377664 offset 0 length 520: 4 00000100:00100000:1.0:1789635463.268293:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e015f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1876568427377792:0@lo:400:kworker.0 00000400:00000100:1.0:1789635463.268321:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876568427377792 offset 0 length 224: 4 00010000:00010000:0.0:1789635463.331949:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635464.357264:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635465.380054:0:15307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635466.403772:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635467.363711:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789635457/real 1789635457] req@ffff8d056e014700 x1876568427377280/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789635467 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635467.363743:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d056e014700 x1876568427377280/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789635467 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789635467.363761:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d04465c5000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789635467.363776:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e014700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1876568427377280:0@lo:39:umount.0 00000100:00080000:3.0:1789635467.364860:0:15509:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789635467.364866:0:15509:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789635467.364872:0:15509:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789635467.366538:0:15509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05820d3c00/0xb0c3a59caa40ef4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ef52 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635467.366556:0:15509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05820d3c00/0xb0c3a59caa40ef4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ef52 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635467.366562:0:15509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05820d3c00/0xb0c3a59caa40ef4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb0c3a59caa40ef52 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635467.366569:0:15509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff8d05820d3c00/0xb0c3a59caa40ef4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb0c3a59caa40ef52 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635467.366624:0:15509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789635467.366633:0:15509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40f1c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40f1c8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635467.366640:0:15509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40f1c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40f1c8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635467.366805:0:15306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635467.366812:0:15306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d05820d3c00/0xb0c3a59caa40ef4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb0c3a59caa40ef52 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635467.366820:0:15306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05820d3c00 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:1.0:1789635467.366824:0:15306:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d05820d3c00/0xb0c3a59caa40ef4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb0c3a59caa40ef52 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635467.366850:0:15306:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d05820d3c00/0xb0c3a59caa40ef4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xb0c3a59caa40ef52 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789635467.366857:0:15306:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d05820d3c00/0xb0c3a59caa40ef4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xb0c3a59caa40ef52 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635467.366862:0:15306:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789635467.366864:0:15306:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:1.0:1789635467.366876:0:15306:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d057b5c0800 00010000:00010000:1.0:1789635467.366879:0:15306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d05820d3c00/0xb0c3a59caa40ef4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xb0c3a59caa40ef52 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635467.366885:0:15306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d05820d3c00/0xb0c3a59caa40ef4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xb0c3a59caa40ef52 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635467.366900:0:15306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635467.366901:0:15306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635467.366904:0:15306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635467.367150:0:15509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40f1c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb0c3a59caa40f1c8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635467.367157:0:15509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40f1c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb0c3a59caa40f1c8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635467.367180:0:15509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789635467.367192:0:15509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1789635467.367196:0:15509:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1789635467.367222:0:15509:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1789635467.367227:0:15509:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1789635467.367232:0:15509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789635467.367237:0:15509:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789635467.367241:0:15509:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff8d056f55cd40) has no exports 00000020:00080000:3.0:1789635467.367261:0:15509:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff8d056f55cd40) has no exports 00000020:01000000:3.0:1789635467.370041:0:15509:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d044641b8a0 - data ffff8d0445c21438/ffff8d057602c000 00010000:00010000:0.0:1789635467.370580:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635467.370590:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40f1c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb0c3a59caa40f1c8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635467.370633:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152600 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:0.0:1789635467.370646:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40f1c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb0c3a59caa40f1c8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635467.370657:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40f1c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb0c3a59caa40f1c8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789635467.370678:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40f1c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb0c3a59caa40f1c8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635467.370685:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789635467.370688:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789635467.370691:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789635467.370706:0:6503:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d057b5c0800 00010000:00010000:0.0:1789635467.370709:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40f1c1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb0c3a59caa40f1c8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635467.370715:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056e152600/0xb0c3a59caa40f1c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb0c3a59caa40f1c8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635467.370735:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635467.370738:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635467.370740:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789635467.373922:0:15509:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d044641b120 - data ffff8d057b285af8/ffff8d056e133400 00100000:10000000:3.0:1789635467.405400:0:15509:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789635467.423760:0:15509:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40ec9d 00000020:00000080:0.0:1789635467.423770:0:15509:0:(genops.c:885:class_export_put()) final put ffff8d0445990000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1789635467.423785:0:15509:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d056f7ce800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1789635467.423789:0:15509:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d056f7ce800 2 00000020:01000004:0.0:1789635467.423792:0:15509:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d056f7ce800 from lustre-OST0000 00000020:00000080:0.0:1789635467.423818:0:15509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789635467.423827:0:15509:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1789635467.423830:0:15509:0:(genops.c:885:class_export_put()) final put ffff8d0445997000/lustre-OST0000_UUID 00000020:00000080:0.0:1789635467.423833:0:15509:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0445997000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1789635467.423838:0:15509:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1789635467.423891:0:15509:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1789635467.423895:0:15509:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789635467.423898:0:15509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789635467.423902:0:15509:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789635467.423916:0:15509:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8d056e356800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789635467.423922:0:15509:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff8d044646b380) has exports, disconnecting them 00000020:00080000:0.0:1789635467.423927:0:15509:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8d056e356800), last request at 1789635214 00000020:00000080:0.0:1789635467.423931:0:15509:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40ecc7 00000020:00080000:0.0:1789635467.423937:0:15509:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d056e356800): rc 0 00000020:00000080:0.0:1789635467.423941:0:15509:0:(genops.c:885:class_export_put()) final put ffff8d056e356800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789635467.424671:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0445990000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789635467.424680:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d056e356800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1789635467.425679:0:15509:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1789635467.425685:0:15509:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789635467.425689:0:15509:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789635467.425694:0:15509:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789635467.425869:0:15509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789635467.425877:0:15509:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1789635467.425882:0:15509:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789635467.425887:0:15509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789635467.425891:0:15509:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789635467.425963:0:15509:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8d04465c7800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789635467.425969:0:15509:0:(genops.c:1552:class_disconnect_exports()) OBD device 20 (ffff8d0446468000) has exports, disconnecting them 00000020:00080000:1.0:1789635467.425983:0:15509:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8d04465c7800), last request at 1789635214 00000020:00000080:1.0:1789635467.425987:0:15509:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40ecdc 00000020:00080000:1.0:1789635467.425999:0:15509:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d04465c7800): rc 0 00000020:00000080:1.0:1789635467.426004:0:15509:0:(genops.c:885:class_export_put()) final put ffff8d04465c7800/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1789635467.426072:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d056e352000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789635467.426081:0:36:0:(genops.c:885:class_export_put()) final put ffff8d05746d6000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1789635467.426084:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d05746d6000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1789635467.426091:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1789635467.426175:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d04465c7800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1789635467.454303:0:15509:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789635467.454312:0:15509:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00010000:00010000:2.0:1789635467.454313:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635467.454316:0:15509:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789635467.454325:0:15509:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789635467.454437:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d04465c5000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1789635467.454556:0:15509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789635467.454565:0:15509:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1789635467.454570:0:15509:0:(genops.c:885:class_export_put()) final put ffff8d04465c4000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1789635467.454574:0:15509:0:(genops.c:844:class_export_destroy()) destroying export ffff8d04465c4000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1789635467.454582:0:15509:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1789635467.454669:0:15509:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d056f7ce800 1 00000020:00000080:0.0:1789635467.454674:0:15509:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40ec65 00000020:00000080:0.0:1789635467.454679:0:15509:0:(genops.c:885:class_export_put()) final put ffff8d056f6f0800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1789635467.454684:0:15509:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1789635467.454688:0:15509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789635467.454692:0:15509:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789635467.454695:0:15509:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff8d0575920000) has no exports 00000020:00000080:2.0:1789635467.454988:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d056f6f0800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789635467.499045:0:15509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789635467.499058:0:15509:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1789635467.499064:0:15509:0:(genops.c:885:class_export_put()) final put ffff8d056f7cd800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1789635467.499067:0:15509:0:(genops.c:844:class_export_destroy()) destroying export ffff8d056f7cd800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1789635467.499079:0:15509:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1789635467.499258:0:15509:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d056f7cf800 00000020:02000400:3.0:1789635467.499297:0:15509:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1789635468.517117:0:15307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789635468.707976:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6356ed01-c755-4f9e-b839-20feb7c3f098->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789635468.707984:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6356ed01-c755-4f9e-b839-20feb7c3f098->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789635468.707988:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789635468.707991:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789635468.708055:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789635468.708077:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1876568427377920:0@lo:400:kworker.0 00000400:00000100:0.0:1789635468.708142:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876568427377920 offset 0 length 224: 4 00010000:00010000:1.0:1789635469.539816:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635470.563842:0:15306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789635470.814060:0:15711:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789635470.825085:0:15711:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1789635470.825389:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05820d2c00/0xb0c3a59caa40ef21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ef28 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635470.825404:0:15711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05820d2c00/0xb0c3a59caa40ef21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ef28 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635470.825410:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05820d2c00/0xb0c3a59caa40ef21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb0c3a59caa40ef28 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635470.825418:0:15711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff8d05820d2c00/0xb0c3a59caa40ef21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb0c3a59caa40ef28 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635470.825435:0:15711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789635470.825440:0:15711:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1789635470.825462:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635470.825468:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d05820d2c00/0xb0c3a59caa40ef21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb0c3a59caa40ef28 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635470.825475:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05820d2c00 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:0.0:1789635470.825478:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d05820d2c00/0xb0c3a59caa40ef21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb0c3a59caa40ef28 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635470.825486:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d05820d2c00/0xb0c3a59caa40ef21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb0c3a59caa40ef28 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789635470.825494:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d05820d2c00/0xb0c3a59caa40ef21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb0c3a59caa40ef28 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635470.826097:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789635470.826100:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789635470.826102:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789635470.826282:0:6503:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d057b5c0800 00010000:00010000:0.0:1789635470.826289:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d05820d2c00/0xb0c3a59caa40ef21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb0c3a59caa40ef28 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635470.826296:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d05820d2c00/0xb0c3a59caa40ef21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb0c3a59caa40ef28 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635470.826310:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635470.826314:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635470.826317:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789635470.826335:0:15711:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789635470.826347:0:15711:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d0543291f80 x1876568427377024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789635471 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635470.826366:0:15711:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789635470.826372:0:15711:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789635470.826378:0:15711:0:(import.c:65:import_set_state_nolock()) ffff8d0447569800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789635470.826384:0:15711:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789635470.826388:0:15711:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d0543291f80 x1876568427377024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789635471 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635470.826395:0:15711:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789635470.826399:0:15711:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000100:00100000:0.0:1789635470.826455:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543291f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1876568427377024:0@lo:38:kworker.0 00000100:00080000:1.0:1789635470.828867:0:15711:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789635470.828885:0:15711:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d0543291c00 x1876568427377152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635472 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635470.828904:0:15711:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d05759d3b80 x1876568427377408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635473 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635470.828915:0:15711:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d056e015180 x1876568427377536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635477 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635470.828927:0:15711:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d056e015f80 x1876568427377792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635479 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635470.828937:0:15711:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d0543292680 x1876568427377920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635484 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635470.828945:0:15711:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:1.0:1789635470.828977:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1876568427377920:0@lo:400:kworker.0 00000100:00100000:1.0:1789635470.828986:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543291c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1876568427377152:0@lo:400:kworker.0 00000100:00100000:1.0:1789635470.829017:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e015f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1876568427377792:0@lo:400:kworker.0 00000100:00080000:1.0:1789635470.829026:0:15711:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789635470.829056:0:15711:0:(import.c:65:import_set_state_nolock()) ffff8d0445981000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789635470.829100:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3639:1876568427378048:0@lo:39:umount.0 00000400:00000100:1.0:1789635470.829159:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876568427378048 offset 0 length 224: 4 00000100:00100000:1.0:1789635470.829979:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1876568427377408:0@lo:400:kworker.0 00000100:00100000:3.0:1789635470.832354:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e015180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1876568427377536:0@lo:400:kworker.0 00010000:00010000:2.0:1789635471.588115:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635472.612547:0:15307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635473.636740:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789635473.827824:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6356ed01-c755-4f9e-b839-20feb7c3f098->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789635473.827834:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6356ed01-c755-4f9e-b839-20feb7c3f098->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1789635474.660981:0:15306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635475.683978:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635476.709729:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635477.733436:0:15307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635478.757756:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789635478.947753:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6356ed01-c755-4f9e-b839-20feb7c3f098->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789635478.947761:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6356ed01-c755-4f9e-b839-20feb7c3f098->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789635479.011728:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789635463/real 1789635463] req@ffff8d056e016300 x1876568427377664/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789635478 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635479.011778:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d056e016300 x1876568427377664/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789635478 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789635479.011807:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d057b5c0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789635479.011833:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1789635479.011837:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6356ed01-c755-4f9e-b839-20feb7c3f098:3639:1876568427377664:0@lo:250:kworker.0 00000100:00080000:0.0:1789635479.012038:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6356ed01-c755-4f9e-b839-20feb7c3f098->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789635479.012061:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1789635479.012064:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d057b5c0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789635479.012069:0:36:0:(import.c:545:import_select_connection()) MGC192.168.203.120@tcp: connect to NID 0@lo last attempt 481 00000100:00080000:0.0:1789635479.012075:0:36:0:(import.c:630:import_select_connection()) MGC192.168.203.120@tcp: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789635479.012087:0:36:0:(import.c:666:import_select_connection()) MGC192.168.203.120@tcp: import ffff8d057b5c0800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1789635479.012116:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0543291f80 x1876568427378176/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789635479.012369:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543291f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6356ed01-c755-4f9e-b839-20feb7c3f098:3639:1876568427378176:0@lo:250:kworker.0 00000400:00000100:1.0:1789635479.012420:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876568427378176 offset 0 length 520: 4 00010000:00010000:1.0:1789635479.779899:0:15306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635480.037191:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789635470/real 1789635470] req@ffff8d0543294700 x1876568427378048/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789635480 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635480.037222:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d0543294700 x1876568427378048/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789635480 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789635480.037239:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d0445981000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789635480.037307:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3639:1876568427378048:0@lo:39:umount.0 00000100:00080000:0.0:1789635480.040935:0:15711:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789635480.040944:0:15711:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789635480.040949:0:15711:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789635480.042124:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40ef2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40ef36 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635480.042140:0:15711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40ef2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40ef36 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635480.042148:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40ef2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb0c3a59caa40ef36 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635480.042156:0:15711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40ef2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb0c3a59caa40ef36 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635480.042182:0:15711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789635480.042189:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa40f1b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa40f1ba expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635480.042196:0:15711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa40f1b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa40f1ba expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635480.042219:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa40f1b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb0c3a59caa40f1ba expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635480.042227:0:15711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa40f1b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb0c3a59caa40f1ba expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635480.042229:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635480.042239:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40ef2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb0c3a59caa40ef36 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635480.042250:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05820d3800 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:2.0:1789635480.042254:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40ef2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb0c3a59caa40ef36 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635480.042263:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40ef2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb0c3a59caa40ef36 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789635480.042270:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40ef2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb0c3a59caa40ef36 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635480.042276:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789635480.042278:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1789635480.042303:0:6503:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d057b5c0800 00010000:00010000:2.0:1789635480.042308:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40ef2f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb0c3a59caa40ef36 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635480.042315:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d05820d3800/0xb0c3a59caa40ef2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb0c3a59caa40ef36 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635480.042330:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635480.042334:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa40f1b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb0c3a59caa40f1ba expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635480.042542:0:15711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:0.0:1789635480.042548:0:15711:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1789635480.042552:0:15711:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1789635480.042578:0:15711:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1789635480.042583:0:15711:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1789635480.042588:0:15711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789635480.042593:0:15711:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789635480.042620:0:15711:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff8d04464699c0) has no exports 00000020:00080000:0.0:1789635480.042643:0:15711:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff8d04464699c0) has no exports 00010000:00010000:2.0:1789635480.042731:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152000 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:2.0:1789635480.042751:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa40f1b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb0c3a59caa40f1ba expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635480.042760:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa40f1b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb0c3a59caa40f1ba expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789635480.042766:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa40f1b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb0c3a59caa40f1ba expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635480.042771:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789635480.042774:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789635480.042776:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789635480.042782:0:6503:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d057b5c0800 00010000:00010000:2.0:1789635480.042785:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa40f1b3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb0c3a59caa40f1ba expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635480.042792:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa40f1b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb0c3a59caa40f1ba expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635480.042805:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635480.042807:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635480.045663:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789635480.045843:0:15711:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d044641bd20 - data ffff8d0445c21000/ffff8d057602f800 00000020:01000000:0.0:1789635480.045968:0:15711:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d044641ba20 - data ffff8d0445c0e438/ffff8d04418c8800 00010000:00010000:1.0:1789635480.046525:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1789635480.056018:0:15711:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789635480.070462:0:15711:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40edc3 00000020:00000080:2.0:1789635480.070474:0:15711:0:(genops.c:885:class_export_put()) final put ffff8d0445985000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1789635480.070540:0:15711:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d0577690000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1789635480.070545:0:15711:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d0577690000 2 00000020:01000004:2.0:1789635480.070547:0:15711:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d0577690000 from lustre-OST0001 00000020:00000080:2.0:1789635480.070570:0:15711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789635480.070579:0:15711:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1789635480.070582:0:15711:0:(genops.c:885:class_export_put()) final put ffff8d0445982800/lustre-OST0001_UUID 00000020:00000080:2.0:1789635480.070585:0:15711:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0445982800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1789635480.070590:0:15711:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1789635480.070971:0:15711:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 6356ed01-c755-4f9e-b839-20feb7c3f098->MGS 00010000:00010000:2.0:1789635480.070986:0:15711:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d05820d3a00/0xb0c3a59caa40eb1c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb0c3a59caa40eb23 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789635480.071006:0:15711:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d05820d3a00/0xb0c3a59caa40eb1c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb0c3a59caa40eb23 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635480.071014:0:15711:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1789635480.071017:0:15711:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1789635480.071020:0:15711:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1789635480.071033:0:15711:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d057b5c0800 00010000:00010000:2.0:1789635480.071037:0:15711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d05820d3a00/0xb0c3a59caa40eb1c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb0c3a59caa40eb23 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635480.071050:0:15711:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2000/0xb0c3a59caa40ef91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb0c3a59caa40ef98 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789635480.071056:0:15711:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2000/0xb0c3a59caa40ef91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb0c3a59caa40ef98 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635480.071061:0:15711:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789635480.071063:0:15711:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1789635480.071064:0:15711:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1789635480.071073:0:15711:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d057b5c0800 00010000:00010000:2.0:1789635480.071075:0:15711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2000/0xb0c3a59caa40ef91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb0c3a59caa40ef98 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789635480.071728:0:15711:0:(import.c:65:import_set_state_nolock()) ffff8d057b5c0800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1789635480.071734:0:15711:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789635480.071736:0:15711:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789635480.071738:0:15711:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789635480.071743:0:15711:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789635480.071766:0:15711:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d0543291f80 x1876568427378176/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789635499 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789635480.071900:0:15711:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789635480.071903:0:15711:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00000100:00100000:3.0:1789635480.071989:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543291f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6356ed01-c755-4f9e-b839-20feb7c3f098:3639:1876568427378176:0@lo:250:kworker.0 10000000:01000000:2.0:1789635480.072092:0:15711:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789635480.072099:0:15711:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40ea19 00000020:00000080:2.0:1789635480.072105:0:15711:0:(genops.c:885:class_export_put()) final put ffff8d057b5c2800/6356ed01-c755-4f9e-b839-20feb7c3f098 00000020:00000080:1.0:1789635480.075555:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0445985000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1789635480.079497:0:15711:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.120@tcp (flags='') 00000020:00000080:3.0:1789635480.079692:0:15711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789635480.079701:0:15711:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.120@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789635480.079706:0:15711:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8d057ae4b380) has no exports 10000000:01000000:3.0:1789635480.079765:0:6512:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1789635480.079891:0:15711:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.120@tcp: client import never connected 00000100:00080000:2.0:1789635480.079895:0:15711:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1789635480.079899:0:15711:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789635480.079902:0:15711:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1789635480.079905:0:15711:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789635480.084361:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d057b5c2800/6356ed01-c755-4f9e-b839-20feb7c3f098 for MGC192.168.203.120@tcp 00000020:00000080:2.0:1789635480.086026:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d057b5c0800 for MGC192.168.203.120@tcp 00000020:00000080:2.0:1789635480.086081:0:15711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789635480.086090:0:15711:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.120@tcp (uuid 6356ed01-c755-4f9e-b839-20feb7c3f098) 00000020:00000080:2.0:1789635480.086095:0:15711:0:(genops.c:885:class_export_put()) final put ffff8d057b5c1000/6356ed01-c755-4f9e-b839-20feb7c3f098 00000020:00000080:2.0:1789635480.086098:0:15711:0:(genops.c:844:class_export_destroy()) destroying export ffff8d057b5c1000/6356ed01-c755-4f9e-b839-20feb7c3f098 for MGC192.168.203.120@tcp 00000020:01000000:2.0:1789635480.086109:0:15711:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.120@tcp (6356ed01-c755-4f9e-b839-20feb7c3f098) 00000020:01000000:2.0:1789635480.086510:0:15711:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789635480.086516:0:15711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789635480.086710:0:15711:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789635480.086719:0:15711:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8d0445986000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789635480.086725:0:15711:0:(genops.c:1552:class_disconnect_exports()) OBD device 25 (ffff8d0579bd99c0) has exports, disconnecting them 00000020:00080000:2.0:1789635480.086730:0:15711:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8d0445986000), last request at 1789635234 00000020:00000080:2.0:1789635480.086734:0:15711:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40eded 00000020:00080000:2.0:1789635480.086747:0:15711:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d0445986000): rc 0 00000020:00000080:2.0:1789635480.086752:0:15711:0:(genops.c:885:class_export_put()) final put ffff8d0445986000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1789635480.086784:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0445986000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1789635480.087840:0:15711:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1789635480.087846:0:15711:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789635480.087851:0:15711:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789635480.087868:0:15711:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789635480.087957:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d0447569800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789635480.088092:0:15711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789635480.088100:0:15711:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1789635480.088104:0:15711:0:(genops.c:885:class_export_put()) final put ffff8d044756f000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1789635480.088107:0:15711:0:(genops.c:844:class_export_destroy()) destroying export ffff8d044756f000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1789635480.088119:0:15711:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1789635480.088173:0:15711:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789635480.088177:0:15711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789635480.088181:0:15711:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789635480.088186:0:15711:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8d0445980800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789635480.088191:0:15711:0:(genops.c:1552:class_disconnect_exports()) OBD device 26 (ffff8d044646cd40) has exports, disconnecting them 00000020:00080000:3.0:1789635480.088195:0:15711:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8d0445980800), last request at 1789635234 00000020:00000080:3.0:1789635480.088198:0:15711:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40ee02 00000020:00080000:3.0:1789635480.088210:0:15711:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d0445980800): rc 0 00000020:00000080:3.0:1789635480.088213:0:15711:0:(genops.c:885:class_export_put()) final put ffff8d0445980800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1789635480.088694:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0445980800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1789635480.129639:0:15711:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1789635480.129658:0:15711:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789635480.129662:0:15711:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789635480.129668:0:15711:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789635480.129744:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d0445981000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1789635480.130648:0:15307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1789635480.130930:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1789635480.130988:0:15306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:2.0:1789635480.131061:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00010000:00010000:2.0:1789635480.131132:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-5 blwis in pool) 00000100:00100000:2.0:1789635480.131306:0:6498:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8d0545268400:6498] 1 exiting: rc = 0 00000100:00100000:1.0:1789635480.131591:0:6497:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8d0545268600:6497] 0 exiting: rc = 1 00000100:00100000:0.0:1789635480.132298:0:10394:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8d0447ad8600:10394] 2 exiting: rc = 0 00000100:00100000:1.0:1789635480.132371:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.134338:0:7457:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8d057aef0200:7457] 3 exiting: rc = 0 00000100:00100000:1.0:1789635480.134582:0:13189:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_004: service thread [ffff8d0446c9ce00:13189] 4 exiting: rc = 0 00000100:00100000:1.0:1789635480.134687:0:6500:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8d054c18fa00:6500] 1 exiting: rc = 0 00000100:00100000:0.0:1789635480.135323:0:6499:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8d054c18f200:6499] 0 exiting: rc = 1 00000100:00100000:2.0:1789635480.135742:0:6501:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8d054c3d4200:6501] 2 exiting: rc = 0 00000100:00100000:1.0:1789635480.135812:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.135821:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.135829:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.135836:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.135841:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.135847:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.135853:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.135858:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.135864:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.135869:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.135875:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.135881:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.135888:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.135895:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.135904:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.135912:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.135922:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.135929:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.135935:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.135942:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.135950:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.135956:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.135964:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.135984:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.135990:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136003:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136019:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136025:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136031:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136036:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136041:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136046:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136050:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136055:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136060:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136065:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136070:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136075:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136079:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136084:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136089:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136093:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136098:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136102:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136107:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136111:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136115:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136120:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136124:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136129:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136133:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136137:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136149:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136154:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136160:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136164:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136169:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136174:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136179:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136183:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136188:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136198:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136203:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.136210:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789635480.137491:0:15711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789635480.137502:0:15711:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1789635480.137508:0:15711:0:(genops.c:885:class_export_put()) final put ffff8d0445980000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1789635480.137524:0:15711:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0445980000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1789635480.137530:0:15711:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1789635480.137579:0:15711:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d0577690000 1 00000020:00000080:1.0:1789635480.137585:0:15711:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb0c3a59caa40ed92 00000020:00000080:1.0:1789635480.137590:0:15711:0:(genops.c:885:class_export_put()) final put ffff8d057604f000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1789635480.137620:0:15711:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1789635480.137624:0:15711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789635480.137629:0:15711:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789635480.137633:0:15711:0:(genops.c:1557:class_disconnect_exports()) OBD device 23 (ffff8d0579bd8000) has no exports 00000020:00000080:2.0:1789635480.139210:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d057604f000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789635480.182188:0:15711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789635480.182200:0:15711:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1789635480.182206:0:15711:0:(genops.c:885:class_export_put()) final put ffff8d0577692000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1789635480.182211:0:15711:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0577692000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1789635480.182222:0:15711:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1789635480.182945:0:15711:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d0577693800 00000020:01000000:0.0:1789635480.182969:0:15711:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1789635480.182975:0:15711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789635480.182980:0:15711:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789635480.182984:0:15711:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff8d0558610000) has no exports 00000020:00000080:0.0:1789635480.183029:0:15711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789635480.183035:0:15711:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1789635480.183039:0:15711:0:(genops.c:885:class_export_put()) final put ffff8d056f6f1000/OSS_uuid 00000020:00000080:0.0:1789635480.183041:0:15711:0:(genops.c:844:class_export_destroy()) destroying export ffff8d056f6f1000/OSS_uuid for OSS 00000020:01000000:0.0:1789635480.183045:0:15711:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1789635480.183188:0:6510:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1789635480.185335:0:8430:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff8d05746ea800:8430] 0 exiting: rc = 1 00000100:00100000:3.0:1789635480.185422:0:8431:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff8d05746eae00:8431] 1 exiting: rc = 0 00000100:00100000:3.0:1789635480.185481:0:10116:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff8d044140c000:10116] 3 exiting: rc = 0 00000100:00100000:3.0:1789635480.185578:0:8432:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff8d056e0cc200:8432] 2 exiting: rc = 0 00000100:00100000:0.0:1789635480.185852:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.185862:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.185872:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.185878:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.185886:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.185892:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.185897:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.185902:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.185907:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.185912:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.185918:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.185923:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.185928:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.185934:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.185940:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.185945:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.185949:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.185954:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.185960:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.185964:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.185970:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.185975:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.185980:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.185985:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.185990:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186007:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186014:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186020:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186025:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186030:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186036:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186041:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186046:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186052:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186058:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186078:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186084:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186090:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186096:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186101:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186106:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186122:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186127:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186133:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186138:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186143:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186148:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186152:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186157:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186161:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186166:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186170:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186175:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186180:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186185:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186190:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186195:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186201:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186205:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186209:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186214:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186218:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186223:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.186229:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.196993:0:8433:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8d056e0b9e00:8433] 0 exiting: rc = 1 00000100:00100000:1.0:1789635480.198559:0:8434:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8d056e0bbc00:8434] 1 exiting: rc = 0 00000100:00100000:2.0:1789635480.201969:0:10329:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8d0446732e00:10329] 2 exiting: rc = 0 00000100:00100000:3.0:1789635480.202178:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202196:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202205:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202210:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202227:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202230:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202234:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202237:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202240:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202244:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202247:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202250:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202254:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202257:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202260:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202263:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202266:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202269:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202272:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202276:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202279:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202282:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202285:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202288:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202290:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202293:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202296:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202299:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202302:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202305:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202307:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202310:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202314:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202317:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202321:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202324:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202327:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202330:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202332:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202339:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202342:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202346:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202349:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202352:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202355:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202358:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202361:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202364:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202367:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202370:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202373:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202381:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202384:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202388:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202391:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202395:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202398:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202402:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202405:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202408:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202411:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202414:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202416:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.202419:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.203455:0:8436:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8d056f3fcc00:8436] 1 exiting: rc = 0 00000100:00100000:3.0:1789635480.203565:0:8435:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8d056e0ba800:8435] 0 exiting: rc = 1 00000100:00100000:2.0:1789635480.203771:0:8437:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8d056f3fd000:8437] 2 exiting: rc = 0 00000100:00100000:3.0:1789635480.203849:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.203857:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.203862:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.203868:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.203872:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.203878:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.203883:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.203887:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.203892:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.203909:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.203913:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.203919:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.203923:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.203929:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.203936:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.203942:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.203951:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.203959:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.203970:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.203979:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.203989:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204022:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204033:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204163:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204173:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204179:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204186:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204191:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204196:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204202:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204207:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204214:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204220:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204225:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204231:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204236:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204242:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204248:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204252:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204256:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204260:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204264:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204267:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204271:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204280:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204285:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204290:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204307:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204311:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204315:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204320:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204324:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204328:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204333:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204336:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204340:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204345:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204349:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204353:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204357:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204361:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204364:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204369:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789635480.204373:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635480.208443:0:8868:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_002: service thread [ffff8d044643c400:8868] 2 exiting: rc = 0 00000100:00100000:3.0:1789635480.208499:0:8438:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8d056f3fc200:8438] 0 exiting: rc = 1 00000100:00100000:1.0:1789635480.208953:0:8439:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8d056e1bc600:8439] 1 exiting: rc = 0 00000100:00100000:2.0:1789635480.209346:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209358:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209365:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209370:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209376:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209381:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209387:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209392:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209398:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209404:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209411:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209418:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209425:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209447:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209452:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209470:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209475:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209498:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209506:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209521:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209527:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209533:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209538:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209543:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209549:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209559:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209565:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209571:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209577:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209583:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209588:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209612:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209621:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209627:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209632:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209638:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209643:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209651:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209657:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209663:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209679:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209687:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209693:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209698:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209713:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209721:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209728:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209734:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209740:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209747:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209755:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209762:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209780:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209787:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209792:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209798:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209803:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209809:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209814:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209821:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209837:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209843:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209848:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.209854:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635480.210640:0:8441:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8d056e2c4000:8441] 1 exiting: rc = 0 00000100:00100000:0.0:1789635480.210846:0:8440:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8d056e1bd000:8440] 0 exiting: rc = 1 00000100:00100000:2.0:1789635480.211372:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211394:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211401:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211407:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211413:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211419:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211425:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211432:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211438:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211444:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211451:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211456:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211462:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211482:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211490:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211496:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211501:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211508:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211514:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211520:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211526:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211532:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211538:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211553:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211559:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211579:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211586:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211591:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211613:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211621:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211629:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211636:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211642:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211648:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211656:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211776:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211785:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211806:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211812:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211818:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211823:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211835:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211840:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211845:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211851:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211856:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211862:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211868:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211874:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211894:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211900:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211906:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211912:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211917:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211923:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211929:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211935:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211941:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211955:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211962:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211968:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211974:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211980:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635480.211993:0:15711:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1789635480.218058:0:15711:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1789635500.093808:0:16476:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789635510.214445:0:17075:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789635510.214451:0:17075:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1789635510.214452:0:17075:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789635510.214564:0:17075:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d054b800800 00000020:01000004:0.0:1789635510.214584:0:17075:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1789635510.214591:0:17075:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789635510.214807:0:17075:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8d056f55cd40) 00000020:00000080:0.0:1789635510.214822:0:17075:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789635510.268170:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1789635510.268415:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789635510.269590:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1789635510.270205:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789635510.270539:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789635510.270755:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1789635510.270959:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1789635510.271215:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1789635510.271579:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1789635510.271934:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1789635510.272285:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1789635510.272471:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1789635510.272727:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789635510.272966:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1789635510.273247:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1789635510.273670:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1789635510.273909:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1789635510.274431:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1789635510.274680:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1789635510.274980:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1789635510.275219:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789635510.275403:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1789635510.275583:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1789635510.275802:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1789635510.276127:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1789635510.276372:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1789635510.276556:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1789635510.276885:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789635510.277054:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1789635510.277519:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1789635510.277968:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1789635510.278312:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1789635510.278525:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789635510.279373:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1789635510.279629:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1789635510.280345:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1789635510.281224:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1789635510.281623:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1789635510.281836:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1789635510.282156:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789635510.283577:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1789635510.283833:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1789635510.284366:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1789635510.285363:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1789635510.285593:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1789635510.291076:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1789635510.291998:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1789635510.295803:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1789635510.296278:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1789635510.296483:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1789635510.297206:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1789635510.297714:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1789635510.297949:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:3.0:1789635510.298444:0:17075:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789635510.298716:0:17075:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789635510.298726:0:17075:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789635510.298745:0:17075:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb0c3a59caa40ffc8 00000020:01000004:3.0:1789635510.298752:0:17075:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1789635510.298757:0:17075:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789635510.298771:0:17075:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d054b800800 from MGS 00000020:01000004:3.0:1789635510.298775:0:17075:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789635510.298786:0:17075:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8d0575920000) 00000020:00000080:3.0:1789635510.298796:0:17075:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789635510.299150:0:17075:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d054b800800 from MGS, refs=2 00080000:01000000:3.0:1789635510.299157:0:17075:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789635510.299163:0:17075:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb0c3a59caa40ffd6 00000100:00100000:3.0:1789635510.299263:0:17075:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789635510.299397:0:17075:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789635510.299403:0:17075:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789635510.304377:0:17075:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789635510.304392:0:17075:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789635510.307504:0:17075:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789635510.308173:0:17075:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789635510.308180:0:17075:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789635510.310299:0:17075:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789635510.310518:0:17075:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789635510.318872:0:17075:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789635510.318892:0:17075:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789635510.319776:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635510.319780:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635510.319782:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635510.320269:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635510.320272:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635510.320273:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635510.322985:0:17075:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789635510.327484:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789635510.331436:0:17075:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1789635510.333381:0:17087:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789635510.333436:0:17075:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789635510.333476:0:17075:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789635510.339693:0:17075:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789635510.340023:0:17075:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789635510.340297:0:17075:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789635510.340304:0:17075:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789635510.340854:0:17075:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789635510.340861:0:17075:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789635510.341246:0:17075:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789635510.341252:0:17075:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789635510.342427:0:17075:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789635510.342449:0:17075:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.120@tcp' 00000020:01000004:0.0:1789635510.342451:0:17075:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789635510.342480:0:17075:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.120@tcp (typ=mgc) 00000020:00000080:0.0:1789635510.342492:0:17075:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.120@tcp (ffff8d056f55b380) 00000020:00000080:0.0:1789635510.342508:0:17075:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789635510.342587:0:17075:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d057b74d800@MGC192.168.203.120@tcp: add connection 192.168.203.120@tcp at head 00010000:00010000:0.0:1789635510.342775:0:17075:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.120@tcp-0 is initialized 00000040:01000000:0.0:1789635510.342782:0:17075:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 1 is initialized 00000100:00080000:3.0:1789635510.345026:0:17092:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1789635510.346831:0:17094:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789635510.347290:0:17075:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.120@tcp (uuid e3d8f284-7347-44bd-9697-6e3097b3c5ae) 00000020:00000080:0.0:1789635510.347314:0:17075:0:(genops.c:1384:class_connect()) connect: client e3d8f284-7347-44bd-9697-6e3097b3c5ae, cookie 0xb0c3a59caa40ffe4 00000100:00080000:0.0:1789635510.347326:0:17075:0:(import.c:545:import_select_connection()) MGC192.168.203.120@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789635510.347338:0:17075:0:(import.c:666:import_select_connection()) MGC192.168.203.120@tcp: import ffff8d057b74d800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1789635510.347379:0:17075:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0543293100 x1876568427378304/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789635510.347456:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543293100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3639:1876568427378304:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789635510.347521:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789635510.347570:0:17075:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import e3d8f284-7347-44bd-9697-6e3097b3c5ae->MGS 00000020:01000004:0.0:1789635510.347628:0:17075:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789635510.347655:0:17075:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789635510.347670:0:17075:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8d056f558000) 00000020:00000080:0.0:1789635510.347683:0:17075:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789635510.349940:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427378304 00000100:00100000:2.0:1789635510.349954:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427378304 00000100:00100000:2.0:1789635510.350036:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789635510.350045:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3639:x1876568427378304:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1789635510.350073:0:17089:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from e3d8f284-7347-44bd-9697-6e3097b3c5ae@0@lo t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:2.0:1789635510.350167:0:17089:0:(genops.c:1384:class_connect()) connect: client e3d8f284-7347-44bd-9697-6e3097b3c5ae, cookie 0xb0c3a59caa40fff2 00000100:00080000:2.0:1789635510.350299:0:17089:0:(import.c:65:import_set_state_nolock()) ffff8d0549fb5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789635510.350507:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+5:3639:x1876568427378304:12345-0@lo:250:mount.lustre.0 Request processed in 462us (2984us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635510.350515:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789635510.350581:0:3639:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.120@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789635510.350590:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.120@tcp: connect to target with instance 0 00000100:00080000:3.0:1789635510.350711:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.120@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789635510.350717:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789635510.350721:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d057b74d800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789635510.350724:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789635510.350771:0:3639:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789635510.350777:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543293100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3639:1876568427378304:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789635510.356523:0:17075:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789635510.356743:0:17075:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789635510.356749:0:17075:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789635510.359515:0:17075:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789635510.359533:0:17075:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789635510.360390:0:17075:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789635510.360398:0:17075:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789635510.361347:0:17075:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789635510.361527:0:17075:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789635510.361532:0:17075:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789635510.362270:0:17075:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789635510.362276:0:17075:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789635510.410896:0:17075:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789635510.411127:0:17075:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789635510.411134:0:17075:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789635510.412811:0:17075:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789635510.412824:0:17075:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789635510.414785:0:17075:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789635510.414963:0:17075:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789635510.414984:0:17075:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789635510.419935:0:17075:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789635510.419950:0:17075:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789635510.423282:0:17075:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789635510.423465:0:17075:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789635510.423471:0:17075:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1789635510.424773:0:17075:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789635510.424784:0:17075:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1789635510.425410:0:17075:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789635510.425564:0:17075:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789635510.425568:0:17075:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789635510.426687:0:17075:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789635510.426696:0:17075:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789635510.460062:0:17075:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789635510.460458:0:17075:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789635510.460464:0:17075:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789635510.466206:0:17075:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789635510.466235:0:17075:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789635510.467723:0:17075:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789635510.467734:0:17075:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789635510.475062:0:17075:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789635510.475313:0:17075:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1789635510.475321:0:17075:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789635510.475428:0:17075:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789635510.475465:0:17075:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.120@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1789635510.475469:0:17075:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789635510.475471:0:17075:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789635510.475472:0:17075:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789635510.475473:0:17075:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789635510.475475:0:17075:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789635510.475476:0:17075:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789635510.475477:0:17075:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789635510.475479:0:17075:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789635510.475480:0:17075:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789635510.475482:0:17075:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789635510.475484:0:17075:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1789635510.475486:0:17075:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789635510.475488:0:17075:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789635510.475488:0:17075:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789635510.475489:0:17075:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789635510.475490:0:17075:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789635510.475491:0:17075:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789635510.475492:0:17075:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789635510.475493:0:17075:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789635510.475494:0:17075:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789635510.475500:0:17075:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789635510.475526:0:17075:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789635510.475545:0:17075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17075:1876568427378432:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789635510.475966:0:17075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635510.476124:0:17075:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b6753c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635510.476373:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427378432 00000100:00100000:2.0:1789635510.476382:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427378432 00000100:00100000:2.0:1789635510.476469:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789635510.476480:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+5:17075:x1876568427378432:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789635510.476532:0:17091:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789635510.476535:0:17091:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789635510.476538:0:17091:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1789635510.476962:0:17112:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789635510.478784:0:17091:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1789635510.482054:0:17113:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1789635510.482063:0:17113:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1789635510.482066:0:17113:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1789635510.482068:0:17113:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1789635510.482391:0:17113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1789635510.482794:0:17091:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789635510.482805:0:17091:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789635510.484354:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+5:17075:x1876568427378432:12345-0@lo:253:mount.lustre.0 Request processed in 7870us (8382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635510.484368:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789635510.484529:0:17075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17075:1876568427378432:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789635510.484544:0:17075:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789635510.484547:0:17075:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789635510.484549:0:17075:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789635510.484551:0:17075:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789635510.484552:0:17075:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789635510.484553:0:17075:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789635510.484554:0:17075:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789635510.484555:0:17075:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789635510.484557:0:17075:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789635510.484558:0:17075:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789635510.484559:0:17075:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789635510.484577:0:17075:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d054b800800 from lustre-MDT0000 10000000:01000000:2.0:1789635510.484647:0:17075:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789635510.484651:0:17075:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789635510.484655:0:17075:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d056f55b380 10000000:01000000:2.0:1789635510.484659:0:17075:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789635510.484666:0:17075:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d056f55b380 from 1 10000000:01000000:2.0:1789635510.484668:0:17075:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789635510.484703:0:17075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2a00/0xb0c3a59caa40fff9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635510.484723:0:17075:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2a00/0xb0c3a59caa40fff9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635510.484734:0:17075:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2a00/0xb0c3a59caa40fff9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635510.484754:0:17075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17075:1876568427378560:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789635510.484801:0:17075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635510.484831:0:17075:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b675e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789635510.485374:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427378560 00000100:00100000:3.0:1789635510.485382:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427378560 00000100:00100000:3.0:1789635510.485428:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789635510.485437:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546405450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+5:17075:x1876568427378560:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789635510.485450:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635510.485466:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d05488fec00/0xb0c3a59caa410000 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa40fff9 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635510.485503:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d05488fec00/0xb0c3a59caa410000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa40fff9 expref: 6 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635510.485513:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d05488fec00/0xb0c3a59caa410000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa40fff9 expref: 6 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635510.485522:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05488fec00, rc 0) 00000100:00100000:3.0:1789635510.485571:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546405450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+6:17075:x1876568427378560:12345-0@lo:101:mount.lustre.0 Request processed in 135us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635510.485577:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789635510.485696:0:17075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17075:1876568427378560:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789635510.485711:0:17075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2a00/0xb0c3a59caa40fff9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410000 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.485719:0:17075:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2a00/0xb0c3a59caa40fff9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa410000 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635510.485786:0:17075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17075:1876568427378688:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789635510.485814:0:17075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635510.485843:0:17075:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d04410f90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635510.485893:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427378688 00000100:00100000:3.0:1789635510.485898:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427378688 00000100:00100000:3.0:1789635510.485962:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789635510.485969:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+6:17075:x1876568427378688:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789635510.486039:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+6:17075:x1876568427378688:12345-0@lo:501:mount.lustre.0 Request processed in 70us (224us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789635510.486046:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789635510.486362:0:17075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17075:1876568427378688:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789635510.486387:0:17075:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789635510.486408:0:17075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2a00/0xb0c3a59caa40fff9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410000 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.486417:0:17075:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2a00/0xb0c3a59caa40fff9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410000 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635510.486439:0:17075:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d054b800800 10000000:01000000:1.0:1789635510.486444:0:17075:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789635510.486448:0:17075:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d054b800800 10000000:01000000:1.0:1789635510.486451:0:17075:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789635510.486454:0:17075:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d054b800800 from 1 10000000:01000000:1.0:1789635510.486456:0:17075:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789635510.486476:0:17075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e153e00/0xb0c3a59caa410007 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.486484:0:17075:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056e153e00/0xb0c3a59caa410007 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.486492:0:17075:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056e153e00/0xb0c3a59caa410007 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635510.486505:0:17075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17075:1876568427378816:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789635510.486534:0:17075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635510.486560:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427378816 00000100:00100000:1.0:1789635510.486565:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427378816 00000100:00100000:1.0:1789635510.486583:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789635510.486590:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546404850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+6:17075:x1876568427378816:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789635510.486626:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635510.486639:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056e153200/0xb0c3a59caa41000e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa410007 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.486669:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e153200/0xb0c3a59caa41000e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa410007 expref: 7 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.486688:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056e153200/0xb0c3a59caa41000e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa410007 expref: 7 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.486696:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e153200, rc 0) 00000100:00100000:1.0:1789635510.486723:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546404850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+7:17075:x1876568427378816:12345-0@lo:101:mount.lustre.0 Request processed in 134us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635510.486730:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789635510.486772:0:17075:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d04410f90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635510.486785:0:17075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17075:1876568427378816:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789635510.486795:0:17075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056e153e00/0xb0c3a59caa410007 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa41000e expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.486803:0:17075:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056e153e00/0xb0c3a59caa410007 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa41000e expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635510.486815:0:17075:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789635510.486820:0:17075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e153e00/0xb0c3a59caa410007 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa41000e expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.486826:0:17075:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e153e00/0xb0c3a59caa410007 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa41000e expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635510.486832:0:17075:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789635510.486836:0:17075:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789635510.487031:0:17075:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d054b800800 10000000:01000000:1.0:1789635510.487036:0:17075:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789635510.487040:0:17075:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789635510.487047:0:17075:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789635510.487064:0:17075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152e00/0xb0c3a59caa410015 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.487072:0:17075:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056e152e00/0xb0c3a59caa410015 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.487079:0:17075:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056e152e00/0xb0c3a59caa410015 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635510.487092:0:17075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17075:1876568427378944:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789635510.487303:0:17075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635510.487369:0:17075:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d04410f90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635510.487407:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427378944 00000100:00100000:2.0:1789635510.487413:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427378944 00000100:00100000:2.0:1789635510.487485:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789635510.487495:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+7:17075:x1876568427378944:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789635510.487505:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635510.487516:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056e1a3200/0xb0c3a59caa41001c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa410015 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635510.487531:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e1a3200/0xb0c3a59caa41001c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa410015 expref: 8 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635510.487540:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056e1a3200/0xb0c3a59caa41001c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa410015 expref: 8 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635510.487548:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a3200, rc 0) 00000100:00100000:2.0:1789635510.487588:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+8:17075:x1876568427378944:12345-0@lo:101:mount.lustre.0 Request processed in 96us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635510.487628:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789635510.487738:0:17075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17075:1876568427378944:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789635510.487749:0:17075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056e152e00/0xb0c3a59caa410015 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa41001c expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.487758:0:17075:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056e152e00/0xb0c3a59caa410015 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa41001c expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635510.487812:0:17075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17075:1876568427379072:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789635510.487838:0:17075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635510.488183:0:17075:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d04410f90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635510.488210:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427379072 00000100:00100000:3.0:1789635510.488216:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427379072 00000100:00100000:0.0:1789635510.488326:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789635510.488336:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+8:17075:x1876568427379072:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789635510.488466:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+9:17075:x1876568427379072:12345-0@lo:501:mount.lustre.0 Request processed in 132us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635510.488473:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789635510.488581:0:17075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17075:1876568427379072:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789635510.488651:0:17075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17075:1876568427379200:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789635510.488693:0:17075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635510.488711:0:17075:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d04410f90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635510.488769:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427379200 00000100:00100000:0.0:1789635510.488773:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427379200 00000100:00100000:0.0:1789635510.488805:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789635510.488812:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+9:17075:x1876568427379200:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789635510.489563:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+9:17075:x1876568427379200:12345-0@lo:503:mount.lustre.0 Request processed in 750us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635510.489570:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789635510.489703:0:17075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17075:1876568427379200:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789635510.490197:0:17114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17114:1876568427379328:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635510.490302:0:17114:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635510.490336:0:17114:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b588480 going to sleep for 11 seconds 00000100:00100000:2.0:1789635510.490394:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427379328 00000100:00100000:2.0:1789635510.490399:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427379328 00000100:00100000:2.0:1789635510.490435:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789635510.490443:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+9:17114:x1876568427379328:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789635510.491062:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+9:17114:x1876568427379328:12345-0@lo:502:llog_process_th.0 Request processed in 618us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635510.491070:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789635510.491192:0:17114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17114:1876568427379328:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789635510.491218:0:17114:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789635510.491239:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635510.491241:0:17114:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789635510.491246:0:17114:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789635510.491249:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789635510.491263:0:17114:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8d0579bdcd40) 00000020:00000080:2.0:1789635510.491277:0:17114:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789635510.491283:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789635510.491348:0:17114:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789635510.491355:0:17114:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb0c3a59caa41002a 00000020:00000080:2.0:1789635510.491546:0:17114:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789635510.491550:0:17114:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789635510.491554:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635510.491555:0:17114:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789635510.491558:0:17114:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789635510.491562:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635510.491563:0:17114:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789635510.491567:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789635510.491574:0:17114:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8d0579bd8000) 00000020:00000080:2.0:1789635510.491583:0:17114:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789635510.491586:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789635510.491588:0:17114:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789635510.491630:0:17114:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789635510.491637:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789635510.491685:0:17114:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d054b800800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789635510.491697:0:17114:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8d0579bd99c0) 00000020:00000080:2.0:1789635510.491705:0:17114:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789635510.491756:0:17114:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789635510.491774:0:17114:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb0c3a59caa41003f 00000020:00000080:2.0:1789635510.491991:0:17114:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789635510.491998:0:17114:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789635510.492003:0:17114:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xb0c3a59caa410046 00080000:01000000:2.0:1789635510.492009:0:17114:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789635510.492012:0:17114:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb0c3a59caa41004d 00010000:00010000:3.0:1789635510.557167:0:17114:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789635510.557808:0:17114:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:3.0:1789635510.558349:0:17114:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789635510.559081:0:17114:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8d0575924d40) 00000020:00000080:3.0:1789635510.559111:0:17114:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789635510.559191:0:17114:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789635510.559199:0:17114:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb0c3a59caa41005b 00000020:00000080:1.0:1789635510.560048:0:17114:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789635510.563571:0:17114:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xb0c3a59caa410062 00000020:00000080:2.0:1789635510.564141:0:17114:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789635510.564153:0:17114:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789635510.564159:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635510.564161:0:17114:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789635510.564165:0:17114:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789635510.564168:0:17114:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1789635510.564170:0:17114:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789635510.564172:0:17114:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789635510.564173:0:17114:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789635510.564176:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635510.564178:0:17114:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789635510.564180:0:17114:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789635510.564185:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635510.564186:0:17114:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789635510.564191:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789635510.564233:0:17114:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789635510.564248:0:17114:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789635510.564251:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635510.564253:0:17114:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1789635510.564255:0:17114:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789635510.564259:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635510.564260:0:17114:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1789635510.564272:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789635510.564277:0:17114:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:00000080:2.0:1789635510.564312:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789635510.564337:0:17114:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8d0579bdb380) 00000020:00000080:2.0:1789635510.564350:0:17114:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1789635510.564355:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789635510.564418:0:17114:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1789635510.564423:0:17114:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789635510.564429:0:17114:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb0c3a59caa410070 00010000:00080000:2.0:1789635510.564455:0:17114:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d0546438000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.120@tcp at head 00010000:00010000:2.0:1789635510.568109:0:17114:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1789635510.571832:0:17114:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789635510.571865:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789635510.572022:0:17114:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789635510.572048:0:17114:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb0c3a59caa410077 00000100:00080000:3.0:1789635510.572058:0:17114:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789635510.572070:0:17114:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d0546438000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789635510.572103:0:17114:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d056e016680 x1876568427379456/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789635510.572133:0:17114:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1789635510.572189:0:17114:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789635510.572193:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635510.572195:0:17114:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1789635510.572198:0:17114:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789635510.572200:0:17114:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1789635510.572202:0:17114:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789635510.572203:0:17114:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789635510.572205:0:17114:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789635510.572207:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635510.572209:0:17114:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789635510.572211:0:17114:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789635510.572215:0:17114:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789635510.572364:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635510.572366:0:17114:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789635510.572371:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789635510.572374:0:17114:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:01000000:3.0:1789635510.572394:0:17114:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789635510.572396:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789635510.572407:0:17114:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d0575923380) 00000020:00000080:3.0:1789635510.572417:0:17114:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1789635510.572420:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789635510.572471:0:17114:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789635510.572476:0:17114:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789635510.572486:0:17114:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb0c3a59caa410085 00010000:00080000:3.0:1789635510.572511:0:17114:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d0546439800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.120@tcp at head 00010000:00010000:3.0:1789635510.572731:0:17114:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:2.0:1789635510.574131:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e016680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427379456:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789635510.574240:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635510.574466:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427379456 00000100:00100000:1.0:1789635510.574475:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427379456 00000100:00100000:1.0:1789635510.574503:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789635510.574511:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1876568427379456:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1789635510.574528:0:17101:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:3.0:1789635510.579923:0:17114:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789635510.580717:0:17114:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789635510.583540:0:17114:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789635510.583960:0:17114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1789635510.602009:0:17114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00100000:0.0:1789635510.611211:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1876568427379456:12345-0@lo:38:llog_process_th.0 Request processed in 36691us (36962us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789635510.611239:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789635510.611727:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d0546438000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789635510.611733:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789635510.611737:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e016680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427379456:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1789635510.612417:0:17120:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789635510.612422:0:17120:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789635510.613430:0:17114:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789635510.613449:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789635510.613498:0:17114:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789635510.613519:0:17114:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb0c3a59caa41008c 00000100:00080000:0.0:1789635510.613528:0:17114:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789635510.613540:0:17114:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d0546439800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1789635510.613573:0:17114:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0543290000 x1876568427379584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789635510.613676:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427379584:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789635510.613736:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876568427379584 offset 0 length 520: 4 00000100:00080000:0.0:1789635510.613971:0:17114:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789635510.614063:0:17114:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635510.614067:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635510.614069:0:17114:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789635510.614072:0:17114:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789635510.614074:0:17114:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1789635510.614076:0:17114:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789635510.614078:0:17114:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789635510.614079:0:17114:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789635510.614081:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635510.614083:0:17114:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789635510.614085:0:17114:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789635510.614089:0:17114:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789635510.614093:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635510.614094:0:17114:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789635510.614097:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789635510.614101:0:17114:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:01000000:0.0:1789635510.614119:0:17114:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789635510.614122:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789635510.614134:0:17114:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d056f5599c0) 00000020:00000080:0.0:1789635510.614145:0:17114:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1789635510.614150:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789635510.614208:0:17114:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789635510.614214:0:17114:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:0.0:1789635510.614235:0:17114:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb0c3a59caa41009a 00010000:00080000:0.0:1789635510.614265:0:17114:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d057604f000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.120@tcp at head 00010000:00010000:0.0:1789635510.614464:0:17114:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1789635510.614534:0:17114:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789635510.614551:0:17114:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789635510.616404:0:17114:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789635510.616620:0:17114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1789635510.616749:0:17114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1789635510.617635:0:17122:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789635510.617639:0:17122:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789635510.618719:0:17114:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789635510.618730:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789635510.618770:0:17114:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789635510.618788:0:17114:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb0c3a59caa4100a1 00000100:00080000:0.0:1789635510.618802:0:17114:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789635510.618814:0:17114:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d057604f000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1789635510.618884:0:17114:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0543293100 x1876568427379712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789635510.618913:0:17114:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789635510.618963:0:17114:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635510.618967:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635510.618969:0:17114:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789635510.618972:0:17114:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789635510.618976:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635510.618977:0:17114:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789635510.618980:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789635510.618982:0:17114:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789635510.618984:0:17114:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635510.618986:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635510.618987:0:17114:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789635510.618990:0:17114:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789635510.618992:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635510.618993:0:17114:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789635510.618997:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789635510.619035:0:17114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543292d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17114:1876568427379840:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789635510.619108:0:17114:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635510.619146:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427379840 00000100:00100000:0.0:1789635510.619152:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427379840 00000100:00100000:0.0:1789635510.619189:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789635510.619198:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+9:17114:x1876568427379840:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789635510.619367:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543293100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427379712:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789635510.619395:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876568427379712 offset 0 length 520: 4 00000100:00100000:0.0:1789635510.619692:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+9:17114:x1876568427379840:12345-0@lo:502:llog_process_th.0 Request processed in 494us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635510.619701:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789635510.619745:0:17114:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05461e8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789635510.619778:0:17114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543292d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17114:1876568427379840:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789635510.619803:0:17114:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635510.619807:0:17114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635510.619808:0:17114:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789635510.619812:0:17114:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1789635510.619958:0:17075:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1789635510.619977:0:17075:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789635510.620564:0:17075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152e00/0xb0c3a59caa410015 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa41001c expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.620576:0:17075:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e152e00/0xb0c3a59caa410015 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa41001c expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635510.620585:0:17075:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d054b800800 from 1 10000000:01000000:1.0:1789635510.620588:0:17075:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789635510.620639:0:17075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152a00/0xb0c3a59caa4100a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.620648:0:17075:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056e152a00/0xb0c3a59caa4100a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.620658:0:17075:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056e152a00/0xb0c3a59caa4100a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635510.620689:0:17075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543296680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17075:1876568427379968:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789635510.620726:0:17075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635510.620818:0:17075:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0544e0e540 going to sleep for 11 seconds 00000100:00100000:3.0:1789635510.621059:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427379968 00000100:00100000:3.0:1789635510.621065:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427379968 00000100:00100000:3.0:1789635510.621133:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789635510.621141:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+9:17075:x1876568427379968:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789635510.621153:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635510.621167:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d05488ff800/0xb0c3a59caa4100af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa4100a8 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635510.621190:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d05488ff800/0xb0c3a59caa4100af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa4100a8 expref: 10 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635510.621199:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d05488ff800/0xb0c3a59caa4100af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa4100a8 expref: 10 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635510.621208:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05488ff800, rc 0) 00000100:00100000:3.0:1789635510.621260:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+10:17075:x1876568427379968:12345-0@lo:101:mount.lustre.0 Request processed in 120us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635510.621273:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789635510.621341:0:17075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543296680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17075:1876568427379968:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789635510.621354:0:17075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056e152a00/0xb0c3a59caa4100a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4100af expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.621362:0:17075:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056e152a00/0xb0c3a59caa4100a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa4100af expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635510.622121:0:17075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543296680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17075:1876568427380096:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789635510.622163:0:17075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635510.622370:0:17075:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0544e0e540 going to sleep for 11 seconds 00000100:00100000:0.0:1789635510.622468:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427380096 00000100:00100000:0.0:1789635510.622474:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427380096 00000100:00100000:0.0:1789635510.622499:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789635510.622506:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+10:17075:x1876568427380096:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789635510.622521:0:17090:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789635510.622527:0:17090:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789635510.622610:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+10:17075:x1876568427380096:12345-0@lo:256:mount.lustre.0 Request processed in 89us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635510.622617:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789635510.622683:0:17075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543296680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17075:1876568427380096:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789635510.623361:0:17075:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789635510.623420:0:17075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152a00/0xb0c3a59caa4100a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4100af expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.623430:0:17075:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e152a00/0xb0c3a59caa4100a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4100af expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635510.623439:0:17075:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d054b800800 from 1 10000000:01000000:1.0:1789635510.623441:0:17075:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789635510.623468:0:17075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e153a00/0xb0c3a59caa4100b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.623532:0:17075:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056e153a00/0xb0c3a59caa4100b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.623542:0:17075:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056e153a00/0xb0c3a59caa4100b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635510.623559:0:17075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543296680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17075:1876568427380224:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789635510.623618:0:17075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635510.623644:0:17075:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0544e0e540 going to sleep for 11 seconds 00000100:00100000:3.0:1789635510.623816:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427380224 00000100:00100000:3.0:1789635510.623822:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427380224 00000100:00100000:3.0:1789635510.623862:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789635510.623869:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+10:17075:x1876568427380224:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789635510.623888:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635510.623901:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d05488ff200/0xb0c3a59caa4100bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa4100b6 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635510.623920:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d05488ff200/0xb0c3a59caa4100bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa4100b6 expref: 11 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635510.623928:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d05488ff200/0xb0c3a59caa4100bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa4100b6 expref: 11 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635510.623935:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05488ff200, rc 0) 00000100:00100000:3.0:1789635510.623974:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+11:17075:x1876568427380224:12345-0@lo:101:mount.lustre.0 Request processed in 106us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635510.623981:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789635510.624147:0:17075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543296680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17075:1876568427380224:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789635510.624159:0:17075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056e153a00/0xb0c3a59caa4100b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4100bd expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.624167:0:17075:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056e153a00/0xb0c3a59caa4100b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa4100bd expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635510.624234:0:17075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543296680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17075:1876568427380352:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789635510.624259:0:17075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635510.624285:0:17075:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0544e0e540 going to sleep for 11 seconds 00000100:00100000:3.0:1789635510.624384:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427380352 00000100:00100000:3.0:1789635510.624388:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427380352 00000100:00100000:3.0:1789635510.624405:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789635510.624411:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+11:17075:x1876568427380352:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789635510.624528:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+11:17075:x1876568427380352:12345-0@lo:501:mount.lustre.0 Request processed in 117us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635510.624535:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789635510.624626:0:17075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543296680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17075:1876568427380352:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789635510.624653:0:17075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543296680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17075:1876568427380480:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789635510.624690:0:17075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635510.624700:0:17075:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0544e0e540 going to sleep for 11 seconds 00000100:00100000:3.0:1789635510.624753:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427380480 00000100:00100000:3.0:1789635510.624772:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427380480 00000100:00100000:3.0:1789635510.624790:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789635510.624796:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+11:17075:x1876568427380480:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789635510.625004:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+11:17075:x1876568427380480:12345-0@lo:503:mount.lustre.0 Request processed in 208us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635510.625011:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789635510.625091:0:17075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543296680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17075:1876568427380480:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789635510.625978:0:17124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543292d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17124:1876568427380608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789635510.626040:0:17124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635510.626082:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427380608 00000100:00100000:0.0:1789635510.626267:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427380608 00000100:00100000:0.0:1789635510.626315:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789635510.626506:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+11:17124:x1876568427380608:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789635510.626779:0:17124:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d055060f480 going to sleep for 11 seconds 00000100:00100000:0.0:1789635510.627531:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+11:17124:x1876568427380608:12345-0@lo:502:llog_process_th.0 Request processed in 1203us (1489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635510.627541:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789635510.627710:0:17124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543292d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17124:1876568427380608:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789635510.627806:0:17124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789635510.627816:0:17124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635510.627819:0:17124:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789635510.627825:0:17124:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d054b800800 00000020:00000080:0.0:1789635510.627828:0:17124:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789635510.627834:0:17124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635510.627837:0:17124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635510.627838:0:17124:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789635510.627841:0:17124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789635510.628041:0:17124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635510.628043:0:17124:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789635510.628048:0:17124:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d054b800800 00000020:00000080:0.0:1789635510.628051:0:17124:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789635510.628149:0:17124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635510.628154:0:17124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635510.628155:0:17124:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789635510.628157:0:17124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789635510.628160:0:17124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635510.628161:0:17124:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789635510.628166:0:17124:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d054b800800 00000020:00000080:0.0:1789635510.628168:0:17124:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789635510.631028:0:17124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635510.631041:0:17124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635510.631049:0:17124:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789635510.631053:0:17124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789635510.631058:0:17124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635510.631059:0:17124:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789635510.631064:0:17124:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d054b800800 00000020:00000080:0.0:1789635510.631066:0:17124:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789635510.631145:0:17124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543292d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17124:1876568427380736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789635510.631229:0:17124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635510.631266:0:17124:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d055060f480 going to sleep for 11 seconds 00000100:00100000:3.0:1789635510.631466:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427380736 00000100:00100000:3.0:1789635510.631473:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427380736 00000100:00100000:3.0:1789635510.631527:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789635510.631536:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+11:17124:x1876568427380736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789635510.631678:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+11:17124:x1876568427380736:12345-0@lo:502:llog_process_th.0 Request processed in 142us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635510.631686:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789635510.631817:0:17124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543292d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17124:1876568427380736:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789635510.631855:0:17124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635510.631860:0:17124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635510.631861:0:17124:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789635510.631864:0:17124:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789635510.631987:0:17075:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789635510.632008:0:17075:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789635510.632024:0:17075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e153a00/0xb0c3a59caa4100b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4100bd expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635510.632034:0:17075:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e153a00/0xb0c3a59caa4100b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4100bd expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635510.632092:0:17075:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789635510.632095:0:17075:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d054b800800 10000000:01000000:0.0:1789635510.632098:0:17075:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d054b800800 10000000:01000000:0.0:1789635510.632102:0:17075:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789635510.632107:0:17075:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d054b800800 from 1 10000000:01000000:0.0:1789635510.632110:0:17075:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789635510.632137:0:17075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d0446d1a200/0xb0c3a59caa4100c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635510.632156:0:17075:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d0446d1a200/0xb0c3a59caa4100c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635510.632166:0:17075:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d0446d1a200/0xb0c3a59caa4100c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635510.632181:0:17075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543292d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17075:1876568427380864:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789635510.632214:0:17075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635510.632440:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427380864 00000100:00100000:0.0:1789635510.632445:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427380864 00000100:00100000:0.0:1789635510.632518:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789635510.632525:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+11:17075:x1876568427380864:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789635510.632536:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635510.632549:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0446d1b200/0xb0c3a59caa4100cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa4100c4 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635510.632570:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0446d1b200/0xb0c3a59caa4100cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa4100c4 expref: 12 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635510.632580:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0446d1b200/0xb0c3a59caa4100cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa4100c4 expref: 12 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635510.632588:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1b200, rc 0) 00000100:00100000:0.0:1789635510.632639:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+12:17075:x1876568427380864:12345-0@lo:101:mount.lustre.0 Request processed in 115us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635510.632646:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789635510.635104:0:17075:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d055060f540 going to sleep for 11 seconds 00000100:00100000:0.0:1789635510.635148:0:17075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543292d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17075:1876568427380864:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789635510.635172:0:17075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d0446d1a200/0xb0c3a59caa4100c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4100cb expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635510.635185:0:17075:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d0446d1a200/0xb0c3a59caa4100c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa4100cb expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635510.635345:0:17075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543292d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17075:1876568427380992:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789635510.635401:0:17075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635510.635467:0:17075:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d055060f540 going to sleep for 11 seconds 00000100:00100000:1.0:1789635510.636656:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427380992 00000100:00100000:1.0:1789635510.636671:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427380992 00000100:00100000:1.0:1789635510.636726:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789635510.636735:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+12:17075:x1876568427380992:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789635510.637035:0:17075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543292d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17075:1876568427380992:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789635510.637078:0:17075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543292d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17075:1876568427381120:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789635510.637083:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+12:17075:x1876568427380992:12345-0@lo:501:mount.lustre.0 Request processed in 349us (1681us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635510.637091:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789635510.637119:0:17075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635510.637142:0:17075:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d055060f540 going to sleep for 11 seconds 00000100:00100000:0.0:1789635510.637156:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427381120 00000100:00100000:0.0:1789635510.637160:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427381120 00000100:00100000:0.0:1789635510.637230:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789635510.637239:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+12:17075:x1876568427381120:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789635510.637335:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+12:17075:x1876568427381120:12345-0@lo:503:mount.lustre.0 Request processed in 97us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635510.637343:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789635510.638045:0:17075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543292d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17075:1876568427381120:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789635510.639074:0:17128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543296680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17128:1876568427381248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635510.639134:0:17128:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635510.639214:0:17128:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05677b0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789635510.643134:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427381248 00000100:00100000:2.0:1789635510.643150:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427381248 00000100:00100000:2.0:1789635510.643214:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789635510.643224:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+12:17128:x1876568427381248:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789635510.643385:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+12:17128:x1876568427381248:12345-0@lo:502:llog_process_th.0 Request processed in 162us (4249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635510.643392:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789635510.643726:0:17128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543296680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17128:1876568427381248:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1789635510.643803:0:17128:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789635510.643818:0:17128:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8d04478a19c0) 00000020:00000080:1.0:1789635510.643836:0:17128:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1789635510.644061:0:17128:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d054b800800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789635510.644066:0:17128:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d054b800800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789635510.644068:0:17128:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d054b800800 4 00010000:00080000:1.0:1789635510.644108:0:17128:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d0554287800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.120@tcp at head 00010000:00010000:1.0:1789635510.648265:0:17128:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1789635510.648447:0:17128:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789635510.648488:0:17128:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789635510.648500:0:17128:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xb0c3a59caa4100d9 00000100:00080000:1.0:1789635510.648509:0:17128:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789635510.648520:0:17128:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d0554287800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1789635510.648567:0:17128:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0543296680 x1876568427381376/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789635510.648701:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876568427381376:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1789635510.649785:0:17128:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789635510.649995:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635510.650106:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427381376 00000100:00100000:1.0:1789635510.650114:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427381376 00000100:00100000:1.0:1789635510.650217:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789635510.650225:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e017800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1876568427381376:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789635510.650301:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e017800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1876568427381376:12345-0@lo:38:llog_process_th.0 Request processed in 75us (306us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789635510.650308:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789635510.650366:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789635510.650373:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d0554287800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789635510.650377:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789635510.650381:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876568427381376:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789635510.650563:0:17128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543295880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17128:1876568427381504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635510.650639:0:17128:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635510.650661:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427381504 00000100:00100000:1.0:1789635510.650666:0:17128:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05677b0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789635510.650666:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427381504 00000100:00100000:0.0:1789635510.650705:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789635510.650713:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+12:17128:x1876568427381504:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789635510.650882:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+12:17128:x1876568427381504:12345-0@lo:502:llog_process_th.0 Request processed in 169us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635510.650895:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789635510.650982:0:17128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543295880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17128:1876568427381504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635510.651019:0:17128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543295880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17128:1876568427381632:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635510.651056:0:17128:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635510.651080:0:17128:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05677b0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789635510.651122:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427381632 00000100:00100000:0.0:1789635510.651126:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427381632 00000100:00100000:0.0:1789635510.651147:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789635510.651152:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+12:17128:x1876568427381632:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789635510.651256:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+12:17128:x1876568427381632:12345-0@lo:502:llog_process_th.0 Request processed in 102us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635510.651263:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789635510.651985:0:17128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543295880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17128:1876568427381632:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789635510.652061:0:17128:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789635510.652478:0:17075:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789635510.652503:0:17075:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789635510.652531:0:17075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d0446d1a200/0xb0c3a59caa4100c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4100cb expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635510.652683:0:17075:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d0446d1a200/0xb0c3a59caa4100c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4100cb expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789635510.652729:0:17075:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789635510.652732:0:17075:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789635510.652733:0:17075:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789635510.652734:0:17075:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789635510.652735:0:17075:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789635510.652737:0:17075:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789635510.652738:0:17075:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789635510.652740:0:17075:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789635510.652742:0:17075:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789635510.652743:0:17075:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789635510.652747:0:17075:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1789635510.652749:0:17075:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789635510.652750:0:17075:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789635510.652752:0:17075:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789635510.652753:0:17075:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789635510.652754:0:17075:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789635510.652755:0:17075:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789635510.652756:0:17075:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789635510.652768:0:17075:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789635510.652770:0:17075:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789635510.652771:0:17075:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789635510.652790:0:17075:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789635510.652814:0:17075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17075:1876568427381760:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789635510.652877:0:17075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635510.652909:0:17075:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b6753c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635510.652978:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427381760 00000100:00100000:1.0:1789635510.652985:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427381760 00000100:00100000:1.0:1789635510.653023:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789635510.653031:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+12:17075:x1876568427381760:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789635510.653055:0:17089:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789635510.653068:0:17089:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789635510.655443:0:17089:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789635510.655462:0:17089:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789635510.655568:0:17112:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789635510.655573:0:17112:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789635510.655728:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa4100e0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635510.655751:0:17112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d05488ff800/0xb0c3a59caa4100af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa4100a8 expref: 12 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635510.655769:0:17112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa4100e0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635510.655806:0:17112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d05488ff800/0xb0c3a59caa4100af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa4100a8 expref: 12 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635510.655819:0:17112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d05488ff800/0xb0c3a59caa4100af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa4100a8 expref: 12 pid: 17091 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635510.655833:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17112:1876568427381888:0@lo:104: 00000100:00100000:1.0:1789635510.656164:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+12:17075:x1876568427381760:12345-0@lo:253:mount.lustre.0 Request processed in 3132us (3284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635510.656180:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789635510.656292:0:17075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17075:1876568427381760:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789635510.656306:0:17075:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789635510.656310:0:17075:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789635510.656311:0:17075:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789635510.656312:0:17075:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789635510.656313:0:17075:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789635510.656315:0:17075:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789635510.656316:0:17075:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789635510.656322:0:17075:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789635510.656323:0:17075:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789635510.656325:0:17075:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789635510.656326:0:17075:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789635510.656339:0:17075:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1789635510.660002:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635510.660111:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0551233840 going to sleep for 11 seconds 00000100:00100000:1.0:1789635510.665716:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427381888 00000100:00100000:1.0:1789635510.665729:0:17079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427381888 00000100:00100000:1.0:1789635510.665790:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789635510.665800:0:17079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+3:17112:x1876568427381888:12345-0@lo:104: 00010000:00010000:1.0:1789635510.665818:0:17079:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d056e152a00/0xb0c3a59caa4100a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa4100af expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.666158:0:17079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789635510.666166:0:17079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+3:17112:x1876568427381888:12345-0@lo:104: Request processed in 367us (6170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635510.666174:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789635510.666369:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17112:1876568427381888:0@lo:104: 00010000:00010000:3.0:1789635510.666392:0:17112:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa4100e0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.669700:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635510.669712:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d056e152a00/0xb0c3a59caa4100a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa4100af expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.669723:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152a00 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:1.0:1789635510.669728:0:17085:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d056e152a00/0xb0c3a59caa4100a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa4100af expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.669738:0:17085:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056e152a00/0xb0c3a59caa4100a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa4100af expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789635510.669746:0:17085:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056e152a00/0xb0c3a59caa4100a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa4100af expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635510.669752:0:17085:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789635510.669809:0:17085:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d056e152a00/0xb0c3a59caa4100a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa4100af expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.669828:0:17085:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789635510.669849:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d056e152a00/0xb0c3a59caa4100a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa4100af expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.669856:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056e152a00/0xb0c3a59caa4100a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa4100af expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.669872:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635510.669874:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635510.669876:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635510.669923:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3641:1876568427382016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789635510.669984:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635510.670077:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427382016 00000100:00100000:1.0:1789635510.670086:0:17081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427382016 00010000:00010000:1.0:1789635510.670111:0:17081:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d05488ff800/0xb0c3a59caa4100af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa4100a8 expref: 12 pid: 17091 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635510.670137:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789635510.670146:0:17081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543297b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+12:3641:x1876568427382016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789635510.670158:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635510.670164:0:17081:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d05488ff800/0xb0c3a59caa4100af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa4100a8 expref: 12 pid: 17091 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.670175:0:17081:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d05488ff800/0xb0c3a59caa4100af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa4100a8 expref: 12 pid: 17091 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.670834:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d05488ff800/0xb0c3a59caa4100af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa4100a8 expref: 12 pid: 17091 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.670860:0:17081:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa4100e0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.670868:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa4100e0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789635510.671266:0:17081:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015693848s 00010000:00010000:1.0:1789635510.671273:0:17081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa4100e0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.671281:0:17081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa4100e0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.671288:0:17081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa4100e0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.671294:0:17081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa4100e0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.671299:0:17081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a2800 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:1.0:1789635510.671303:0:17081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa4100e0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.671310:0:17081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa4100e0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.671325:0:17081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa4100e0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.671335:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635510.671469:0:17081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543297b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+11:3641:x1876568427382016:12345-0@lo:103:ldlm_bl.0 Request processed in 1322us (1483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635510.671478:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789635510.671508:0:17112:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa4100e0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.671516:0:17112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa4100e0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635510.671522:0:17112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa4100e0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635510.671674:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3641:1876568427382016:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1789635510.677657:0:17075:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1789635510.678060:0:17075:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1789635510.678167:0:17135:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1789635510.678170:0:17135:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1789635510.678471:0:17136:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1789635510.678820:0:17136:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1789635510.679939:0:17075:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:3.0:1789635510.680469:0:17137:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8d056e016d80 x1876568427382144/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635510.680481:0:17137:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549cf4a80 going to sleep for 0 seconds 00000040:01000000:2.0:1789635510.681169:0:17075:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789635510.681211:0:17075:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789635510.681981:0:17075:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789635510.681997:0:17075:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789635510.682035:0:17075:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789635510.682935:0:17136:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789635510.682994:0:17136:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1789635510.683546:0:17075:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789635510.684302:0:17075:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789635510.684339:0:17075:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1789635510.685030:0:17075:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:2.0:1789635510.685863:0:17075:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:2.0:1789635510.687903:0:17075:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1789635510.689733:0:17075:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789635510.689774:0:17075:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa6bb41c4b988 00100000:10000000:2.0:1789635510.689789:0:17075:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789635510.691085:0:17075:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789635510.691110:0:17075:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.120@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789635510.691127:0:17075:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789635510.691145:0:17075:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1789635510.695266:0:17075:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789635510.695487:0:17075:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789635511.331839:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789635511.653217:0:17130:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789635511.653226:0:17130:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789635511.655888:0:17130:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:3.0:1789635511.655902:0:17130:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:3.0:1789635511.716033:0:17094:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789635511.716041:0:17094:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d054b800800 from 7 10000000:01000000:3.0:1789635511.716046:0:17094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789635511.716095:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05488ffc00/0xb0c3a59caa4100e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635511.716107:0:17094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d05488ffc00/0xb0c3a59caa4100e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635511.716135:0:17094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d05488ffc00/0xb0c3a59caa4100e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635511.716142:0:17137:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549cf4a80 going to sleep for 0 seconds 00000100:00100000:3.0:1789635511.716162:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e017100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427382272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789635511.716230:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635511.716272:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b5ebc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789635511.716488:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427382272 00000100:00100000:0.0:1789635511.716497:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427382272 00000100:00100000:0.0:1789635511.716553:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789635511.716564:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+11:17094:x1876568427382272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789635511.716577:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635511.716592:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0446d1aa00/0xb0c3a59caa4100ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa4100e7 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635511.716635:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0446d1aa00/0xb0c3a59caa4100ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa4100e7 expref: 12 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635511.716646:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0446d1aa00/0xb0c3a59caa4100ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa4100e7 expref: 12 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635511.716661:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1aa00, rc 0) 00000100:00100000:0.0:1789635511.716707:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+12:17094:x1876568427382272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635511.716713:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789635511.716800:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e017100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427382272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789635511.716944:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d05488ffc00/0xb0c3a59caa4100e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4100ee expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635511.716955:0:17094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d05488ffc00/0xb0c3a59caa4100e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa4100ee expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635511.717090:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e017100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427382400:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789635511.717126:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635511.717158:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b5ebc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789635511.717316:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427382400 00000100:00100000:2.0:1789635511.717322:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427382400 00000100:00100000:2.0:1789635511.717358:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789635511.717366:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+12:17094:x1876568427382400:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789635511.717382:0:17089:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789635511.717398:0:17089:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789635511.717401:0:17089:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789635511.717499:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+12:17094:x1876568427382400:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 133us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635511.717505:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789635511.718080:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e017100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427382400:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789635511.718126:0:17094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789635511.718135:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05488ffc00/0xb0c3a59caa4100e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4100ee expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635511.718144:0:17094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d05488ffc00/0xb0c3a59caa4100e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4100ee expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635512.360090:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789635512.675803:0:17130:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789635512.675817:0:17130:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789635512.675949:0:17130:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1789635512.675987:0:17130:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789635512.676199:0:17130:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00000100:00100000:2.0:1789635512.739676:0:17137:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549cf4a80 going to sleep for 0 seconds 00010000:00010000:2.0:1789635513.379728:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635513.769065:0:17137:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549cf4a80 going to sleep for 0 seconds 00010000:00010000:1.0:1789635514.403921:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789635514.677052:0:17380:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789635514.790038:0:17137:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549cf4a80 going to sleep for 0 seconds 00010000:00010000:1.0:1789635515.427744:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789635515.490361:0:17432:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789635515.490530:0:17432:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789635515.813327:0:17137:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549cf4a80 going to sleep for 0 seconds 00000100:00100000:1.0:1789635515.814128:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:3.0:1789635515.814156:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789635515.814161:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789635515.814166:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d0546438000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789635515.814177:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 529 00000100:00080000:3.0:1789635515.814184:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789635515.814200:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d0546438000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789635515.814233:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d056e014380 x1876568427382656/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789635515.814273:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789635515.814278:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789635515.814281:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789635515.814285:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789635515.814288:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789635515.814292:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789635515.814294:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d0554287800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789635515.814300:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d0554287800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789635515.814313:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d056e015880 x1876568427382784/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789635515.814406:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427382656:0@lo:38:kworker.0 00000100:00100000:2.0:1789635515.814505:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635515.814579:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e015880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876568427382784:0@lo:38:kworker.0 00000100:00100000:2.0:1789635515.814659:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635515.814767:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427382784 00000100:00100000:3.0:1789635515.814795:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427382784 00000100:00100000:3.0:1789635515.814853:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789635515.814861:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1876568427382784:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789635515.814891:0:17098:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 534 last 0 00000020:00000080:3.0:1789635515.814945:0:17098:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xb0c3a59caa4100f5 00000004:00100000:3.0:1789635515.814964:0:17098:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789635515.815115:0:17098:0:(import.c:65:import_set_state_nolock()) ffff8d056e353000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789635515.815176:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876568427382784:12345-0@lo:38:kworker.0 Request processed in 314us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635515.815184:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789635515.815405:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d056e015880 x1876568427382784/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789635525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789635515.815422:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789635515.815431:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789635515.815447:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789635515.815450:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d0554287800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789635515.815456:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e015880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876568427382784:0@lo:38:kworker.0 00000100:00100000:0.0:1789635515.815913:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427382656 00000100:00100000:0.0:1789635515.815921:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427382656 00000100:00100000:0.0:1789635515.815957:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789635515.815964:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3639:x1876568427382656:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789635515.815979:0:17102:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789635515.818041:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3643:1876568427382528:0@lo:400:kworker.0 00000100:00100000:1.0:1789635515.818151:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635515.818298:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427382528 00000100:00100000:2.0:1789635515.818308:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427382528 00000100:00100000:2.0:1789635515.818386:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789635515.818397:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+12:3643:x1876568427382528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635515.820915:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+12:3643:x1876568427382528:12345-0@lo:400:kworker.0 Request processed in 2507us (2750us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635515.820933:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789635515.824534:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3643:1876568427382528:0@lo:400:kworker.0 00000100:00100000:0.0:1789635515.834345:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3639:x1876568427382656:12345-0@lo:38:kworker.0 Request processed in 18366us (19826us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789635515.834378:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789635515.834415:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d0546438000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789635515.834423:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789635515.834429:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427382656:0@lo:38:kworker.0 00000020:00000004:2.0:1789635516.311238:0:17482:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789635516.311432:0:17482:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789635516.451812:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635516.836117:0:17137:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549cf4a80 going to sleep for 0 seconds 00010000:00010000:1.0:1789635517.478176:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635517.859879:0:17137:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549cf4a80 going to sleep for 0 seconds 00010000:00010000:3.0:1789635518.502224:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635518.883745:0:17137:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549cf4a80 going to sleep for 0 seconds 00010000:00010000:3.0:1789635519.523959:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635519.909654:0:17137:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549cf4a80 going to sleep for 0 seconds 00010000:00010000:3.0:1789635520.547925:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789635520.932114:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789635520.932416:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789635520.932423:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d0546438000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789635520.932431:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 534 00000100:00080000:3.0:1789635520.932437:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789635520.932448:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d0546438000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789635520.932473:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d056e015180 x1876568427383040/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789635520.932501:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789635520.932504:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789635520.932508:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789635520.932510:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789635520.932640:0:17137:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549cf4a80 going to sleep for 0 seconds 00000100:00100000:1.0:1789635520.932664:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e017480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427383168:0@lo:400:kworker.0 00000100:00100000:1.0:1789635520.932746:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635520.932837:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427383168 00000100:00100000:3.0:1789635520.932848:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427383168 00000100:00100000:3.0:1789635520.932901:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789635520.932909:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427383168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635520.932942:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3643:1876568427382912:0@lo:400:kworker.0 00000100:00100000:3.0:1789635520.932967:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427383168:12345-0@lo:400:kworker.0 Request processed in 57us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635520.932974:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789635520.932985:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635520.933021:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789635510/real 1789635510] req@ffff8d0543293100 x1876568427379712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789635520 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635520.933040:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d0543293100 x1876568427379712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789635520 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635520.933044:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427382912 00000100:00100000:2.0:1789635520.933050:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427382912 00000100:00100000:2.0:1789635520.933079:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789635520.933086:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+12:3643:x1876568427382912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635520.933110:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789635510/real 1789635510] req@ffff8d0543290000 x1876568427379584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789635520 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635520.933122:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+12:3643:x1876568427382912:12345-0@lo:400:kworker.0 Request processed in 36us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635520.933127:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d0543290000 x1876568427379584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789635520 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635520.933134:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789635520.933150:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e015180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427383040:0@lo:38:kworker.0 00000100:00100000:2.0:1789635520.933179:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3643:1876568427382912:0@lo:400:kworker.0 00000100:00100000:3.0:1789635520.933187:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789635520.933209:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d057604f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789635520.933236:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789635520.933241:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543293100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427379712:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789635520.933247:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d0546439800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789635520.933255:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789635520.933258:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427379584:0@lo:8:llog_process_th.0 00010000:00080000:1.0:1789635520.933265:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d056e017480 x1876568427383168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635520.933278:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e017480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427383168:0@lo:400:kworker.0 00000100:00100000:3.0:1789635520.933297:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427383040 00000100:00100000:3.0:1789635520.933302:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427383040 00000100:00100000:3.0:1789635520.933334:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789635520.933339:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e014e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1876568427383040:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789635520.933355:0:17101:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1789635520.933539:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789635520.933544:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789635520.933546:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d0546439800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789635520.933556:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 529 00000100:00080000:2.0:1789635520.933559:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789635520.933565:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d0546439800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1789635520.933581:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d05759d0380 x1876568427383296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789635520.933615:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789635520.933619:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789635520.933621:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d057604f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789635520.933624:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 529 00000100:00080000:2.0:1789635520.933627:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789635520.933631:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d057604f000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1789635520.933641:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d05759d1180 x1876568427383424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789635520.933699:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427383296:0@lo:8:kworker.0 00000400:00000100:1.0:1789635520.933727:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876568427383296 offset 0 length 520: 4 00000100:00100000:1.0:1789635520.933745:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427383424:0@lo:8:kworker.0 00000400:00000100:1.0:1789635520.933759:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876568427383424 offset 0 length 520: 4 00000100:00100000:3.0:1789635520.950653:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e014e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1876568427383040:12345-0@lo:38:kworker.0 Request processed in 17304us (17460us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789635520.950667:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789635520.950957:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d0546438000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789635520.950963:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789635520.950966:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e015180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427383040:0@lo:38:kworker.0 00010000:00010000:3.0:1789635521.571781:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635521.955666:0:17137:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549cf4a80 going to sleep for 0 seconds 00000020:01000004:1.0:1789635522.009573:0:17827:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789635522.009577:0:17827:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1789635522.009579:0:17827:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789635522.010085:0:17827:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d0550104800 00000020:01000004:0.0:1789635522.010168:0:17827:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1789635522.010180:0:17827:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789635522.010194:0:17827:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8d0574728000) 00000020:00000080:0.0:1789635522.010209:0:17827:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789635522.078697:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789635522.082172:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1789635522.085570:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789635522.086170:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789635522.086631:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789635522.086872:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1789635522.087070:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1789635522.087539:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1789635522.087904:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1789635522.088109:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789635522.088376:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1789635522.088757:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1789635522.088991:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789635522.089268:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1789635522.090736:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1789635522.091337:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1789635522.091741:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1789635522.091999:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1789635522.092205:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1789635522.092649:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1789635522.092930:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1789635522.093166:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1789635522.093689:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1789635522.093948:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1789635522.094144:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1789635522.094687:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1789635522.094942:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1789635522.095545:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1789635522.096034:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1789635522.097010:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1789635522.098689:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1789635522.099028:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1789635522.099739:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1789635522.102380:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1789635522.104927:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1789635522.105272:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1789635522.105842:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1789635522.106077:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1789635522.106291:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1789635522.106707:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1789635522.106969:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1789635522.107238:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1789635522.107667:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1789635522.107889:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1789635522.108069:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1789635522.108374:0:17827:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00080000:01000000:0.0:1789635522.109921:0:17827:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789635522.110137:0:17827:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1789635522.110148:0:17827:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789635522.110160:0:17827:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb0c3a59caa410103 00000020:01000004:0.0:1789635522.110167:0:17827:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789635522.110188:0:17827:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.120@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789635522.110191:0:17827:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789635522.110196:0:17827:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1789635522.110222:0:17827:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1789635522.110226:0:17827:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.120@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1789635522.117100:0:17827:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789635522.117147:0:17827:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.120@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1789635522.117151:0:17827:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789635522.117153:0:17827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789635522.117154:0:17827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789635522.117155:0:17827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789635522.117156:0:17827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789635522.117158:0:17827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789635522.117159:0:17827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789635522.117161:0:17827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789635522.117162:0:17827:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789635522.117166:0:17827:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1789635522.117168:0:17827:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789635522.117169:0:17827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789635522.117171:0:17827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789635522.117172:0:17827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789635522.117173:0:17827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789635522.117174:0:17827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789635522.117175:0:17827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789635522.117176:0:17827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789635522.117177:0:17827:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789635522.117203:0:17827:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789635522.117223:0:17827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543295c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427383552:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789635522.117292:0:17827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635522.117494:0:17827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0441455540 going to sleep for 11 seconds 00000100:00100000:2.0:1789635522.117846:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427383552 00000100:00100000:2.0:1789635522.117855:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427383552 00000100:00100000:2.0:1789635522.117944:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789635522.117956:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+12:17827:x1876568427383552:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789635522.118011:0:17091:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789635522.118014:0:17091:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1789635522.118021:0:17091:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1789635522.118661:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+12:17827:x1876568427383552:12345-0@lo:253:mount.lustre.0 Request processed in 705us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635522.118679:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789635522.118781:0:17827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543295c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427383552:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789635522.118802:0:17827:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789635522.118805:0:17827:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789635522.118807:0:17827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789635522.118808:0:17827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789635522.118810:0:17827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789635522.118811:0:17827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789635522.118812:0:17827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789635522.118813:0:17827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789635522.118815:0:17827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789635522.118816:0:17827:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789635522.118831:0:17827:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d0550104800 from lustre-MDT0001 10000000:01000000:1.0:1789635522.118857:0:17827:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1789635522.118860:0:17827:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789635522.118866:0:17827:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d056f55b380 local copy 00010000:00010000:1.0:1789635522.118875:0:17827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2a00/0xb0c3a59caa40fff9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410000 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635522.118964:0:17827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543295c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427383680:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789635522.119008:0:17827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635522.119416:0:17827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0441455180 going to sleep for 11 seconds 00000100:00100000:0.0:1789635522.119961:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427383680 00000100:00100000:0.0:1789635522.119978:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427383680 00000100:00100000:0.0:1789635522.120017:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789635522.120026:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+12:17827:x1876568427383680:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789635522.120129:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+12:17827:x1876568427383680:12345-0@lo:501:mount.lustre.0 Request processed in 103us (1118us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789635522.120135:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789635522.120206:0:17827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543295c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427383680:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789635522.120223:0:17827:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789635522.120244:0:17827:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789635522.120252:0:17827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2a00/0xb0c3a59caa40fff9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410000 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635522.120262:0:17827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2a00/0xb0c3a59caa40fff9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410000 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635522.120290:0:17827:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d0550104800 10000000:01000000:1.0:1789635522.120305:0:17827:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789635522.120319:0:17827:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d056f55b380 10000000:01000000:1.0:1789635522.120323:0:17827:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789635522.120326:0:17827:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8d056f55b380 from 1 10000000:01000000:1.0:1789635522.120329:0:17827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789635522.120357:0:17827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e153600/0xb0c3a59caa41010a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635522.120366:0:17827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056e153600/0xb0c3a59caa41010a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635522.120375:0:17827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056e153600/0xb0c3a59caa41010a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635522.120390:0:17827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543295c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427383808:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789635522.120416:0:17827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635522.120451:0:17827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0441455180 going to sleep for 11 seconds 00000100:00100000:0.0:1789635522.120744:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427383808 00000100:00100000:0.0:1789635522.120758:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427383808 00000100:00100000:0.0:1789635522.120779:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789635522.120786:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+12:17827:x1876568427383808:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789635522.120794:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635522.120805:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0446d1bc00/0xb0c3a59caa410111 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa41010a expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635522.120830:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0446d1bc00/0xb0c3a59caa410111 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa41010a expref: 13 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635522.120839:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0446d1bc00/0xb0c3a59caa410111 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa41010a expref: 13 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635522.120848:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1bc00, rc 0) 00000100:00100000:0.0:1789635522.120886:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+13:17827:x1876568427383808:12345-0@lo:101:mount.lustre.0 Request processed in 101us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635522.120893:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789635522.121052:0:17827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543295c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427383808:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789635522.121064:0:17827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056e153600/0xb0c3a59caa41010a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410111 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635522.121072:0:17827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056e153600/0xb0c3a59caa41010a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa410111 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635522.121087:0:17827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789635522.121102:0:17827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e153600/0xb0c3a59caa41010a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410111 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635522.121109:0:17827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e153600/0xb0c3a59caa41010a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410111 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635522.121129:0:17827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d0550104800 10000000:01000000:1.0:1789635522.121133:0:17827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789635522.121137:0:17827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d0550104800 from 1 10000000:01000000:1.0:1789635522.121138:0:17827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789635522.121155:0:17827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152400/0xb0c3a59caa410118 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635522.121161:0:17827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056e152400/0xb0c3a59caa410118 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635522.121169:0:17827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056e152400/0xb0c3a59caa410118 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635522.121181:0:17827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543295c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427383936:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789635522.121206:0:17827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635522.121228:0:17827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0441455180 going to sleep for 11 seconds 00000100:00100000:0.0:1789635522.121274:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427383936 00000100:00100000:0.0:1789635522.121279:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427383936 00000100:00100000:0.0:1789635522.121296:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789635522.121301:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+13:17827:x1876568427383936:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789635522.121307:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635522.121385:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0446d1ba00/0xb0c3a59caa41011f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa410118 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635522.121401:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0446d1ba00/0xb0c3a59caa41011f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa410118 expref: 14 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635522.121410:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0446d1ba00/0xb0c3a59caa41011f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa410118 expref: 14 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635522.121416:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1ba00, rc 0) 00000100:00100000:0.0:1789635522.121558:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+14:17827:x1876568427383936:12345-0@lo:101:mount.lustre.0 Request processed in 256us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635522.121573:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789635522.121870:0:17827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543295c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427383936:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789635522.121881:0:17827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056e152400/0xb0c3a59caa410118 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa41011f expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635522.121889:0:17827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056e152400/0xb0c3a59caa410118 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa41011f expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635522.121901:0:17827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789635522.121909:0:17827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152400/0xb0c3a59caa410118 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa41011f expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635522.121915:0:17827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e152400/0xb0c3a59caa410118 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa41011f expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635522.121927:0:17827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789635522.121930:0:17827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789635522.121935:0:17827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d0550104800 10000000:01000000:1.0:1789635522.121937:0:17827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789635522.121940:0:17827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1789635522.121942:0:17827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789635522.121957:0:17827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152800/0xb0c3a59caa410126 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635522.121964:0:17827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056e152800/0xb0c3a59caa410126 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635522.121981:0:17827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056e152800/0xb0c3a59caa410126 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635522.121994:0:17827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543295c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427384064:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789635522.122021:0:17827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635522.122040:0:17827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0441455180 going to sleep for 11 seconds 00000100:00100000:0.0:1789635522.122167:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427384064 00000100:00100000:0.0:1789635522.122172:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427384064 00000100:00100000:0.0:1789635522.122202:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789635522.122208:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+14:17827:x1876568427384064:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789635522.122217:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635522.122226:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0446d1b600/0xb0c3a59caa41012d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa410126 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635522.122239:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0446d1b600/0xb0c3a59caa41012d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa410126 expref: 15 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635522.122247:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0446d1b600/0xb0c3a59caa41012d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa410126 expref: 15 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635522.122254:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1b600, rc 0) 00000100:00100000:0.0:1789635522.122288:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+15:17827:x1876568427384064:12345-0@lo:101:mount.lustre.0 Request processed in 80us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635522.122294:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789635522.122541:0:17827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543295c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427384064:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789635522.122551:0:17827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056e152800/0xb0c3a59caa410126 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa41012d expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635522.122559:0:17827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056e152800/0xb0c3a59caa410126 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa41012d expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789635522.124150:0:17827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1789635522.125937:0:17827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789635522.130101:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789635522.130161:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1789635522.130175:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1789635522.130189:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1789635522.130203:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:1.0:1789635522.130218:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:1.0:1789635522.130232:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:1.0:1789635522.130247:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1789635522.130261:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1789635522.130275:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:1.0:1789635522.130289:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:1.0:1789635522.130303:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:1.0:1789635522.130318:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:1.0:1789635522.130331:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1789635522.130345:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1789635522.130358:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:1.0:1789635522.130372:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1789635522.130386:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1789635522.130399:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:1.0:1789635522.130416:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1789635522.131125:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1789635522.131150:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1789635522.131164:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1789635522.131193:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:1.0:1789635522.131199:0:17827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:1.0:1789635522.131309:0:17827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543295c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427384192:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789635522.131373:0:17827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635522.131545:0:17827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0441455cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635522.132212:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427384192 00000100:00100000:2.0:1789635522.132222:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427384192 00000100:00100000:2.0:1789635522.132317:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789635522.132329:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+15:17827:x1876568427384192:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789635522.132637:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+15:17827:x1876568427384192:12345-0@lo:501:mount.lustre.0 Request processed in 310us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635522.132645:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789635522.132739:0:17827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543295c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427384192:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789635522.132795:0:17827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543295c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427384320:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789635522.132843:0:17827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635522.133202:0:17827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0441455cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635522.133338:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427384320 00000100:00100000:0.0:1789635522.133346:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427384320 00000100:00100000:0.0:1789635522.133373:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789635522.133379:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+15:17827:x1876568427384320:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789635522.134219:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+15:17827:x1876568427384320:12345-0@lo:503:mount.lustre.0 Request processed in 835us (1371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635522.134229:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789635522.134353:0:17827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543295c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427384320:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789635522.135027:0:17827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789635522.135105:0:17827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543295c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427384448:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789635522.135155:0:17827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635522.135232:0:17827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0441455180 going to sleep for 11 seconds 00000100:00100000:2.0:1789635522.135413:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427384448 00000100:00100000:2.0:1789635522.135420:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427384448 00000100:00100000:0.0:1789635522.136108:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789635522.136132:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+15:17827:x1876568427384448:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789635522.137349:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+15:17827:x1876568427384448:12345-0@lo:502:mount.lustre.0 Request processed in 1216us (2187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635522.137361:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789635522.139948:0:17827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543295c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427384448:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789635522.140224:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789635522.140260:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:1.0:1789635522.140275:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:1.0:1789635522.140290:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:1.0:1789635522.140301:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:1.0:1789635522.140313:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:1.0:1789635522.140326:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:1.0:1789635522.140338:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:1.0:1789635522.140349:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:1.0:1789635522.140365:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:1.0:1789635522.140379:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:1.0:1789635522.140392:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:1.0:1789635522.140404:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:1.0:1789635522.140416:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:1.0:1789635522.140444:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:1.0:1789635522.140542:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:1.0:1789635522.140559:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:1.0:1789635522.140570:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:1.0:1789635522.140582:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:1.0:1789635522.140616:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:1.0:1789635522.140632:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:1.0:1789635522.140643:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:1.0:1789635522.140655:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:1.0:1789635522.140691:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:1.0:1789635522.140706:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:1.0:1789635522.140719:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:1.0:1789635522.140732:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:1.0:1789635522.140744:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:1.0:1789635522.140832:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:1.0:1789635522.140847:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:1.0:1789635522.140857:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:1.0:1789635522.140880:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:1.0:1789635522.140894:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:1.0:1789635522.140909:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:1.0:1789635522.140923:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:1.0:1789635522.140936:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:1.0:1789635522.140948:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:1.0:1789635522.140960:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:1.0:1789635522.140972:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:1.0:1789635522.140983:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:1.0:1789635522.140993:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:1.0:1789635522.141005:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:1.0:1789635522.141016:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:1.0:1789635522.141027:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:1.0:1789635522.141066:0:17827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543295c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427384576:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789635522.141141:0:17827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635522.141254:0:17827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0441455180 going to sleep for 11 seconds 00000100:00100000:2.0:1789635522.141863:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427384576 00000100:00100000:2.0:1789635522.141872:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427384576 00000100:00100000:2.0:1789635522.141967:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789635522.141976:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+15:17827:x1876568427384576:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789635522.142149:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+15:17827:x1876568427384576:12345-0@lo:502:mount.lustre.0 Request processed in 172us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635522.142157:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789635522.142230:0:17827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543295c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427384576:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789635522.142286:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:1.0:1789635522.142297:0:17827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1789635522.143075:0:17831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789635522.143086:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635522.143088:0:17831:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789635522.143093:0:17831:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1789635522.143102:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789635522.143115:0:17831:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8d04478a4d40) 00000020:00000080:1.0:1789635522.143132:0:17831:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1789635522.143144:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789635522.143217:0:17831:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789635522.143225:0:17831:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb0c3a59caa41013b 00000020:00000080:1.0:1789635522.143445:0:17831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1789635522.143450:0:17831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789635522.143454:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635522.143553:0:17831:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789635522.143559:0:17831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789635522.143564:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635522.143565:0:17831:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1789635522.143569:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789635522.143577:0:17831:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8d04478a3380) 00000020:00000080:1.0:1789635522.143588:0:17831:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1789635522.143592:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789635522.143620:0:17831:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1789635522.143623:0:17831:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1789635522.143630:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789635522.143681:0:17831:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d0550104800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1789635522.143692:0:17831:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8d04478a0000) 00000020:00000080:1.0:1789635522.143701:0:17831:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1789635522.143820:0:17831:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789635522.143826:0:17831:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb0c3a59caa410150 00000020:00000080:1.0:1789635522.143910:0:17831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1789635522.143916:0:17831:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789635522.143920:0:17831:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xb0c3a59caa410157 00080000:01000000:1.0:1789635522.143925:0:17831:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789635522.143928:0:17831:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb0c3a59caa41015e 00010000:00010000:0.0:1789635522.216141:0:17831:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1789635522.216819:0:17831:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:0.0:1789635522.217108:0:17831:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789635522.219078:0:17831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1789635522.219091:0:17831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789635522.219098:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635522.219100:0:17831:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1789635522.219103:0:17831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789635522.219109:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635522.219110:0:17831:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1789635522.219114:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789635522.219118:0:17831:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:00000080:2.0:1789635522.219147:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789635522.219163:0:17831:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8d044646cd40) 00000020:00000080:2.0:1789635522.219185:0:17831:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1789635522.219192:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789635522.219292:0:17831:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1789635522.219300:0:17831:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789635522.219307:0:17831:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb0c3a59caa41016c 00010000:00080000:2.0:1789635522.219342:0:17831:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d056f7cd000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.120@tcp at head 00010000:00010000:2.0:1789635522.222135:0:17831:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1789635522.230398:0:17831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789635522.230413:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789635522.230462:0:17831:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789635522.230486:0:17831:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb0c3a59caa410173 00000100:00080000:2.0:1789635522.230496:0:17831:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789635522.230508:0:17831:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8d056f7cd000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1789635522.230547:0:17831:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d05759d0e00 x1876568427384704/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789635522.230577:0:17831:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1789635522.230708:0:17831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789635522.230713:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635522.230715:0:17831:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1789635522.230719:0:17831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789635522.230722:0:17831:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1789635522.230724:0:17831:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789635522.230726:0:17831:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789635522.230728:0:17831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789635522.230744:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635522.230746:0:17831:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789635522.230750:0:17831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789635522.230755:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635522.230757:0:17831:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1789635522.230761:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789635522.230799:0:17831:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789635522.230814:0:17831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789635522.230817:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635522.230818:0:17831:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1789635522.230821:0:17831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789635522.230823:0:17831:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1789635522.230824:0:17831:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789635522.230833:0:17831:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789635522.230834:0:17831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789635522.230837:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635522.230838:0:17831:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789635522.230840:0:17831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789635522.230843:0:17831:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789635522.230846:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635522.230847:0:17831:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789635522.230850:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789635522.230854:0:17831:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:01000000:2.0:1789635522.230876:0:17831:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789635522.230879:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789635522.230894:0:17831:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8d04464699c0) 00000020:00000080:2.0:1789635522.230907:0:17831:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1789635522.230913:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789635522.230990:0:17831:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1789635522.230998:0:17831:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789635522.231006:0:17831:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb0c3a59caa410181 00010000:00080000:2.0:1789635522.231037:0:17831:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d04478c5800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.120@tcp at head 00010000:00010000:2.0:1789635522.231260:0:17831:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:3.0:1789635522.231654:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1876568427384704:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789635522.231742:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789635522.231934:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789635522.231940:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789635522.231943:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d0546438000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789635522.231948:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 539 00000100:00080000:0.0:1789635522.231953:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789635522.231960:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d0546438000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1789635522.231984:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0543290380 x1876568427384832/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789635522.231999:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789635522.232002:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789635522.232005:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789635522.232008:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789635522.232086:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427384832:0@lo:38:kworker.0 00000100:00100000:3.0:1789635522.232111:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635522.232154:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789635522.232162:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427384960:0@lo:400:kworker.0 00000100:00100000:3.0:1789635522.232188:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635522.232251:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427384704 00000100:00100000:0.0:1789635522.232258:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427384704 00000100:00100000:0.0:1789635522.232278:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427384832 00000100:00100000:0.0:1789635522.232280:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427384832 00000100:00100000:0.0:1789635522.232290:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789635522.232296:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e015180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1876568427384704:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789635522.232326:0:17101:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:0.0:1789635522.232366:0:17101:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb0c3a59caa410188 00000004:00100000:0.0:1789635522.232381:0:17101:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789635522.232387:0:17101:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1789635522.232512:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427384960 00000100:00100000:2.0:1789635522.232517:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427384960 00000100:00100000:2.0:1789635522.232591:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789635522.232627:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427384960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635522.232696:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427384960:12345-0@lo:400:kworker.0 Request processed in 71us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635522.232703:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789635522.232773:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d0543291180 x1876568427384960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635522.232786:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427384960:0@lo:400:kworker.0 00000100:00080000:1.0:1789635522.237124:0:17101:0:(import.c:65:import_set_state_nolock()) ffff8d057b5ca000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789635522.237311:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e015180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1876568427384704:12345-0@lo:38:llog_process_th.0 Request processed in 5008us (5573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635522.237344:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789635522.237373:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789635522.237380:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1876568427384832:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1789635522.237443:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1876568427384832:12345-0@lo:38:kworker.0 Request processed in 61us (5329us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789635522.237449:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:01000000:0.0:1789635522.242100:0:17831:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789635522.242498:0:17831:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1789635522.243890:0:17831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789635522.244157:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789635522.244169:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1789635522.244176:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789635522.244182:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789635522.244186:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d056f7cd000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789635522.244205:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1876568427384704:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789635522.244232:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789635522.244236:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d0546438000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789635522.244239:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789635522.244242:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427384832:0@lo:38:kworker.0 00000100:00100000:1.0:1789635522.244421:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789635522.244438:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427385088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789635522.244498:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635522.244582:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427385088 00000100:00100000:0.0:1789635522.244590:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427385088 00000100:00100000:0.0:1789635522.244678:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789635522.244687:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1876568427385088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789635522.244716:0:17102:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789635522.244766:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1876568427385088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635522.244773:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789635522.244901:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427385088:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1789635522.245036:0:17831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1789635522.245211:0:17831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:3.0:1789635522.247125:0:17836:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789635522.247130:0:17836:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789635522.251097:0:17831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789635522.251113:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789635522.251177:0:17831:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789635522.251205:0:17831:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb0c3a59caa41018f 00000100:00080000:2.0:1789635522.251216:0:17831:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789635522.251229:0:17831:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d04478c5800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1789635522.251270:0:17831:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d05759d0000 x1876568427385216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789635522.251301:0:17831:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789635522.251357:0:17831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789635522.251361:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635522.251363:0:17831:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789635522.251366:0:17831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789635522.251368:0:17831:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1789635522.251370:0:17831:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789635522.251371:0:17831:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789635522.251373:0:17831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789635522.251375:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635522.251376:0:17831:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789635522.251379:0:17831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789635522.251383:0:17831:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789635522.251386:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635522.251388:0:17831:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789635522.251391:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789635522.251394:0:17831:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:01000000:2.0:1789635522.251418:0:17831:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789635522.251420:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789635522.251433:0:17831:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8d0446468000) 00000020:00000080:2.0:1789635522.251446:0:17831:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1789635522.251451:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789635522.251510:0:17831:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1789635522.251519:0:17831:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789635522.251525:0:17831:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb0c3a59caa41019d 00010000:00080000:2.0:1789635522.251556:0:17831:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d057b5c7800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.120@tcp at head 00010000:00010000:2.0:1789635522.251800:0:17831:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1789635522.251866:0:17831:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789635522.251881:0:17831:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:3.0:1789635522.252313:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1876568427385216:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789635522.252360:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876568427385216 offset 0 length 520: 4 00000100:00080000:1.0:1789635522.252545:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789635522.252551:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789635522.252554:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789635522.252557:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1789635522.254571:0:17831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789635522.254988:0:17831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1789635522.255097:0:17831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1789635522.255514:0:17838:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789635522.255520:0:17838:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789635522.257905:0:17831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789635522.257920:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789635522.257966:0:17831:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789635522.257988:0:17831:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb0c3a59caa4101a4 00000100:00080000:0.0:1789635522.257998:0:17831:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789635522.258009:0:17831:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d057b5c7800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1789635522.258047:0:17831:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0543293800 x1876568427385344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789635522.258129:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1876568427385344:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789635522.258182:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876568427385344 offset 0 length 520: 4 00000100:00080000:0.0:1789635522.258234:0:17831:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789635522.258297:0:17831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635522.258301:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635522.258313:0:17831:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789635522.258316:0:17831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789635522.258321:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635522.258322:0:17831:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789635522.258325:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789635522.258327:0:17831:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789635522.258330:0:17831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635522.258332:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635522.258334:0:17831:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789635522.258336:0:17831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789635522.258338:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635522.258339:0:17831:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789635522.258342:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789635522.258375:0:17831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635522.258378:0:17831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635522.258379:0:17831:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789635522.258383:0:17831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:0.0:1789635522.258436:0:17827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1789635522.258465:0:17827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789635522.258479:0:17827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152800/0xb0c3a59caa410126 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa41012d expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635522.258491:0:17827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e152800/0xb0c3a59caa410126 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa41012d expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635522.258500:0:17827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d0550104800 from 1 10000000:01000000:0.0:1789635522.258503:0:17827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789635522.258526:0:17827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d0446d1a600/0xb0c3a59caa4101ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635522.258540:0:17827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d0446d1a600/0xb0c3a59caa4101ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635522.258553:0:17827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d0446d1a600/0xb0c3a59caa4101ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635522.258569:0:17827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543292a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427385472:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789635522.258647:0:17827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635522.258664:0:17827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0554038780 going to sleep for 11 seconds 00000100:00080000:1.0:1789635522.259156:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789635522.259162:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789635522.259165:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789635522.259168:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789635522.259234:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427385472 00000100:00100000:2.0:1789635522.259242:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427385472 00000100:00100000:2.0:1789635522.259294:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789635522.259315:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+15:17827:x1876568427385472:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789635522.259328:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635522.259342:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056e1a3800/0xb0c3a59caa4101b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa4101ab expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635522.259366:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e1a3800/0xb0c3a59caa4101b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa4101ab expref: 16 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635522.259376:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056e1a3800/0xb0c3a59caa4101b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa4101ab expref: 16 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635522.259384:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a3800, rc 0) 00000100:00100000:2.0:1789635522.259434:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+16:17827:x1876568427385472:12345-0@lo:101:mount.lustre.0 Request processed in 131us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635522.259441:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789635522.259971:0:17827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543292a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427385472:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789635522.259987:0:17827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d0446d1a600/0xb0c3a59caa4101ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4101b2 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635522.259995:0:17827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d0446d1a600/0xb0c3a59caa4101ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa4101b2 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635522.260572:0:17827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543292a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427385600:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789635522.260815:0:17827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635522.260845:0:17827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0554038780 going to sleep for 11 seconds 00000100:00100000:2.0:1789635522.260972:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427385600 00000100:00100000:2.0:1789635522.260979:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427385600 00000100:00100000:2.0:1789635522.261022:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789635522.261029:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+16:17827:x1876568427385600:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789635522.261045:0:17090:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789635522.261067:0:17090:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789635522.261070:0:17090:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789635522.261173:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+16:17827:x1876568427385600:12345-0@lo:256:mount.lustre.0 Request processed in 144us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635522.261179:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789635522.261258:0:17827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543292a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427385600:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789635522.262022:0:17827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789635522.262049:0:17827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d0446d1a600/0xb0c3a59caa4101ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4101b2 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635522.262060:0:17827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d0446d1a600/0xb0c3a59caa4101ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4101b2 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635522.262070:0:17827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0550104800 from 1 10000000:01000000:1.0:1789635522.262073:0:17827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789635522.262100:0:17827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa4101b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635522.262108:0:17827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa4101b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635522.262116:0:17827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa4101b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635522.262133:0:17827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427385728:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789635522.262170:0:17827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635522.262197:0:17827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0551530d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789635522.262216:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427385728 00000100:00100000:1.0:1789635522.262221:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427385728 00000100:00100000:1.0:1789635522.262250:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789635522.262256:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+16:17827:x1876568427385728:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789635522.262266:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635522.262276:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056e152c00/0xb0c3a59caa4101c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa4101b9 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635522.262293:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e152c00/0xb0c3a59caa4101c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa4101b9 expref: 17 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635522.264769:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056e152c00/0xb0c3a59caa4101c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa4101b9 expref: 17 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635522.264779:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e152c00, rc 0) 00000100:00100000:1.0:1789635522.264858:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+17:17827:x1876568427385728:12345-0@lo:101:mount.lustre.0 Request processed in 2600us (2686us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635522.264866:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789635522.264954:0:17827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427385728:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789635522.264975:0:17827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa4101b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4101c0 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635522.264984:0:17827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa4101b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa4101c0 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789635522.265116:0:17827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789635522.265154:0:17827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427385856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789635522.265184:0:17827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635522.265211:0:17827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0551530e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789635522.265226:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427385856 00000100:00100000:1.0:1789635522.265232:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427385856 00000100:00100000:1.0:1789635522.265260:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789635522.265268:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+17:17827:x1876568427385856:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789635522.265341:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+17:17827:x1876568427385856:12345-0@lo:501:mount.lustre.0 Request processed in 74us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635522.265348:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789635522.265382:0:17827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427385856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789635522.265413:0:17827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427385984:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789635522.265448:0:17827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635522.265461:0:17827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d054a0bdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635522.265472:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427385984 00000100:00100000:1.0:1789635522.265475:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427385984 00000100:00100000:1.0:1789635522.265494:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789635522.265500:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+17:17827:x1876568427385984:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789635522.265576:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+17:17827:x1876568427385984:12345-0@lo:503:mount.lustre.0 Request processed in 75us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635522.265583:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789635522.265644:0:17827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427385984:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789635522.265978:0:17827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789635522.266033:0:17827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427386112:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789635522.266068:0:17827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635522.266088:0:17827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d054a0bdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635522.266102:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427386112 00000100:00100000:1.0:1789635522.266106:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427386112 00000100:00100000:1.0:1789635522.266127:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789635522.266133:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+17:17827:x1876568427386112:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789635522.269039:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+17:17827:x1876568427386112:12345-0@lo:502:mount.lustre.0 Request processed in 2898us (2962us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635522.269053:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789635522.269891:0:17827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427386112:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789635522.270159:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789635522.270192:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1789635522.270206:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1789635522.270220:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1789635522.270233:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:0.0:1789635522.270245:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1789635522.270258:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:0.0:1789635522.270279:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:0.0:1789635522.270293:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789635522.270320:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:0.0:1789635522.270336:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:0.0:1789635522.270374:0:17827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543292300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427386240:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789635522.270431:0:17827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635522.270470:0:17827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0554038780 going to sleep for 11 seconds 00000100:00100000:1.0:1789635522.270903:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427386240 00000100:00100000:1.0:1789635522.270911:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427386240 00000100:00100000:1.0:1789635522.270958:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789635522.270966:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+17:17827:x1876568427386240:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789635522.271080:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+17:17827:x1876568427386240:12345-0@lo:502:mount.lustre.0 Request processed in 114us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635522.271087:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789635522.271551:0:17827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543292300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427386240:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789635522.271660:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:2.0:1789635522.271683:0:17827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789635522.272568:0:17840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789635522.272578:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635522.272581:0:17840:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789635522.272588:0:17840:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d0550104800 00000020:00000080:1.0:1789635522.272591:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789635522.272847:0:17840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789635522.272851:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635522.272853:0:17840:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789635522.272856:0:17840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789635522.272860:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635522.272861:0:17840:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789635522.272866:0:17840:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d0550104800 00000020:00000080:1.0:1789635522.272868:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789635522.273106:0:17840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789635522.273111:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635522.273112:0:17840:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789635522.273115:0:17840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789635522.273118:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635522.273120:0:17840:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789635522.273123:0:17840:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d0550104800 00000020:00000080:1.0:1789635522.273125:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789635522.279872:0:17840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789635522.279890:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635522.279892:0:17840:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789635522.279899:0:17840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789635522.279903:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635522.279904:0:17840:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789635522.279909:0:17840:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d0550104800 00000020:00000080:1.0:1789635522.279911:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789635522.279983:0:17840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789635522.279986:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635522.279988:0:17840:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789635522.279991:0:17840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:3.0:1789635522.284219:0:17827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789635522.284269:0:17827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789635522.284293:0:17827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa4101b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4101c0 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635522.284314:0:17827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa4101b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4101c0 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635522.284390:0:17827:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789635522.284393:0:17827:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d0550104800 10000000:01000000:3.0:1789635522.284396:0:17827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d0550104800 10000000:01000000:3.0:1789635522.284400:0:17827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789635522.284405:0:17827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d0550104800 from 1 10000000:01000000:3.0:1789635522.284408:0:17827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789635522.284443:0:17827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05488fe800/0xb0c3a59caa4101c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635522.284453:0:17827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d05488fe800/0xb0c3a59caa4101c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635522.284464:0:17827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d05488fe800/0xb0c3a59caa4101c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635522.284486:0:17827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e014a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427386368:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789635522.284552:0:17827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635522.284635:0:17827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446df5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789635522.288145:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427386368 00000100:00100000:0.0:1789635522.288158:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427386368 00000100:00100000:0.0:1789635522.288206:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789635522.288216:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+17:17827:x1876568427386368:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789635522.288233:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635522.288250:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0446d1a400/0xb0c3a59caa4101ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa4101c7 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635522.288278:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0446d1a400/0xb0c3a59caa4101ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa4101c7 expref: 18 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635522.288288:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0446d1a400/0xb0c3a59caa4101ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa4101c7 expref: 18 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635522.288297:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1a400, rc 0) 00000100:00100000:0.0:1789635522.288375:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+18:17827:x1876568427386368:12345-0@lo:101:mount.lustre.0 Request processed in 161us (3823us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635522.288382:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789635522.289258:0:17827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e014a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427386368:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789635522.289287:0:17827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d05488fe800/0xb0c3a59caa4101c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4101ce expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635522.289301:0:17827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d05488fe800/0xb0c3a59caa4101c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa4101ce expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789635522.297086:0:17827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1789635522.297396:0:17827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789635522.297684:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1789635522.297715:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:2.0:1789635522.297733:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:2.0:1789635522.297752:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:2.0:1789635522.297766:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:2.0:1789635522.297780:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:2.0:1789635522.297792:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:2.0:1789635522.297804:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:2.0:1789635522.297817:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:2.0:1789635522.297831:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:2.0:1789635522.297844:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:2.0:1789635522.297857:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:2.0:1789635522.297886:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:2.0:1789635522.297915:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:2.0:1789635522.297931:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:2.0:1789635522.297946:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:2.0:1789635522.297962:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:2.0:1789635522.297978:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:2.0:1789635522.297992:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:2.0:1789635522.298007:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:2.0:1789635522.298021:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:2.0:1789635522.298036:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:2.0:1789635522.298051:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:2.0:1789635522.298066:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:2.0:1789635522.298082:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:2.0:1789635522.298097:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:2.0:1789635522.298111:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:2.0:1789635522.298127:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:2.0:1789635522.298165:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:2.0:1789635522.298172:0:17827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1789635522.298252:0:17827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427386496:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789635522.298313:0:17827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635522.298361:0:17827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d054a2b2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789635522.298386:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427386496 00000100:00100000:2.0:1789635522.298392:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427386496 00000100:00100000:2.0:1789635522.298430:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789635522.298438:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+18:17827:x1876568427386496:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789635522.298541:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+18:17827:x1876568427386496:12345-0@lo:501:mount.lustre.0 Request processed in 103us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635522.298548:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789635522.298617:0:17827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427386496:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789635522.298649:0:17827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427386624:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789635522.298697:0:17827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635522.298715:0:17827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d054a2b2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789635522.298930:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427386624 00000100:00100000:0.0:1789635522.298935:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427386624 00000100:00100000:0.0:1789635522.298972:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789635522.298981:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+18:17827:x1876568427386624:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789635522.299071:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+18:17827:x1876568427386624:12345-0@lo:503:mount.lustre.0 Request processed in 92us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635522.299078:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789635522.299851:0:17827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427386624:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789635522.300214:0:17827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789635522.300453:0:17827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427386752:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789635522.300503:0:17827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635522.300536:0:17827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549fab480 going to sleep for 11 seconds 00000100:00100000:2.0:1789635522.300554:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427386752 00000100:00100000:2.0:1789635522.300559:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427386752 00000100:00100000:2.0:1789635522.300723:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789635522.300737:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+18:17827:x1876568427386752:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789635522.300823:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+18:17827:x1876568427386752:12345-0@lo:502:mount.lustre.0 Request processed in 90us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635522.300830:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789635522.300876:0:17827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427386752:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789635522.301029:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1789635522.301054:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1789635522.301067:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1789635522.301079:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1789635522.301091:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1789635522.301102:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1789635522.301116:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1789635522.301128:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1789635522.301142:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1789635522.301153:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1789635522.301166:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1789635522.301180:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1789635522.301193:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1789635522.301222:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1789635522.301239:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1789635522.301425:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1789635522.301445:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1789635522.301462:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1789635522.301477:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1789635522.301491:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1789635522.301502:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1789635522.301513:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1789635522.301525:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1789635522.301536:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1789635522.301549:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1789635522.301563:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1789635522.301574:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1789635522.301586:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1789635522.306425:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1789635522.306495:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1789635522.306516:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1789635522.306533:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1789635522.306548:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1789635522.306561:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1789635522.306575:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1789635522.306590:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1789635522.310757:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1789635522.310792:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1789635522.310810:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1789635522.310827:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1789635522.310842:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1789635522.310859:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1789635522.310875:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1789635522.310891:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1789635522.310908:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1789635522.310946:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1789635522.310974:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1789635522.310990:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1789635522.311051:0:17827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427386880:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789635522.311131:0:17827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635522.311189:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427386880 00000100:00100000:2.0:1789635522.311197:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427386880 00000100:00100000:2.0:1789635522.311244:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789635522.311253:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+18:17827:x1876568427386880:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789635522.311360:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+18:17827:x1876568427386880:12345-0@lo:502:mount.lustre.0 Request processed in 108us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635522.311368:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789635522.311424:0:17827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549fab480 going to sleep for 11 seconds 00000100:00100000:2.0:1789635522.311445:0:17827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427386880:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789635522.311654:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:2.0:1789635522.311691:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:2.0:1789635522.311715:0:17827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427387008:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789635522.311748:0:17827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635522.311772:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427387008 00000100:00100000:2.0:1789635522.311776:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427387008 00000100:00100000:2.0:1789635522.311801:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789635522.311808:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+18:17827:x1876568427387008:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789635522.311872:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+18:17827:x1876568427387008:12345-0@lo:502:mount.lustre.0 Request processed in 64us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635522.311880:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789635522.311915:0:17827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549fab480 going to sleep for 11 seconds 00000100:00100000:2.0:1789635522.311929:0:17827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427387008:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789635522.311975:0:17827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1789635522.311984:0:17827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1789635522.318000:0:17846:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1789635522.318016:0:17846:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8d05759219c0) 00000020:00000080:3.0:1789635522.318041:0:17846:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1789635522.318122:0:17846:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d0550104800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789635522.318126:0:17846:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d0550104800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789635522.318129:0:17846:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d0550104800 3 00010000:00080000:3.0:1789635522.318161:0:17846:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d057b957000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.120@tcp at head 00010000:00010000:3.0:1789635522.320223:0:17846:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1789635522.320404:0:17846:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1789635522.320443:0:17846:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789635522.320454:0:17846:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xb0c3a59caa4101dc 00000100:00080000:3.0:1789635522.320465:0:17846:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789635522.320476:0:17846:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8d057b957000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789635522.320512:0:17846:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d056e015c00 x1876568427387136/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789635522.320553:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e015c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876568427387136:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789635522.320663:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635522.320741:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427387136 00000100:00100000:3.0:1789635522.323114:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427387136 00000100:00100000:3.0:1789635522.323173:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789635522.323183:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1876568427387136:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789635522.323184:0:17096:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789635522.323197:0:17096:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:3.0:1789635522.323214:0:17098:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 541 last 0 00000020:00000080:3.0:1789635522.323256:0:17098:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xb0c3a59caa4101e3 00000004:00100000:3.0:1789635522.323272:0:17098:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789635522.323304:0:17098:0:(import.c:65:import_set_state_nolock()) ffff8d057b956800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789635522.323386:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876568427387136:12345-0@lo:38:llog_process_th.0 Request processed in 204us (2724us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635522.323394:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789635522.323439:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d056e015c00 x1876568427387136/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789635532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635522.323450:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789635522.323458:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1789635522.323471:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789635522.323475:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789635522.323478:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d057b957000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789635522.323483:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e015c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876568427387136:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789635522.323507:0:17846:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789635522.323567:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789635522.323571:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789635522.323574:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d0546438000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789635522.323583:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d0546438000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789635522.323619:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d056e017480 x1876568427387392/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789635522.323633:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789635522.323636:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789635522.323640:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789635522.323643:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789635522.323680:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789635522.323695:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e015c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3642:1876568427387264:0@lo:400:kworker.0 00000100:00100000:2.0:1789635522.323738:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635522.323770:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427387264 00000100:00100000:2.0:1789635522.323776:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427387264 00000100:00100000:2.0:1789635522.323806:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789635522.323813:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+18:3642:x1876568427387264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635522.323849:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+18:3642:x1876568427387264:12345-0@lo:400:kworker.0 Request processed in 36us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635522.323855:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789635522.323889:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e015c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3642:1876568427387264:0@lo:400:kworker.0 00000100:00100000:0.0:1789635522.326698:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e017480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427387392:0@lo:38:kworker.0 00000100:00100000:0.0:1789635522.326839:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635522.326889:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427387392 00000100:00100000:0.0:1789635522.326898:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427387392 00000100:00100000:0.0:1789635522.326934:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789635522.326942:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3639:x1876568427387392:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1789635522.327001:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3639:x1876568427387392:12345-0@lo:38:kworker.0 Request processed in 58us (162us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789635522.327008:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1789635522.327046:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d0546438000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789635522.327051:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789635522.327055:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e017480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427387392:0@lo:38:kworker.0 00000100:00100000:3.0:1789635522.327175:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427387520:0@lo:400:kworker.0 00000100:00100000:3.0:1789635522.327207:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635522.327243:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427387520 00000100:00100000:3.0:1789635522.327247:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427387520 00000100:00100000:3.0:1789635522.327277:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789635522.327284:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e015880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427387520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635522.327327:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e015880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427387520:12345-0@lo:400:kworker.0 Request processed in 43us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635522.327335:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789635522.327380:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d056e017100 x1876568427387520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635522.327391:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427387520:0@lo:400:kworker.0 00000100:00080000:3.0:1789635522.327425:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789635522.327430:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789635522.327433:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789635522.327436:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789635522.327445:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427387648:0@lo:400:kworker.0 00000100:00100000:3.0:1789635522.327469:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635522.327495:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427387648 00000100:00100000:3.0:1789635522.327499:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427387648 00000100:00100000:3.0:1789635522.327520:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789635522.327529:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e017100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1876568427387648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635522.327567:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e017100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1876568427387648:12345-0@lo:400:kworker.0 Request processed in 41us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635522.327574:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789635522.327619:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427387648:0@lo:400:kworker.0 00000040:00080000:0.0:1789635522.328881:0:17846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:2.0:1789635522.329142:0:17827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789635522.329175:0:17827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789635522.329198:0:17827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05488fe800/0xb0c3a59caa4101c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4101ce expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635522.329210:0:17827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d05488fe800/0xb0c3a59caa4101c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4101ce expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789635522.329258:0:17827:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789635522.329260:0:17827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789635522.329332:0:17827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789635522.329334:0:17827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789635522.329335:0:17827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789635522.329337:0:17827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789635522.329346:0:17827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789635522.329347:0:17827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789635522.329348:0:17827:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789635522.329352:0:17827:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1789635522.329354:0:17827:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789635522.329355:0:17827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789635522.329356:0:17827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789635522.329356:0:17827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789635522.329357:0:17827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789635522.329358:0:17827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789635522.329359:0:17827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789635522.329360:0:17827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789635522.329361:0:17827:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789635522.329385:0:17827:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789635522.329403:0:17827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427387776:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789635522.329547:0:17827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635522.329578:0:17827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549faba80 going to sleep for 11 seconds 00000100:00100000:2.0:1789635522.329797:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427387776 00000100:00100000:2.0:1789635522.329804:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427387776 00000100:00100000:2.0:1789635522.329846:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789635522.329856:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+18:17827:x1876568427387776:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789635522.329883:0:17090:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789635522.329897:0:17090:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1789635522.334159:0:17076:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1789635522.334200:0:17090:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789635522.334210:0:17090:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1789635522.334920:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+18:17827:x1876568427387776:12345-0@lo:253:mount.lustre.0 Request processed in 5061us (5366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635522.334933:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789635522.335447:0:17827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17827:1876568427387776:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789635522.335463:0:17827:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789635522.335466:0:17827:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789635522.335468:0:17827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789635522.335469:0:17827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789635522.335470:0:17827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789635522.335471:0:17827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789635522.335473:0:17827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789635522.335474:0:17827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789635522.335476:0:17827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789635522.335478:0:17827:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789635522.335492:0:17827:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1789635522.335878:0:17112:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789635522.335884:0:17112:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789635522.335904:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d056e153c00/0xb0c3a59caa4101ea lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635522.335919:0:17112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0446d1aa00/0xb0c3a59caa4100ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa4100e7 expref: 17 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635522.335925:0:17112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d056e1a3800/0xb0c3a59caa4101b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa4101ab expref: 17 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635522.335931:0:17112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d056e153c00/0xb0c3a59caa4101ea lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635522.335965:0:17112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d056e1a3800/0xb0c3a59caa4101b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa4101ab expref: 17 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635522.335977:0:17112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d056e1a3800/0xb0c3a59caa4101b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa4101ab expref: 17 pid: 17091 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635522.335989:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543295f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17112:1876568427387904:0@lo:104: 00000100:00100000:1.0:1789635522.336028:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789635522.336064:0:17112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0446d1aa00/0xb0c3a59caa4100ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa4100e7 expref: 17 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635522.336085:0:17112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d0446d1aa00/0xb0c3a59caa4100ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa4100e7 expref: 17 pid: 17090 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635522.336111:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543296300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17112:1876568427388032:0@lo:104: 00000100:00100000:1.0:1789635522.336132:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635522.336151:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d054a0bdd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789635522.336167:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427387904 00000100:00100000:1.0:1789635522.336172:0:17079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427387904 00000100:00100000:1.0:1789635522.336200:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427388032 00000100:00100000:1.0:1789635522.336202:0:17079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427388032 00000100:00100000:1.0:1789635522.336213:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789635522.336220:0:17079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543296a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+4:17112:x1876568427387904:12345-0@lo:104: 00010000:00010000:1.0:1789635522.336231:0:17079:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d0446d1a600/0xb0c3a59caa4101ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa4101b2 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635522.336293:0:17079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789635522.336298:0:17079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543296a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+4:17112:x1876568427387904:12345-0@lo:104: Request processed in 78us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635522.336305:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789635522.336326:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789635522.336331:0:17079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543297100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+3:17112:x1876568427388032:12345-0@lo:104: 00010000:00010000:1.0:1789635522.336338:0:17079:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d05488ffc00/0xb0c3a59caa4100e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa4100ee expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635522.336343:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635522.336366:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d0446d1a600/0xb0c3a59caa4101ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa4101b2 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635522.336368:0:17079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789635522.336373:0:17079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543297100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+3:17112:x1876568427388032:12345-0@lo:104: Request processed in 43us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635522.336378:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789635522.336392:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1a600 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:3.0:1789635522.336397:0:17085:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d0446d1a600/0xb0c3a59caa4101ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa4101b2 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635522.336402:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543295f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17112:1876568427387904:0@lo:104: 00000100:00100000:1.0:1789635522.336420:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543296300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17112:1876568427388032:0@lo:104: 00010000:00010000:3.0:1789635522.336446:0:17085:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d0446d1a600/0xb0c3a59caa4101ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa4101b2 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789635522.336455:0:17085:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d0446d1a600/0xb0c3a59caa4101ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa4101b2 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635522.336461:0:17085:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789635522.336498:0:17085:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d0446d1a600/0xb0c3a59caa4101ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa4101b2 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635522.336513:0:17085:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789635522.336532:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d0446d1a600/0xb0c3a59caa4101ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa4101b2 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635522.336547:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d0446d1a600/0xb0c3a59caa4101ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa4101b2 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635522.336559:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635522.336562:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d05488ffc00/0xb0c3a59caa4100e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa4100ee expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635522.336567:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488ffc00 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:3.0:1789635522.336582:0:17085:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d05488ffc00/0xb0c3a59caa4100e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa4100ee expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635522.336628:0:17085:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d05488ffc00/0xb0c3a59caa4100e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa4100ee expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789635522.336635:0:17085:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d05488ffc00/0xb0c3a59caa4100e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa4100ee expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635522.336640:0:17085:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789635522.336675:0:17085:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d05488ffc00/0xb0c3a59caa4100e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa4100ee expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635522.336681:0:17085:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789635522.336701:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d05488ffc00/0xb0c3a59caa4100e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa4100ee expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635522.336707:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d05488ffc00/0xb0c3a59caa4100e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa4100ee expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635522.336719:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635522.336721:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635522.336723:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635522.336739:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635522.336756:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3642:1876568427388160:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789635522.336804:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635522.336843:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789635522.336850:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e016680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3642:1876568427388288:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789635522.336869:0:17112:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d056e153c00/0xb0c3a59caa4101ea lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635522.336877:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635522.336939:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427388160 00000100:00100000:3.0:1789635522.336944:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427388160 00010000:00010000:3.0:1789635522.336967:0:17082:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d056e1a3800/0xb0c3a59caa4101b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa4101ab expref: 18 pid: 17091 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635522.336989:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427388288 00000100:00100000:3.0:1789635522.337004:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427388288 00010000:00010000:3.0:1789635522.337017:0:17082:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0446d1aa00/0xb0c3a59caa4100ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa4100e7 expref: 19 pid: 17090 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635522.337031:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789635522.337039:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e017b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+19:3642:x1876568427388160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789635522.337048:0:17082:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635522.337070:0:17082:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d056e1a3800/0xb0c3a59caa4101b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa4101ab expref: 19 pid: 17091 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635522.337080:0:17082:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d056e1a3800/0xb0c3a59caa4101b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa4101ab expref: 19 pid: 17091 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635522.337101:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056e1a3800/0xb0c3a59caa4101b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa4101ab expref: 19 pid: 17091 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635522.337112:0:17082:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635522.337152:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e017b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+18:3642:x1876568427388160:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635522.337170:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789635522.337189:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789635522.337208:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e015500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+17:3642:x1876568427388288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789635522.337216:0:17082:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635522.337221:0:17082:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0446d1aa00/0xb0c3a59caa4100ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa4100e7 expref: 17 pid: 17090 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635522.337267:0:17082:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0446d1aa00/0xb0c3a59caa4100ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa4100e7 expref: 17 pid: 17090 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635522.337279:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0446d1aa00/0xb0c3a59caa4100ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa4100e7 expref: 17 pid: 17090 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635522.337290:0:17082:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d056e153c00/0xb0c3a59caa4101ea lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635522.337314:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e153c00/0xb0c3a59caa4101ea lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789635522.337346:0:17082:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015693848s 00010000:00010000:3.0:1789635522.337364:0:17082:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d056e153c00/0xb0c3a59caa4101ea lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635522.337373:0:17082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d056e153c00/0xb0c3a59caa4101ea lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635522.337378:0:17082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d056e153c00/0xb0c3a59caa4101ea lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635522.337384:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d056e153c00/0xb0c3a59caa4101ea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635522.337404:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e153c00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:3.0:1789635522.337408:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d056e153c00/0xb0c3a59caa4101ea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635522.337415:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d056e153c00/0xb0c3a59caa4101ea lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635522.337475:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d056e153c00/0xb0c3a59caa4101ea lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635522.337494:0:17082:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635522.337537:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e015500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+16:3642:x1876568427388288:12345-0@lo:103:ldlm_bl.0 Request processed in 329us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635522.337544:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789635522.337632:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e016680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3642:1876568427388288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789635522.337642:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3642:1876568427388160:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789635522.339831:0:17112:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d056e153c00/0xb0c3a59caa4101ea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635522.339847:0:17112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d056e153c00/0xb0c3a59caa4101ea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635522.339855:0:17112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056e153c00/0xb0c3a59caa4101ea lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:2.0:1789635522.347557:0:17827:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1789635522.347869:0:17853:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1789635522.347878:0:17853:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1789635522.348408:0:17854:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789635522.348482:0:17827:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1789635522.349561:0:17855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e014380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17855:1876568427388416:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789635522.349662:0:17855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635522.349703:0:17855:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446df5e40 going to sleep for 11 seconds 00000040:01000000:2.0:1789635522.349861:0:17827:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1789635522.349894:0:17827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789635522.350342:0:17827:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789635522.350349:0:17827:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1789635522.350441:0:17827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789635522.351480:0:17827:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:0.0:1789635522.351766:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427388416 00000100:00100000:0.0:1789635522.351775:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427388416 00000100:00100000:0.0:1789635522.351821:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789635522.351832:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e016680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17855:x1876568427388416:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789635522.351934:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e016680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17855:x1876568427388416:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 105us (2272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635522.351941:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789635522.351981:0:17855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e014380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17855:1876568427388416:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1789635522.352014:0:17855:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789635522.352051:0:17855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543296300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17855:1876568427388544:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789635522.352089:0:17855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635522.352116:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427388544 00000100:00100000:1.0:1789635522.352120:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427388544 00000040:00080000:3.0:1789635522.352145:0:17854:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789635522.352146:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789635522.352155:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17855:x1876568427388544:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789635522.352249:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17855:x1876568427388544:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 95us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635522.352256:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789635522.352282:0:17855:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d054a0bd300 going to sleep for 11 seconds 00000100:00100000:1.0:1789635522.352294:0:17855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543296300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17855:1876568427388544:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789635522.352345:0:17855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543296300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17855:1876568427388672:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789635522.352380:0:17855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635522.352411:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427388672 00000100:00100000:1.0:1789635522.352415:0:17107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427388672 00000100:00100000:1.0:1789635522.352438:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789635522.352443:0:17107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17855:x1876568427388672:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789635522.352475:0:17107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17855:x1876568427388672:12345-0@lo:900:lod0001_rec0000.0 Request processed in 31us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635522.352481:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789635522.352499:0:17855:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d054a0bdf00 going to sleep for 11 seconds 00010000:00080000:1.0:1789635522.352512:0:17855:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d0543296300 x1876568427388672/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789635538 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635522.352523:0:17855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543296300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17855:1876568427388672:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789635522.352558:0:17855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543296300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17855:1876568427388800:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789635522.352591:0:17855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635522.352634:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427388800 00000100:00100000:1.0:1789635522.352638:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427388800 00000100:00100000:1.0:1789635522.352681:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789635522.352688:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17855:x1876568427388800:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789635522.352729:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17855:x1876568427388800:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 41us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635522.352736:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789635522.352753:0:17855:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d054a0bd300 going to sleep for 11 seconds 00000100:00100000:1.0:1789635522.352763:0:17855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543296300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17855:1876568427388800:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1789635522.352796:0:17855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789635522.355282:0:17827:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789635522.355350:0:17827:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1789635522.355483:0:17827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1789635522.356191:0:17827:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:00080000:3.0:1789635522.358333:0:17854:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789635522.359142:0:17854:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1789635522.359389:0:17855:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789635522.359437:0:17855:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789635522.359442:0:17855:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:3.0:1789635522.359982:0:17827:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1789635522.361304:0:17827:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789635522.361335:0:17827:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa6bb456ff988 00100000:10000000:3.0:1789635522.361342:0:17827:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1789635522.362388:0:17827:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789635522.362415:0:17827:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.120@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789635522.362430:0:17827:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789635522.362451:0:17827:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1789635522.363275:0:17827:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789635522.363502:0:17827:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789635522.598062:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789635522.916467:0:17130:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789635522.979707:0:17137:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549cf4a80 going to sleep for 0 seconds 00000040:00080000:0.0:1789635523.365687:0:17847:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789635523.620000:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789635523.624874:0:17094:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789635523.624943:0:17094:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d0550104800 from 8 10000000:01000000:1.0:1789635523.624949:0:17094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789635523.625014:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e153000/0xb0c3a59caa4101f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635523.625030:0:17094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056e153000/0xb0c3a59caa4101f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635523.625044:0:17094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056e153000/0xb0c3a59caa4101f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635523.625154:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543296300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427388928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789635523.625247:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635523.625309:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0546402900 going to sleep for 11 seconds 00000100:00100000:2.0:1789635523.625311:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427388928 00000100:00100000:2.0:1789635523.625323:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427388928 00000100:00100000:2.0:1789635523.625453:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789635523.625467:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+16:17094:x1876568427388928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635523.625489:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635523.625511:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056e1a2400/0xb0c3a59caa4101f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa4101f1 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635523.625544:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e1a2400/0xb0c3a59caa4101f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa4101f1 expref: 17 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635523.625557:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056e1a2400/0xb0c3a59caa4101f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa4101f1 expref: 17 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635523.625582:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a2400, rc 0) 00000100:00100000:2.0:1789635523.625669:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+17:17094:x1876568427388928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635523.625678:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789635523.626026:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543296300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427388928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789635523.626046:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056e153000/0xb0c3a59caa4101f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4101f8 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635523.626057:0:17094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056e153000/0xb0c3a59caa4101f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa4101f8 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635523.626125:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543296300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427389056:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789635523.626186:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635523.629970:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0546402900 going to sleep for 11 seconds 00000100:00100000:0.0:1789635523.632402:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427389056 00000100:00100000:0.0:1789635523.632425:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427389056 00000100:00100000:1.0:1789635523.634385:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789635523.634423:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+17:17094:x1876568427389056:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789635523.634463:0:17089:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789635523.634493:0:17089:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789635523.634497:0:17089:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1789635523.634939:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+17:17094:x1876568427389056:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 529us (8752us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635523.634948:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789635523.640426:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543296300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427389056:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789635523.640530:0:17094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789635523.640545:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e153000/0xb0c3a59caa4101f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4101f8 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635523.640863:0:17094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e153000/0xb0c3a59caa4101f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4101f8 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635523.640878:0:17094:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789635523.640881:0:17094:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d054b800800 from 8 10000000:01000000:1.0:1789635523.640885:0:17094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789635523.640933:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152200/0xb0c3a59caa4101ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635523.640944:0:17094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056e152200/0xb0c3a59caa4101ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635523.640957:0:17094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056e152200/0xb0c3a59caa4101ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635523.640985:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543296300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427389184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789635523.641083:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635523.641277:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0546402900 going to sleep for 11 seconds 00000100:00100000:2.0:1789635523.641337:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427389184 00000100:00100000:2.0:1789635523.641347:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427389184 00000100:00100000:2.0:1789635523.641458:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789635523.641471:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+17:17094:x1876568427389184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635523.641488:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635523.641505:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056e1a2200/0xb0c3a59caa410206 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa4101ff expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635523.641533:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e1a2200/0xb0c3a59caa410206 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa4101ff expref: 18 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635523.641556:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056e1a2200/0xb0c3a59caa410206 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa4101ff expref: 18 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635523.641580:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a2200, rc 0) 00000100:00100000:2.0:1789635523.641680:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+18:17094:x1876568427389184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 212us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635523.641688:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789635523.641774:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543296300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427389184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789635523.641791:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056e152200/0xb0c3a59caa4101ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410206 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635523.641801:0:17094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056e152200/0xb0c3a59caa4101ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa410206 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635523.641859:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543296300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427389312:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789635523.641895:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635523.651437:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427389312 00000100:00100000:0.0:1789635523.651460:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427389312 00000100:00100000:1.0:1789635523.651505:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0546402900 going to sleep for 11 seconds 00000100:00100000:2.0:1789635523.651841:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789635523.651858:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+18:17094:x1876568427389312:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789635523.651892:0:17089:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789635523.651922:0:17089:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789635523.651926:0:17089:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1789635523.653772:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+18:17094:x1876568427389312:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1907us (11863us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635523.653789:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789635523.653896:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543296300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427389312:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789635523.653994:0:17094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789635523.654010:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152200/0xb0c3a59caa4101ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410206 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635523.654024:0:17094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e152200/0xb0c3a59caa4101ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410206 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635524.005916:0:17137:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549cf4a80 going to sleep for 0 seconds 00000040:00080000:0.0:1789635524.388285:0:17847:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789635524.645901:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635525.030193:0:17137:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549cf4a80 going to sleep for 0 seconds 00010000:00010000:1.0:1789635525.667706:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635526.052695:0:17137:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549cf4a80 going to sleep for 0 seconds 00000001:02000400:1.0:1789635526.063977:0:18097:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789635526.691893:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789635526.885450:0:18149:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789635526.885991:0:18149:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789635527.079393:0:17137:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549cf4a80 going to sleep for 0 seconds 00000100:00080000:3.0:1789635527.590028:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789635527.590036:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789635527.590041:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d0546438000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789635527.590063:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d0546438000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789635527.590094:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d056e015f80 x1876568427389568/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789635527.590113:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789635527.590118:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789635527.590122:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789635527.590125:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789635527.590156:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789635527.590159:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789635527.590162:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789635527.590165:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789635527.590208:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3640:1876568427389440:0@lo:400:kworker.0 00000100:00100000:3.0:1789635527.590299:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635527.590370:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789635527.590377:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e014700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427389696:0@lo:400:kworker.0 00000100:00100000:3.0:1789635527.590410:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635527.590445:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427389824:0@lo:400:kworker.0 00000100:00100000:3.0:1789635527.590487:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635527.590517:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789635527.590523:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e017480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876568427389952:0@lo:400:kworker.0 00000100:00100000:2.0:1789635527.590662:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e015f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427389568:0@lo:38:kworker.0 00000100:00100000:2.0:1789635527.590701:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635527.590749:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427389824 00000100:00100000:2.0:1789635527.590759:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427389824 00000100:00100000:2.0:1789635527.590801:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427389568 00000100:00100000:2.0:1789635527.590804:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427389568 00000100:00100000:2.0:1789635527.590819:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789635527.590828:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427389824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635527.590889:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427389824:12345-0@lo:400:kworker.0 Request processed in 61us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635527.590896:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789635527.590914:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789635527.590919:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3639:x1876568427389568:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789635527.590946:0:17102:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 546 last 0 00000020:00000080:2.0:1789635527.590989:0:17102:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb0c3a59caa41020d 00000004:00100000:2.0:1789635527.591009:0:17102:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789635527.591016:0:17102:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1789635527.591147:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427389696 00000100:00100000:2.0:1789635527.591152:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427389696 00000100:00100000:2.0:1789635527.591181:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789635527.591188:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e015c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427389696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635527.591228:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e015c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427389696:12345-0@lo:400:kworker.0 Request processed in 41us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635527.591235:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789635527.591274:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d056e014700 x1876568427389696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635527.591289:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e014700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427389696:0@lo:400:kworker.0 00000100:00100000:3.0:1789635527.591745:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635527.591774:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427389824:0@lo:400:kworker.0 00000100:00100000:2.0:1789635527.591844:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427389952 00000100:00100000:2.0:1789635527.591850:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427389952 00000100:00100000:2.0:1789635527.591890:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789635527.591898:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876568427389952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635527.591941:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876568427389952:12345-0@lo:400:kworker.0 Request processed in 44us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635527.591947:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789635527.591978:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d056e017480 x1876568427389952/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635527.591989:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e017480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876568427389952:0@lo:400:kworker.0 00000100:00100000:0.0:1789635527.592200:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427389440 00000100:00100000:0.0:1789635527.592206:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427389440 00000100:00100000:0.0:1789635527.592239:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789635527.592247:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+18:3640:x1876568427389440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635527.592286:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+18:3640:x1876568427389440:12345-0@lo:400:kworker.0 Request processed in 40us (1987us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635527.592292:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789635527.592346:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789635527.592357:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543291c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427390080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789635527.592385:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635527.592455:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3640:1876568427389440:0@lo:400:kworker.0 00000100:00100000:0.0:1789635527.592671:0:17101:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1789635527.592681:0:17101:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1789635527.592973:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427390080 00000100:00100000:0.0:1789635527.592978:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427390080 00000100:00100000:2.0:1789635527.593123:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789635527.593131:0:18189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427390080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789635527.593162:0:18189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789635527.593260:0:18189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427390080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635527.593267:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789635527.595676:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543291c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427390080:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1789635527.596933:0:17102:0:(import.c:65:import_set_state_nolock()) ffff8d0558841000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789635527.597066:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1876568427389568:12345-0@lo:38:kworker.0 Request processed in 6144us (6362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635527.597078:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1789635527.597269:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789635527.597281:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789635527.597288:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789635527.597304:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d0546438000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1789635527.597328:0:3639:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000054355348): req@ffff8d056e016d80 x1876568427382144/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635527.597355:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e015f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427389568:0@lo:38:kworker.0 00000100:00100000:2.0:1789635527.597483:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789635527.597493:0:17137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635527.597502:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427390208:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789635527.597533:0:17137:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549cf4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789635527.597561:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635527.597649:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427382144 00000100:00100000:1.0:1789635527.597659:0:18189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427382144 00000100:00100000:0.0:1789635527.597725:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427390208 00000100:00100000:1.0:1789635527.597732:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789635527.597733:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427390208 00000100:00100000:1.0:1789635527.597746:0:18189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17137:x1876568427382144:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789635527.597773:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789635527.597785:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3640:x1876568427390208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789635527.597818:0:17101:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789635527.597875:0:18189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17137:x1876568427382144:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 130us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635527.597885:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789635527.597903:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3640:x1876568427390208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635527.597913:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789635527.597952:0:17137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e016d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17137:1876568427382144:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789635527.597974:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427390208:0@lo:41:osp-pre-1-0.0 00000040:01000000:1.0:1789635527.598005:0:17137:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789635527.598062:0:17137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17137:1876568427390336:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789635527.598103:0:17137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635527.598153:0:17137:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05446f3300 going to sleep for 11 seconds 00000100:00100000:0.0:1789635527.598163:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427390336 00000100:00100000:0.0:1789635527.598169:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427390336 00000100:00100000:0.0:1789635527.598210:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789635527.598216:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17137:x1876568427390336:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789635527.598359:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17137:x1876568427390336:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 142us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635527.598364:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789635527.598394:0:17137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17137:1876568427390336:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789635527.598486:0:17137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543292680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17137:1876568427390464:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789635527.598517:0:17137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635527.598540:0:17137:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0579b3e840 going to sleep for 11 seconds 00000100:00100000:1.0:1789635527.598888:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427390464 00000100:00100000:1.0:1789635527.598896:0:18189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427390464 00000100:00100000:1.0:1789635527.598944:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789635527.598957:0:18189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17137:x1876568427390464:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789635527.599035:0:18189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17137:x1876568427390464:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 82us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635527.599043:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789635527.599187:0:17137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543292680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17137:1876568427390464:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1789635527.599251:0:17137:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789635527.603726:0:17137:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789635527.603831:0:17137:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 17, retries 0 00000004:00080000:0.0:1789635527.603838:0:17137:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:1.0:1789635527.675425:0:18201:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789635527.676086:0:18201:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789635527.728883:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789635528.638514:0:18249:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff686141b0 20000000:00000080:3.0:1789635528.638788:0:18249:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d05654d3800 uarg=0000000000000000 20000000:01000000:3.0:1789635528.638842:0:18249:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789635528.638851:0:18249:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789635528.638858:0:18249:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789635528.639497:0:18250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1789635528.639862:0:18249:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789635528.652793:0:18249:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789635528.653223:0:18249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa410214 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635528.653261:0:18249:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d05488ff200/0xb0c3a59caa4100bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa4100b6 expref: 17 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635528.653270:0:18249:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d056e152c00/0xb0c3a59caa4101c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa4101b9 expref: 17 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635528.653279:0:18249:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa410214 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635528.653336:0:18249:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d056e152c00/0xb0c3a59caa4101c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa4101b9 expref: 17 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635528.653353:0:18249:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d056e152c00/0xb0c3a59caa4101c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa4101b9 expref: 17 pid: 17089 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635528.653372:0:18249:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18249:1876568427390592:0@lo:104: 00000100:00100000:2.0:1789635528.653463:0:18249:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789635528.653578:0:18249:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d05488ff200/0xb0c3a59caa4100bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa4100b6 expref: 17 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635528.653642:0:18249:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d05488ff200/0xb0c3a59caa4100bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa4100b6 expref: 17 pid: 17091 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635528.653653:0:18249:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18249:1876568427390720:0@lo:104: 00000100:00100000:2.0:1789635528.653678:0:18249:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635528.654504:0:18249:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d054a0bdb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789635528.654679:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427390592 00000100:00100000:1.0:1789635528.654691:0:17079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427390592 00000100:00100000:3.0:1789635528.654859:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427390720 00000100:00100000:3.0:1789635528.654864:0:17080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427390720 00000100:00100000:3.0:1789635528.654895:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789635528.654905:0:17080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+4:18249:x1876568427390592:12345-0@lo:104: 00010000:00010000:3.0:1789635528.655030:0:17080:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa4101b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa4101c0 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635528.655123:0:17080:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789635528.655129:0:17080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+4:18249:x1876568427390592:12345-0@lo:104: Request processed in 227us (1667us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635528.655137:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789635528.655182:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789635528.655189:0:17080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+3:18249:x1876568427390720:12345-0@lo:104: 00010000:00010000:3.0:1789635528.655198:0:17080:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d056e153a00/0xb0c3a59caa4100b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa4100bd expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635528.655235:0:17080:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789635528.655240:0:17080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+3:18249:x1876568427390720:12345-0@lo:104: Request processed in 52us (1561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635528.655246:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1789635528.655267:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789635528.655274:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa4101b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa4101c0 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635528.655281:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152000 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:3.0:1789635528.655286:0:17084:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa4101b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa4101c0 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635528.655295:0:17084:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa4101b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa4101c0 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789635528.655303:0:17084:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa4101b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa4101c0 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635528.655310:0:17084:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789635528.655353:0:17084:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa4101b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa4101c0 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635528.655361:0:17084:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789635528.655385:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa4101b9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa4101c0 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635528.655404:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa4101b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa4101c0 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635528.655420:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635528.655424:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d056e153a00/0xb0c3a59caa4100b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa4100bd expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635528.655430:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e153a00 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:3.0:1789635528.655433:0:17084:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d056e153a00/0xb0c3a59caa4100b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa4100bd expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635528.655440:0:17084:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056e153a00/0xb0c3a59caa4100b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa4100bd expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789635528.655446:0:17084:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056e153a00/0xb0c3a59caa4100b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa4100bd expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635528.655450:0:17084:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789635528.655467:0:17084:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d056e153a00/0xb0c3a59caa4100b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa4100bd expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635528.655473:0:17084:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789635528.655480:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d056e153a00/0xb0c3a59caa4100b6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa4100bd expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635528.655487:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056e153a00/0xb0c3a59caa4100b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa4100bd expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635528.655502:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635528.655512:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635528.655514:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635528.655636:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635528.655855:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3642:1876568427390848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789635528.655905:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635528.656061:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789635528.656068:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3642:1876568427390976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789635528.656095:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635528.656170:0:18249:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18249:1876568427390592:0@lo:104: 00000100:00100000:2.0:1789635528.656181:0:18249:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18249:1876568427390720:0@lo:104: 00010000:00010000:2.0:1789635528.656210:0:18249:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa410214 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635528.656490:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427390848 00000100:00100000:0.0:1789635528.656498:0:17081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427390848 00010000:00010000:3.0:1789635528.659063:0:17081:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d056e152c00/0xb0c3a59caa4101c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa4101b9 expref: 18 pid: 17089 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635528.659682:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427390976 00000100:00100000:2.0:1789635528.659694:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427390976 00010000:00010000:2.0:1789635528.659730:0:17083:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d05488ff200/0xb0c3a59caa4100bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa4100b6 expref: 19 pid: 17091 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635528.659776:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789635528.659785:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+19:3642:x1876568427390848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789635528.659802:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635528.659808:0:17083:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d056e152c00/0xb0c3a59caa4101c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa4101b9 expref: 19 pid: 17089 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635528.659822:0:17083:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d056e152c00/0xb0c3a59caa4101c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa4101b9 expref: 19 pid: 17089 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635528.659843:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056e152c00/0xb0c3a59caa4101c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa4101b9 expref: 19 pid: 17089 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635528.659861:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635528.660074:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+18:3642:x1876568427390848:12345-0@lo:103:ldlm_bl.0 Request processed in 289us (4168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635528.660082:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789635528.660102:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789635528.660108:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448598000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+17:3642:x1876568427390976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789635528.660115:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635528.660120:0:17083:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d05488ff200/0xb0c3a59caa4100bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa4100b6 expref: 17 pid: 17091 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635528.660129:0:17083:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d05488ff200/0xb0c3a59caa4100bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa4100b6 expref: 17 pid: 17091 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635528.660154:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d05488ff200/0xb0c3a59caa4100bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa4100b6 expref: 17 pid: 17091 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635528.660166:0:17083:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa410214 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635528.660176:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa410214 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635528.660193:0:17083:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa410214 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635528.660201:0:17083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa410214 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635528.660208:0:17083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa410214 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635528.660216:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa410214 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635528.660223:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a2800 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635528.660228:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa410214 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635528.660236:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa410214 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635528.660255:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa410214 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635528.660274:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635528.660297:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448598000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+16:3642:x1876568427390976:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (4202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635528.660303:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1789635528.660337:0:18249:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa410214 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635528.660346:0:18249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa410214 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635528.660353:0:18249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa410214 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635528.660697:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3642:1876568427390976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789635528.660719:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3642:1876568427390848:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789635528.740490:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635529.764281:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789635529.766459:0:17094:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789635529.766466:0:17094:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0550104800 from 13 10000000:01000000:3.0:1789635529.766471:0:17094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789635529.766522:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05488ffc00/0xb0c3a59caa41021b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635529.766534:0:17094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d05488ffc00/0xb0c3a59caa41021b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635529.766545:0:17094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d05488ffc00/0xb0c3a59caa41021b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635529.766571:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427391104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789635529.766679:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635529.769428:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427391104 00000100:00100000:0.0:1789635529.769442:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427391104 00000100:00100000:0.0:1789635529.769734:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789635529.769744:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+16:17094:x1876568427391104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789635529.769761:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635529.769782:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0446d1b000/0xb0c3a59caa410222 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa41021b expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635529.769810:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0446d1b000/0xb0c3a59caa410222 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa41021b expref: 17 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635529.769821:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0446d1b000/0xb0c3a59caa410222 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa41021b expref: 17 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635529.769830:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1b000, rc 0) 00000100:00100000:0.0:1789635529.769893:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+17:17094:x1876568427391104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (3213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635529.769900:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789635529.770568:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0551530e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789635529.770791:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427391104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789635529.770811:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d05488ffc00/0xb0c3a59caa41021b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410222 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635529.770841:0:17094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d05488ffc00/0xb0c3a59caa41021b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa410222 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635529.770919:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427391232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635529.770962:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635529.770990:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0551530e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789635529.771517:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427391232 00000100:00100000:2.0:1789635529.771524:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427391232 00000100:00100000:2.0:1789635529.771568:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789635529.771580:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+17:17094:x1876568427391232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635529.771765:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+17:17094:x1876568427391232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 188us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635529.771773:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789635529.771823:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427391232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635529.771857:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543296680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427391360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789635529.771900:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635529.771935:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05446f3480 going to sleep for 11 seconds 00000100:00100000:3.0:1789635529.772002:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427391360 00000100:00100000:3.0:1789635529.772007:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427391360 00000100:00100000:3.0:1789635529.772146:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789635529.772154:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+17:17094:x1876568427391360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789635529.772242:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+17:17094:x1876568427391360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635529.772249:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789635529.772523:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543296680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427391360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789635529.773973:0:18310:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789635529.774154:0:17094:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789635529.774178:0:17094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789635529.774190:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05488ffc00/0xb0c3a59caa41021b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410222 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635529.774202:0:17094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d05488ffc00/0xb0c3a59caa41021b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410222 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635529.774327:0:17094:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789635529.774329:0:17094:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d054b800800 from 13 10000000:01000000:1.0:1789635529.774332:0:17094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789635529.774367:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e153c00/0xb0c3a59caa410229 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635529.774375:0:17094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056e153c00/0xb0c3a59caa410229 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635529.774384:0:17094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056e153c00/0xb0c3a59caa410229 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635529.774407:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427391488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789635529.774466:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635529.774565:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05446f3300 going to sleep for 11 seconds 00000100:00100000:2.0:1789635529.774576:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427391488 00000100:00100000:2.0:1789635529.774675:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427391488 00000100:00100000:2.0:1789635529.774877:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789635529.774889:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+17:17094:x1876568427391488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635529.774901:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635529.774914:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056e1a3400/0xb0c3a59caa410230 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa410229 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635529.774947:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e1a3400/0xb0c3a59caa410230 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa410229 expref: 18 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635529.774955:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056e1a3400/0xb0c3a59caa410230 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa410229 expref: 18 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635529.774961:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a3400, rc 0) 00000100:00100000:2.0:1789635529.774998:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+18:17094:x1876568427391488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635529.775004:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789635529.775024:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427391488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789635529.775038:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056e153c00/0xb0c3a59caa410229 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410230 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635529.775046:0:17094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056e153c00/0xb0c3a59caa410229 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa410230 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635529.775150:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427391616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635529.775176:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635529.775305:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427391616 00000100:00100000:3.0:1789635529.775310:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427391616 00000100:00100000:3.0:1789635529.775347:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789635529.775354:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+18:17094:x1876568427391616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635529.775425:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05446f3300 going to sleep for 11 seconds 00000100:00100000:3.0:1789635529.775468:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+18:17094:x1876568427391616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635529.775476:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789635529.775720:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427391616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635529.775862:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427391744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789635529.775892:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635529.775947:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05446f3300 going to sleep for 11 seconds 00000100:00100000:2.0:1789635529.775982:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427391744 00000100:00100000:2.0:1789635529.775987:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427391744 00000100:00100000:2.0:1789635529.776020:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789635529.776027:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+18:17094:x1876568427391744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789635529.776513:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+18:17094:x1876568427391744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 485us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635529.776520:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789635529.776590:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427391744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789635529.777925:0:18311:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789635529.778190:0:17094:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789635529.778282:0:17094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789635529.778294:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e153c00/0xb0c3a59caa410229 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410230 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635529.778305:0:17094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e153c00/0xb0c3a59caa410229 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410230 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635530.788135:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635531.813034:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789635532.132229:0:17130:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789635532.707676:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789635522/real 1789635522] req@ffff8d0543293800 x1876568427385344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789635532 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635532.707706:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d0543293800 x1876568427385344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789635532 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635532.707717:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789635522/real 1789635522] req@ffff8d05759d0000 x1876568427385216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789635532 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635532.707729:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d05759d0000 x1876568427385216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789635532 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789635532.707749:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d057b5c7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789635532.707767:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789635532.707772:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1876568427385344:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789635532.707777:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d04478c5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789635532.707782:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789635532.707784:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1876568427385216:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789635532.707918:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789635532.707923:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789635532.707926:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789635532.707928:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789635532.707948:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789635532.707951:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789635532.707969:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d04478c5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789635532.707973:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 540 00000100:00080000:2.0:1789635532.707979:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789635532.707988:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d04478c5800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1789635532.708008:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d05759d0000 x1876568427392384/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789635532.708019:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789635532.708022:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789635532.708024:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d057b5c7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789635532.708027:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 540 00000100:00080000:2.0:1789635532.708030:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789635532.708033:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d057b5c7800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1789635532.708041:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d05759d1880 x1876568427392512/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789635532.708069:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427392000:0@lo:400:kworker.0 00000100:00100000:2.0:1789635532.708119:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635532.708161:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789635532.708167:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3641:1876568427391872:0@lo:400:kworker.0 00000100:00100000:2.0:1789635532.708189:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635532.708208:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876568427392640:0@lo:400:kworker.0 00000100:00100000:2.0:1789635532.708227:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635532.708247:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427392256:0@lo:400:kworker.0 00000100:00100000:2.0:1789635532.708269:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635532.708282:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789635532.708287:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876568427392128:0@lo:400:kworker.0 00000100:00100000:2.0:1789635532.708312:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635532.709080:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427392000 00000100:00100000:2.0:1789635532.709090:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427392000 00000100:00100000:2.0:1789635532.709125:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427392256 00000100:00100000:2.0:1789635532.709127:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427392256 00000100:00100000:2.0:1789635532.709140:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789635532.709148:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1876568427392000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635532.709203:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1876568427392000:12345-0@lo:400:kworker.0 Request processed in 55us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635532.709210:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789635532.709224:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789635532.709229:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e015f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427392256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635532.709253:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e015f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427392256:12345-0@lo:400:kworker.0 Request processed in 25us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635532.709259:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789635532.709275:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427391872 00000100:00100000:2.0:1789635532.709278:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427391872 00000100:00100000:2.0:1789635532.709299:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789635532.709304:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+18:3641:x1876568427391872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635532.709327:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+18:3641:x1876568427391872:12345-0@lo:400:kworker.0 Request processed in 23us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635532.709438:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1876568427392384:0@lo:8:kworker.0 00000400:00000100:1.0:1789635532.709463:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876568427392384 offset 0 length 520: 4 00000100:00100000:1.0:1789635532.709484:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1876568427392512:0@lo:8:kworker.0 00000400:00000100:1.0:1789635532.709497:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876568427392512 offset 0 length 520: 4 00000100:00100000:2.0:1789635532.710045:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789635532.710077:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427392640 00000100:00100000:2.0:1789635532.710081:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427392640 00000100:00100000:2.0:1789635532.710104:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427392128 00000100:00100000:2.0:1789635532.710106:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427392128 00000100:00100000:2.0:1789635532.710120:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789635532.710126:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e016d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876568427392640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635532.710167:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e016d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876568427392640:12345-0@lo:400:kworker.0 Request processed in 40us (1938us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635532.710173:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789635532.710182:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789635532.710187:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e016300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876568427392128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635532.710207:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e016300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876568427392128:12345-0@lo:400:kworker.0 Request processed in 20us (1894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635532.710212:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789635532.710255:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d05759d0700 x1876568427392128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635532.710268:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876568427392128:0@lo:400:kworker.0 00000100:00100000:2.0:1789635532.710278:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427392256:0@lo:400:kworker.0 00000100:00100000:2.0:1789635532.710302:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3641:1876568427391872:0@lo:400:kworker.0 00010000:00080000:2.0:1789635532.710311:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d05759d3480 x1876568427392640/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635532.710320:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876568427392640:0@lo:400:kworker.0 00000100:00100000:2.0:1789635532.710328:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427392000:0@lo:400:kworker.0 00000100:00100000:1.0:1789635532.710451:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789635532.710459:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427392768:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789635532.710485:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635532.710507:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427392768 00000100:00100000:1.0:1789635532.710511:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427392768 00000100:00100000:1.0:1789635532.710528:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789635532.710534:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427392768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789635532.710556:0:17101:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789635532.710584:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427392768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 50us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635532.710617:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789635532.710654:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427392768:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789635532.714505:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427392896:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789635532.714571:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635532.714750:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427392896 00000100:00100000:0.0:1789635532.714758:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427392896 00000100:00100000:0.0:1789635532.714809:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789635532.714819:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1876568427392896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789635532.714853:0:17102:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789635532.714895:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1876568427392896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635532.714901:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789635532.715065:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427392896:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789635532.840330:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789635533.224247:0:17828:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1789635533.863676:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789635534.629051:0:17847:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:0.0:1789635534.640502:0:18598:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789635534.640508:0:18598:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789635534.640510:0:18598:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789635534.640966:0:18598:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d0447985000 00000020:01000004:0.0:1789635534.640988:0:18598:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789635534.641006:0:18598:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789635534.641026:0:18598:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d057472b380) 00000020:00000080:0.0:1789635534.641049:0:18598:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789635534.686538:0:18598:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789635534.690902:0:18598:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789635534.692305:0:18598:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789635534.693003:0:18598:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1789635534.693353:0:18598:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789635534.693989:0:18598:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789635534.694289:0:18598:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:3.0:1789635534.698730:0:18598:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789635534.699062:0:18598:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789635534.699082:0:18598:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789635534.699103:0:18598:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb0c3a59caa41023e 00000020:01000004:3.0:1789635534.699113:0:18598:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789635534.699141:0:18598:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.120@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789635534.699145:0:18598:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789635534.699152:0:18598:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789635534.699158:0:18598:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789635534.699190:0:18598:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8d05655a4d40) 00000020:00000080:3.0:1789635534.699206:0:18598:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1789635534.705773:0:18598:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789635534.705973:0:18598:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789635534.705979:0:18598:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789635534.709724:0:18598:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789635534.709738:0:18598:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789635534.710341:0:18598:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789635534.710419:0:18598:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789635534.713422:0:18598:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789635534.713766:0:18598:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789635534.713774:0:18598:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789635534.715232:0:18598:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789635534.715241:0:18598:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789635534.737031:0:18598:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789635534.737278:0:18598:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789635534.737292:0:18598:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789635534.739185:0:18598:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789635534.739198:0:18598:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789635534.740742:0:18598:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789635534.740758:0:18598:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789635534.743974:0:18598:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789635534.744251:0:18598:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789635534.744259:0:18598:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789635534.745279:0:18598:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789635534.745286:0:18598:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789635534.780155:0:18598:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789635534.780352:0:18598:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789635534.780359:0:18598:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789635534.782771:0:18598:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789635534.782785:0:18598:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789635534.783714:0:18598:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789635534.783744:0:18598:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1789635534.783750:0:18598:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.120@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789635534.824189:0:18598:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789635534.824228:0:18598:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.120@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1789635534.824233:0:18598:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789635534.824235:0:18598:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789635534.824236:0:18598:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789635534.824237:0:18598:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789635534.824238:0:18598:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789635534.824239:0:18598:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789635534.824241:0:18598:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789635534.824242:0:18598:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789635534.824243:0:18598:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789635534.824247:0:18598:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1789635534.824250:0:18598:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789635534.824251:0:18598:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789635534.824252:0:18598:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789635534.824253:0:18598:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789635534.824254:0:18598:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789635534.824255:0:18598:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789635534.824256:0:18598:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789635534.824257:0:18598:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789635534.824258:0:18598:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789635534.824300:0:18598:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789635534.824322:0:18598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e017480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427393024:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789635534.824395:0:18598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635534.825090:0:18598:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d054c33cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789635534.825208:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427393024 00000100:00100000:0.0:1789635534.825216:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427393024 00000100:00100000:0.0:1789635534.825303:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789635534.825314:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+18:18598:x1876568427393024:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789635534.825359:0:17089:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789635534.825363:0:17089:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1789635534.825367:0:17089:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789635534.825791:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+18:18598:x1876568427393024:12345-0@lo:253:mount.lustre.0 Request processed in 479us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635534.825807:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789635534.825930:0:18598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e017480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427393024:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789635534.825944:0:18598:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789635534.825947:0:18598:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789635534.825949:0:18598:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789635534.825950:0:18598:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789635534.825951:0:18598:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789635534.825952:0:18598:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789635534.825953:0:18598:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789635534.825955:0:18598:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789635534.825956:0:18598:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789635534.825957:0:18598:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789635534.825976:0:18598:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d0447985000 from lustre-OST0000 10000000:01000000:1.0:1789635534.826003:0:18598:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789635534.826006:0:18598:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789635534.826014:0:18598:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d056f55b380 local copy 00010000:00010000:1.0:1789635534.826023:0:18598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2a00/0xb0c3a59caa40fff9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410000 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635534.826151:0:18598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543295180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427393152:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789635534.826185:0:18598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635534.826401:0:18598:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d054c33cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789635534.826441:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427393152 00000100:00100000:2.0:1789635534.826447:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427393152 00000100:00100000:0.0:1789635534.826593:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789635534.826731:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+18:18598:x1876568427393152:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789635534.826827:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+18:18598:x1876568427393152:12345-0@lo:501:mount.lustre.0 Request processed in 99us (641us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789635534.826835:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789635534.826906:0:18598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543295180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427393152:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789635534.826920:0:18598:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789635534.826938:0:18598:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789635534.826945:0:18598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2a00/0xb0c3a59caa40fff9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410000 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635534.826955:0:18598:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2a00/0xb0c3a59caa40fff9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410000 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635534.826991:0:18598:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d0447985000 10000000:01000000:1.0:1789635534.826996:0:18598:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789635534.827001:0:18598:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789635534.827004:0:18598:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789635534.827008:0:18598:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789635534.827011:0:18598:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789635534.827033:0:18598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e153800/0xb0c3a59caa41024c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635534.827040:0:18598:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056e153800/0xb0c3a59caa41024c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635534.827049:0:18598:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056e153800/0xb0c3a59caa41024c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635534.827063:0:18598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543295180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427393280:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789635534.827091:0:18598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635534.827232:0:18598:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d054c33cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789635534.827300:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427393280 00000100:00100000:3.0:1789635534.827306:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427393280 00000100:00100000:0.0:1789635534.827396:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789635534.827403:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546405450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+18:18598:x1876568427393280:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789635534.827414:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635534.827427:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0446d1aa00/0xb0c3a59caa410253 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa41024c expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635534.827448:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0446d1aa00/0xb0c3a59caa410253 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa41024c expref: 19 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635534.827465:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0446d1aa00/0xb0c3a59caa410253 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa41024c expref: 19 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635534.827474:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1aa00, rc 0) 00000100:00100000:0.0:1789635534.827513:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546405450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+19:18598:x1876568427393280:12345-0@lo:101:mount.lustre.0 Request processed in 110us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635534.827519:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789635534.827630:0:18598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543295180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427393280:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789635534.827643:0:18598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056e153800/0xb0c3a59caa41024c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410253 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635534.827664:0:18598:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056e153800/0xb0c3a59caa41024c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa410253 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789635534.828538:0:18598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789635534.829173:0:18598:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789635534.831074:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789635534.831129:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789635534.831146:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789635534.831160:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789635534.831185:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789635534.831199:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789635534.831223:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789635534.831229:0:18598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789635534.831328:0:18598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448599c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427393408:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789635534.831394:0:18598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635534.831443:0:18598:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0565a28600 going to sleep for 11 seconds 00000100:00100000:1.0:1789635534.831699:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427393408 00000100:00100000:1.0:1789635534.831706:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427393408 00000100:00100000:1.0:1789635534.831753:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789635534.831763:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+19:18598:x1876568427393408:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789635534.831905:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+19:18598:x1876568427393408:12345-0@lo:501:mount.lustre.0 Request processed in 142us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635534.831912:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789635534.832158:0:18598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448599c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427393408:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789635534.832192:0:18598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448599c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427393536:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789635534.832234:0:18598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635534.832300:0:18598:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0565a28600 going to sleep for 11 seconds 00000100:00100000:2.0:1789635534.832353:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427393536 00000100:00100000:2.0:1789635534.832359:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427393536 00000100:00100000:1.0:1789635534.832457:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789635534.832465:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546404850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+19:18598:x1876568427393536:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789635534.833172:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546404850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+19:18598:x1876568427393536:12345-0@lo:503:mount.lustre.0 Request processed in 705us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635534.833180:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789635534.833339:0:18598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448599c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427393536:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789635534.833897:0:18598:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789635534.833972:0:18598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448599c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427393664:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789635534.834020:0:18598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635534.834102:0:18598:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0548894e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789635534.834142:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427393664 00000100:00100000:1.0:1789635534.834148:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427393664 00000100:00100000:1.0:1789635534.834229:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789635534.834238:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+19:18598:x1876568427393664:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789635534.834556:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+19:18598:x1876568427393664:12345-0@lo:502:mount.lustre.0 Request processed in 318us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635534.834564:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789635534.834812:0:18598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448599c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427393664:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789635534.834990:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789635534.835016:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789635534.835028:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789635534.835042:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789635534.835054:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789635534.835066:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789635534.835093:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789635534.835108:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789635534.835120:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1789635534.835131:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1789635534.835153:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1789635534.835165:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1789635534.835190:0:18598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448599c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427393792:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789635534.835230:0:18598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635534.835380:0:18598:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0548894e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789635534.835443:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427393792 00000100:00100000:0.0:1789635534.835449:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427393792 00000100:00100000:0.0:1789635534.835478:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789635534.835484:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+19:18598:x1876568427393792:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789635534.835590:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+19:18598:x1876568427393792:12345-0@lo:502:mount.lustre.0 Request processed in 105us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635534.835616:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789635534.835759:0:18598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448599c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427393792:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789635534.835801:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1789635534.835811:0:18598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1789635534.836374:0:18615:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789635534.836382:0:18615:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1789635534.836387:0:18615:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635534.836390:0:18615:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789635534.836395:0:18615:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789635534.836409:0:18615:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d057472cd40) 00000020:00000080:0.0:1789635534.836431:0:18615:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789635534.836436:0:18615:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789635534.836502:0:18615:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d0447985000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789635534.836510:0:18615:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789635534.836516:0:18615:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb0c3a59caa410261 00010000:00010000:0.0:1789635534.842874:0:18615:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1789635534.843309:0:18615:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:0.0:1789635534.844927:0:18615:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1789635534.846003:0:18615:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789635534.846012:0:18615:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635534.846017:0:18615:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635534.846019:0:18615:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789635534.846022:0:18615:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789635534.846024:0:18615:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1789635534.846026:0:18615:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789635534.846027:0:18615:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789635534.846029:0:18615:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789635534.846031:0:18615:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635534.846032:0:18615:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789635534.846035:0:18615:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789635534.846037:0:18615:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635534.846039:0:18615:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789635534.846041:0:18615:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789635534.846043:0:18615:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789635534.846045:0:18615:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635534.846047:0:18615:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635534.846048:0:18615:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789635534.846050:0:18615:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789635534.846052:0:18615:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635534.846053:0:18615:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789635534.846056:0:18615:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789635534.846075:0:18615:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635534.846077:0:18615:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635534.846079:0:18615:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789635534.846082:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1789635534.846215:0:18598:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1789635534.846241:0:18598:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789635534.846261:0:18598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e153800/0xb0c3a59caa41024c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410253 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635534.846272:0:18598:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e153800/0xb0c3a59caa41024c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410253 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635534.846281:0:18598:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0447985000 from 1 10000000:01000000:3.0:1789635534.846283:0:18598:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789635534.846314:0:18598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05488fe200/0xb0c3a59caa410268 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635534.846322:0:18598:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d05488fe200/0xb0c3a59caa410268 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635534.846333:0:18598:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d05488fe200/0xb0c3a59caa410268 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635534.846354:0:18598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448599c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427393920:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789635534.846411:0:18598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635534.846460:0:18598:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0548894e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789635534.846537:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427393920 00000100:00100000:1.0:1789635534.846545:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427393920 00000100:00100000:1.0:1789635534.846614:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789635534.846623:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+19:18598:x1876568427393920:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789635534.846635:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635534.846648:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056e152a00/0xb0c3a59caa41026f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa410268 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635534.846809:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e152a00/0xb0c3a59caa41026f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa410268 expref: 20 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635534.846820:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056e152a00/0xb0c3a59caa41026f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa410268 expref: 20 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635534.846829:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e152a00, rc 0) 00000100:00100000:1.0:1789635534.846872:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+20:18598:x1876568427393920:12345-0@lo:101:mount.lustre.0 Request processed in 250us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635534.846887:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789635534.846968:0:18598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448599c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427393920:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789635534.846981:0:18598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d05488fe200/0xb0c3a59caa410268 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa41026f expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635534.846989:0:18598:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d05488fe200/0xb0c3a59caa410268 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa41026f expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789635534.847757:0:18598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789635534.847960:0:18598:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789635534.848101:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789635534.848122:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789635534.848136:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789635534.848140:0:18598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789635534.848189:0:18598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448599c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427394048:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789635534.848227:0:18598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635534.848257:0:18598:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0548894300 going to sleep for 11 seconds 00000100:00100000:1.0:1789635534.848327:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427394048 00000100:00100000:1.0:1789635534.848333:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427394048 00000100:00100000:1.0:1789635534.848398:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789635534.848406:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+20:18598:x1876568427394048:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789635534.848491:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+20:18598:x1876568427394048:12345-0@lo:501:mount.lustre.0 Request processed in 85us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635534.848498:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789635534.848557:0:18598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448599c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427394048:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789635534.848593:0:18598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448599c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427394176:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789635534.848661:0:18598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635534.850589:0:18598:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0548894300 going to sleep for 11 seconds 00000100:00100000:0.0:1789635534.850862:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427394176 00000100:00100000:0.0:1789635534.850872:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427394176 00000100:00100000:0.0:1789635534.850923:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789635534.850933:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+20:18598:x1876568427394176:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789635534.851108:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+20:18598:x1876568427394176:12345-0@lo:503:mount.lustre.0 Request processed in 176us (2456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635534.851126:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789635534.851223:0:18598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448599c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427394176:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789635534.852926:0:18598:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789635534.853033:0:18598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448599c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427394304:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789635534.853103:0:18598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635534.853144:0:18598:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0546402180 going to sleep for 11 seconds 00000100:00100000:0.0:1789635534.854512:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427394304 00000100:00100000:0.0:1789635534.854521:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427394304 00000100:00100000:0.0:1789635534.854568:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789635534.854586:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+20:18598:x1876568427394304:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789635534.854754:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+20:18598:x1876568427394304:12345-0@lo:502:mount.lustre.0 Request processed in 169us (1650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635534.854761:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789635534.855159:0:18598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448599c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427394304:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789635534.855379:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789635534.855412:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789635534.855428:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789635534.855440:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789635534.855451:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789635534.855462:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789635534.855472:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789635534.855482:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1789635534.855493:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1789635534.855504:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1789635534.855515:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1789635534.855546:0:18598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448599c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427394432:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789635534.856769:0:18598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635534.856816:0:18598:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0548894e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789635534.856893:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427394432 00000100:00100000:0.0:1789635534.856902:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427394432 00000100:00100000:0.0:1789635534.856963:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789635534.856972:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+20:18598:x1876568427394432:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789635534.857104:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+20:18598:x1876568427394432:12345-0@lo:502:mount.lustre.0 Request processed in 133us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635534.857111:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789635534.857279:0:18598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448599c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427394432:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789635534.857354:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1789635534.857367:0:18598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1789635534.863819:0:18619:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789635534.863833:0:18619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635534.863835:0:18619:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789635534.863844:0:18619:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d0447985000 00000020:00000080:0.0:1789635534.863846:0:18619:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789635534.863853:0:18619:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635534.863856:0:18619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635534.863857:0:18619:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789635534.863859:0:18619:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789635534.863861:0:18619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635534.863862:0:18619:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789635534.863865:0:18619:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d0447985000 00000020:00000080:0.0:1789635534.863867:0:18619:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789635534.863966:0:18619:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635534.863970:0:18619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635534.863971:0:18619:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789635534.863973:0:18619:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789635534.863976:0:18619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635534.863977:0:18619:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789635534.863981:0:18619:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d0447985000 00000020:00000080:0.0:1789635534.863983:0:18619:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789635534.865895:0:18619:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635534.865906:0:18619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635534.865907:0:18619:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789635534.865911:0:18619:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789635534.865915:0:18619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635534.865916:0:18619:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789635534.865921:0:18619:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d0447985000 00000020:00000080:0.0:1789635534.865923:0:18619:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789635534.865982:0:18619:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635534.865985:0:18619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635534.865986:0:18619:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789635534.865989:0:18619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1789635534.870870:0:18598:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789635534.870916:0:18598:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789635534.870933:0:18598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05488fe200/0xb0c3a59caa410268 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa41026f expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635534.870945:0:18598:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d05488fe200/0xb0c3a59caa410268 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa41026f expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635534.871011:0:18598:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789635534.871015:0:18598:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d0447985000 10000000:01000000:1.0:1789635534.871018:0:18598:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d0447985000 10000000:01000000:1.0:1789635534.871022:0:18598:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789635534.871028:0:18598:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d0447985000 from 1 10000000:01000000:1.0:1789635534.871031:0:18598:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789635534.871069:0:18598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e153400/0xb0c3a59caa410276 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635534.871078:0:18598:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056e153400/0xb0c3a59caa410276 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635534.871089:0:18598:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056e153400/0xb0c3a59caa410276 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635534.871123:0:18598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543297800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427394560:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789635534.871187:0:18598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635534.871219:0:18598:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549cf49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635534.871292:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427394560 00000100:00100000:0.0:1789635534.871299:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427394560 00000100:00100000:0.0:1789635534.871344:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789635534.871353:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+20:18598:x1876568427394560:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789635534.871365:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635534.871377:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0446d1a600/0xb0c3a59caa41027d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa410276 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635534.871399:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0446d1a600/0xb0c3a59caa41027d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa410276 expref: 21 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635534.871410:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0446d1a600/0xb0c3a59caa41027d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa410276 expref: 21 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635534.871425:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0446d1a600, rc 0) 00000100:00100000:0.0:1789635534.871462:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+21:18598:x1876568427394560:12345-0@lo:101:mount.lustre.0 Request processed in 110us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635534.871468:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789635534.872716:0:18598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543297800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427394560:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789635534.872741:0:18598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056e153400/0xb0c3a59caa410276 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa41027d expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635534.872753:0:18598:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056e153400/0xb0c3a59caa410276 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa41027d expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789635534.883200:0:18598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1789635534.883478:0:18598:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789635534.884833:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789635534.884891:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789635534.884918:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789635534.884933:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789635534.884945:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789635534.884958:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789635534.884971:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789635534.884983:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789635534.884997:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789635534.885009:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789635534.885021:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789635534.885033:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789635534.885046:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789635534.885059:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789635534.885074:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789635534.885089:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789635534.885102:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789635534.885129:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789635534.885146:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789635534.885160:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789635534.885176:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789635534.885190:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789635534.885205:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789635534.885219:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789635534.885233:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1789635534.885247:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1789635534.885262:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1789635534.885276:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1789635534.885290:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1789635534.885304:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1789635534.885318:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1789635534.885332:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1789635534.885347:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1789635534.885377:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1789635534.885394:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1789635534.885420:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1789635534.885436:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1789635534.885460:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1789635534.885466:0:18598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1789635534.885587:0:18598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e014380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427394688:0@lo:501:mount.lustre.0 00010000:00010000:0.0:1789635534.885963:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635534.888742:0:18598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635534.888803:0:18598:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05677b0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635534.889873:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427394688 00000100:00100000:2.0:1789635534.889884:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427394688 00000100:00100000:2.0:1789635534.889947:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789635534.889958:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+21:18598:x1876568427394688:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789635534.890125:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+21:18598:x1876568427394688:12345-0@lo:501:mount.lustre.0 Request processed in 168us (1391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635534.890133:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789635534.890186:0:18598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e014380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427394688:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789635534.890232:0:18598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e014380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427394816:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789635534.890276:0:18598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635534.890292:0:18598:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05677b0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635534.890338:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427394816 00000100:00100000:1.0:1789635534.890343:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427394816 00000100:00100000:1.0:1789635534.890374:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789635534.890381:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+21:18598:x1876568427394816:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789635534.890463:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+21:18598:x1876568427394816:12345-0@lo:503:mount.lustre.0 Request processed in 82us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635534.890470:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789635534.890559:0:18598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e014380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427394816:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789635534.891115:0:18598:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789635534.891188:0:18598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e014380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427394944:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789635534.891236:0:18598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635534.894787:0:18598:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05677b0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635534.897118:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427394944 00000100:00100000:1.0:1789635534.897131:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427394944 00000100:00100000:1.0:1789635534.897204:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789635534.897215:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+21:18598:x1876568427394944:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789635534.897384:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+21:18598:x1876568427394944:12345-0@lo:502:mount.lustre.0 Request processed in 171us (6149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635534.897393:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789635534.897789:0:18598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e014380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427394944:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789635534.898032:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789635534.898060:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789635534.898073:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789635534.898085:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789635534.898096:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789635534.898108:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789635534.898119:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789635534.898130:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789635534.898141:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789635534.898152:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789635534.898163:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789635534.898174:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789635534.898186:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789635534.898196:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789635534.898206:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789635534.898220:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789635534.898232:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789635534.898244:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789635534.898258:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789635534.898271:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789635534.898284:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789635534.898311:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789635534.898323:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789635534.898346:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789635534.898361:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1789635534.898375:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1789635534.898386:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1789635534.898398:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1789635534.898410:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1789635534.898424:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1789635534.898437:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1789635534.898450:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1789635534.898463:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1789635534.898477:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1789635534.898490:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1789635534.898503:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1789635534.898514:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1789635534.898540:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1789635534.898556:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1789635534.898568:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1789635534.898619:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1789635534.898637:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1789635534.898650:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1789635534.898677:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1789635534.898690:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1789635534.898703:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1789635534.898716:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1789635534.898729:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1789635534.898778:0:18598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543291880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427395072:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789635534.898842:0:18598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635534.898881:0:18598:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0446df5480 going to sleep for 11 seconds 00000100:00100000:1.0:1789635534.899033:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427395072 00000100:00100000:1.0:1789635534.899046:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427395072 00000100:00100000:1.0:1789635534.899096:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789635534.899104:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+21:18598:x1876568427395072:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789635534.899210:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+21:18598:x1876568427395072:12345-0@lo:502:mount.lustre.0 Request processed in 106us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635534.899218:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789635534.899744:0:18598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543291880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427395072:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789635534.899918:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1789635534.899940:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1789635534.899972:0:18598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543291880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427395200:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789635534.900015:0:18598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635534.900051:0:18598:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0546402900 going to sleep for 11 seconds 00000100:00100000:0.0:1789635534.900069:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427395200 00000100:00100000:0.0:1789635534.900074:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427395200 00000100:00100000:0.0:1789635534.900145:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789635534.900153:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+21:18598:x1876568427395200:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789635534.900252:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+21:18598:x1876568427395200:12345-0@lo:502:mount.lustre.0 Request processed in 99us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635534.900259:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789635534.902380:0:18598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543291880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427395200:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789635534.902480:0:18598:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1789635534.902494:0:18598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789635534.908971:0:18625:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789635534.908990:0:18625:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d044646b380) 00000020:00000080:2.0:1789635534.909014:0:18625:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1789635534.909134:0:18625:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d0447985000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789635534.909140:0:18625:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d0447985000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789635534.909142:0:18625:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d0447985000 3 00010000:00080000:2.0:1789635534.909171:0:18625:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d0445aae800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.120@tcp at head 00010000:00010000:2.0:1789635534.911948:0:18625:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1789635534.912414:0:18625:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789635534.912460:0:18625:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789635534.912473:0:18625:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xb0c3a59caa41028b 00000100:00080000:2.0:1789635534.912484:0:18625:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789635534.912495:0:18625:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d0445aae800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1789635534.912531:0:18625:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d056e014700 x1876568427395328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789635534.912581:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e014700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1876568427395328:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789635534.914395:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635534.914550:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427395328 00000100:00100000:2.0:1789635534.914560:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427395328 00000100:00080000:0.0:1789635534.914742:0:18625:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789635534.914805:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789635534.914809:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789635534.914812:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789635534.914816:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789635534.914838:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789635534.914841:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789635534.914844:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789635534.914847:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789635534.914873:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427395456:0@lo:400:kworker.0 00000100:00100000:0.0:1789635534.914930:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635534.914953:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789635534.914959:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543293b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876568427395840:0@lo:400:kworker.0 00000100:00100000:0.0:1789635534.914984:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635534.915038:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789635534.915047:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e014380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1876568427395328:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789635534.915076:0:17098:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:2.0:1789635534.915130:0:17098:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xb0c3a59caa410292 00000004:00100000:2.0:1789635534.915146:0:17098:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789635534.915179:0:17098:0:(import.c:65:import_set_state_nolock()) ffff8d0445aa8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789635534.915226:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e014380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876568427395328:12345-0@lo:38:llog_process_th.0 Request processed in 179us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635534.915234:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789635534.915249:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427395840 00000100:00100000:2.0:1789635534.915252:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427395840 00000100:00100000:2.0:1789635534.915285:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789635534.915292:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876568427395840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635534.915337:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876568427395840:12345-0@lo:400:kworker.0 Request processed in 46us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635534.915344:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789635534.915368:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427395712:0@lo:400:kworker.0 00000100:00100000:2.0:1789635534.915393:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635534.915412:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789635534.915418:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876568427395584:0@lo:400:kworker.0 00000100:00100000:2.0:1789635534.915439:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635534.915464:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427395584 00000100:00100000:2.0:1789635534.915467:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427395584 00000100:00100000:2.0:1789635534.915490:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789635534.915496:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876568427395584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635534.915529:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876568427395584:12345-0@lo:400:kworker.0 Request processed in 33us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635534.915535:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789635534.915897:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427395456 00000100:00100000:2.0:1789635534.915902:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427395456 00000100:00100000:2.0:1789635534.915935:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427395712 00000100:00100000:2.0:1789635534.915938:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427395712 00000100:00100000:2.0:1789635534.915955:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789635534.915962:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427395456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635534.915998:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427395456:12345-0@lo:400:kworker.0 Request processed in 37us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635534.916005:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789635534.916017:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789635534.916029:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e017480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427395712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635534.916059:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e017480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427395712:12345-0@lo:400:kworker.0 Request processed in 30us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635534.916065:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1789635534.916102:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0543290700 x1876568427395584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635534.916116:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876568427395584:0@lo:400:kworker.0 00000100:00100000:2.0:1789635534.916128:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427395712:0@lo:400:kworker.0 00010000:00080000:2.0:1789635534.916157:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d056e014700 x1876568427395328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789635544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635534.916166:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789635534.916173:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1789635534.916180:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789635534.916185:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789635534.916188:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d0445aae800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789635534.916194:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e014700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1876568427395328:0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789635534.916292:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0543293b80 x1876568427395840/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635534.916302:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543293b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876568427395840:0@lo:400:kworker.0 00000100:00100000:0.0:1789635534.916311:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427395456:0@lo:400:kworker.0 00000020:01000004:2.0:1789635534.916499:0:18625:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789635534.916513:0:18625:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8d057ae4b380) 00000020:00000080:2.0:1789635534.916531:0:18625:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1789635534.916930:0:18625:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d0447985000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789635534.916936:0:18625:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d0447985000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789635534.916938:0:18625:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d0447985000 3 00010000:00080000:3.0:1789635534.916977:0:18625:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d0447b19000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.120@tcp at head 00010000:00010000:3.0:1789635534.919093:0:18625:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1789635534.919328:0:18625:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1789635534.919394:0:18625:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789635534.919409:0:18625:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xb0c3a59caa4102a0 00000100:00080000:3.0:1789635534.919418:0:18625:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789635534.919430:0:18625:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8d0447b19000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789635534.919470:0:18625:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0448599c00 x1876568427395968/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789635534.919506:0:18625:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789635534.919838:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789635534.919843:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789635534.919846:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789635534.919849:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789635534.919852:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789635534.919855:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789635534.919857:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789635534.919860:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789635534.921643:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1876568427395968:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1789635534.921869:0:18625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000100:00100000:2.0:1789635534.922087:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635534.922146:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427395968 00000100:00100000:2.0:1789635534.922154:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427395968 00000100:00100000:2.0:1789635534.922187:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789635534.922194:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1876568427395968:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789635534.922232:0:17097:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:2.0:1789635534.922266:0:17097:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xb0c3a59caa4102a7 00000004:00100000:2.0:1789635534.922280:0:17097:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789635534.922312:0:17097:0:(import.c:65:import_set_state_nolock()) ffff8d0445aac800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789635534.922361:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876568427395968:12345-0@lo:38:llog_process_th.0 Request processed in 166us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635534.922369:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789635534.922408:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0448599c00 x1876568427395968/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789635544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635534.922418:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789635534.922426:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1789635534.922433:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789635534.922438:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789635534.922441:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d0447b19000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789635534.922446:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1876568427395968:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1789635534.922565:0:18598:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789635534.923329:0:18598:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789635534.923360:0:18598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e153400/0xb0c3a59caa410276 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa41027d expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635534.923372:0:18598:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e153400/0xb0c3a59caa410276 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa41027d expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789635534.923433:0:18598:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789635534.923436:0:18598:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789635534.923437:0:18598:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789635534.923438:0:18598:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789635534.923440:0:18598:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789635534.923441:0:18598:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789635534.923442:0:18598:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789635534.923444:0:18598:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789635534.923445:0:18598:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789635534.923449:0:18598:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1789635534.923452:0:18598:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789635534.923453:0:18598:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789635534.923454:0:18598:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789635534.923455:0:18598:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789635534.923456:0:18598:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789635534.923457:0:18598:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789635534.923458:0:18598:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789635534.923459:0:18598:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789635534.923461:0:18598:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789635534.923483:0:18598:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789635534.923500:0:18598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427396096:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789635534.923552:0:18598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635534.923629:0:18598:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d055060fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789635534.924834:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427396096 00000100:00100000:2.0:1789635534.924846:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427396096 00000100:00100000:2.0:1789635534.924910:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789635534.924921:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+21:18598:x1876568427396096:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789635534.924952:0:17089:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789635534.924966:0:17089:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789635534.929264:0:17089:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789635534.929280:0:17089:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789635534.929343:0:17112:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789635534.929349:0:17112:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789635534.929371:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d056e1a3e00/0xb0c3a59caa4102ae lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635534.929397:0:17112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d056e1a2400/0xb0c3a59caa4101f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa4101f1 expref: 21 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635534.929406:0:17112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d056e1a2200/0xb0c3a59caa410206 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa4101ff expref: 21 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635534.929415:0:17112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d056e1a3e00/0xb0c3a59caa4102ae lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635534.929454:0:17112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d056e1a2200/0xb0c3a59caa410206 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa4101ff expref: 21 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635534.929469:0:17112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d056e1a2200/0xb0c3a59caa410206 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa4101ff expref: 21 pid: 17089 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635534.929485:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d1c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17112:1876568427396224:0@lo:104: 00000100:00100000:2.0:1789635534.929552:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789635534.929629:0:17112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d056e1a2400/0xb0c3a59caa4101f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa4101f1 expref: 21 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635534.929638:0:17112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d056e1a2400/0xb0c3a59caa4101f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa4101f1 expref: 21 pid: 17091 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635534.929647:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17112:1876568427396352:0@lo:104: 00000100:00100000:2.0:1789635534.929677:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635534.929691:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05677b0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789635534.929716:0:17080:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789635534.929733:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427396224 00000100:00100000:2.0:1789635534.929739:0:17080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427396224 00000100:00100000:2.0:1789635534.929778:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427396352 00000100:00100000:2.0:1789635534.929782:0:17080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427396352 00000100:00100000:2.0:1789635534.929795:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789635534.929803:0:17080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+4:17112:x1876568427396224:12345-0@lo:104: 00010000:00010000:2.0:1789635534.929817:0:17080:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d056e152200/0xb0c3a59caa4101ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa410206 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635534.929868:0:17080:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789635534.929874:0:17080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+4:17112:x1876568427396224:12345-0@lo:104: Request processed in 72us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635534.929881:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789635534.929897:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789635534.929904:0:17080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575e6f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+3:17112:x1876568427396352:12345-0@lo:104: 00010000:00010000:2.0:1789635534.929911:0:17080:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d056e153000/0xb0c3a59caa4101f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa4101f8 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635534.929942:0:17080:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789635534.929947:0:17080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575e6f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+3:17112:x1876568427396352:12345-0@lo:104: Request processed in 44us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635534.929953:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1789635534.929994:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789635534.930001:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d056e152200/0xb0c3a59caa4101ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa410206 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635534.930008:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152200 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:2.0:1789635534.930012:0:17085:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d056e152200/0xb0c3a59caa4101ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa410206 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635534.930020:0:17085:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056e152200/0xb0c3a59caa4101ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa410206 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789635534.930035:0:17085:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056e152200/0xb0c3a59caa4101ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa410206 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635534.930041:0:17085:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789635534.930069:0:17085:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d056e152200/0xb0c3a59caa4101ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa410206 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635534.930075:0:17085:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789635534.930094:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d056e152200/0xb0c3a59caa4101ff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa410206 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635534.930100:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056e152200/0xb0c3a59caa4101ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa410206 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635534.930113:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635534.930116:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d056e153000/0xb0c3a59caa4101f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa4101f8 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635534.930122:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e153000 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:2.0:1789635534.930124:0:17085:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d056e153000/0xb0c3a59caa4101f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa4101f8 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635534.930131:0:17085:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056e153000/0xb0c3a59caa4101f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa4101f8 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789635534.930137:0:17085:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056e153000/0xb0c3a59caa4101f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa4101f8 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635534.930142:0:17085:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789635534.930160:0:17085:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d056e153000/0xb0c3a59caa4101f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa4101f8 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635534.930165:0:17085:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789635534.930178:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d056e153000/0xb0c3a59caa4101f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa4101f8 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635534.930184:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056e153000/0xb0c3a59caa4101f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa4101f8 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635534.930196:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635534.930198:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635534.930199:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635534.930205:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635534.930223:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3643:1876568427396480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789635534.930250:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635534.930280:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789635534.930287:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3641:1876568427396608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789635534.930310:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635534.930338:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427396480 00000100:00100000:2.0:1789635534.930343:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427396480 00010000:00010000:2.0:1789635534.930358:0:17083:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d056e1a2200/0xb0c3a59caa410206 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa4101ff expref: 22 pid: 17089 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635534.930378:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427396608 00000100:00100000:2.0:1789635534.930381:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427396608 00010000:00010000:2.0:1789635534.930391:0:17083:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d056e1a2400/0xb0c3a59caa4101f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa4101f1 expref: 23 pid: 17091 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635534.930402:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789635534.930408:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+23:3643:x1876568427396480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789635534.930424:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635534.930430:0:17083:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d056e1a2200/0xb0c3a59caa410206 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa4101ff expref: 23 pid: 17089 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635534.930440:0:17083:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d056e1a2200/0xb0c3a59caa410206 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa4101ff expref: 23 pid: 17089 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635534.930455:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635534.930483:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+23:3643:x1876568427396480:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635534.930490:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789635534.930504:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789635534.930511:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d054d4f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+22:3641:x1876568427396608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789635534.930518:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635534.930523:0:17083:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d056e1a2400/0xb0c3a59caa4101f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa4101f1 expref: 22 pid: 17091 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635534.930531:0:17083:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d056e1a2400/0xb0c3a59caa4101f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa4101f1 expref: 22 pid: 17091 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635534.930543:0:17083:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d056e1a3e00/0xb0c3a59caa4102ae lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635534.930551:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e1a3e00/0xb0c3a59caa4102ae lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789635534.930563:0:17083:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015693848s 00010000:00010000:2.0:1789635534.930567:0:17083:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d056e1a3e00/0xb0c3a59caa4102ae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635534.930617:0:17083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d056e1a3e00/0xb0c3a59caa4102ae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635534.930625:0:17083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d056e1a3e00/0xb0c3a59caa4102ae lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635534.930631:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d056e1a3e00/0xb0c3a59caa4102ae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635534.930637:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3e00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635534.930641:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d056e1a3e00/0xb0c3a59caa4102ae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635534.930649:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d056e1a3e00/0xb0c3a59caa4102ae lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635534.930657:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d056e1a3e00/0xb0c3a59caa4102ae lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635534.930666:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635534.930694:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d054d4f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+22:3641:x1876568427396608:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635534.930700:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789635534.930763:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3641:1876568427396608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789635534.930786:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3643:1876568427396480:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789635534.930806:0:17112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056e1a2200/0xb0c3a59caa410206 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa4101ff expref: 21 pid: 17089 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635534.930838:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d1c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17112:1876568427396224:0@lo:104: 00010000:00010000:2.0:1789635534.930850:0:17112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056e1a2400/0xb0c3a59caa4101f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa4101f1 expref: 20 pid: 17091 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635534.930859:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17112:1876568427396352:0@lo:104: 00010000:00010000:2.0:1789635534.930872:0:17112:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d056e1a3e00/0xb0c3a59caa4102ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635534.930880:0:17112:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d056e1a3e00/0xb0c3a59caa4102ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635534.930887:0:17112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d056e1a3e00/0xb0c3a59caa4102ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635534.930894:0:17112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056e1a3e00/0xb0c3a59caa4102ae lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635534.931153:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+19:18598:x1876568427396096:12345-0@lo:253:mount.lustre.0 Request processed in 6233us (7599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635534.931161:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789635534.931203:0:18598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:18598:1876568427396096:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789635534.931213:0:18598:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789635534.931216:0:18598:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789635534.931218:0:18598:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789635534.931219:0:18598:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789635534.931220:0:18598:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789635534.931222:0:18598:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789635534.931223:0:18598:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789635534.931224:0:18598:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789635534.931231:0:18598:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789635534.931233:0:18598:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789635534.931244:0:18598:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:3.0:1789635534.936355:0:18598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1789635534.938476:0:18598:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789635534.938483:0:18598:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789635534.938516:0:18598:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789635534.938556:0:18598:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.120@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789635534.938592:0:18598:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789635534.938661:0:18598:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1789635534.939409:0:18598:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789635534.939681:0:18598:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1789635535.656962:0:18677:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789635535.657400:0:18677:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789635535.907858:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635535.973505:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789635520/real 1789635520] req@ffff8d05759d0380 x1876568427383296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789635535 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635535.973546:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d05759d0380 x1876568427383296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789635535 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635535.973558:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789635520/real 1789635520] req@ffff8d05759d1180 x1876568427383424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789635535 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635535.973632:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d05759d1180 x1876568427383424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789635535 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789635535.973657:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d0546439800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789635535.973686:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789635535.973692:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427383296:0@lo:8:kworker.0 00000100:00080000:0.0:1789635535.973698:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d057604f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789635535.973703:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789635535.973706:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427383424:0@lo:8:kworker.0 00000100:00100000:2.0:1789635535.974129:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3641:1876568427396736:0@lo:400:kworker.0 00000100:00100000:2.0:1789635535.974232:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635535.974876:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427396736 00000100:00100000:1.0:1789635535.974890:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427396736 00000100:00080000:3.0:1789635535.975441:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789635535.975447:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789635535.975452:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d0546439800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789635535.975460:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 539 00000100:00080000:3.0:1789635535.975468:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789635535.975480:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d0546439800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789635535.975507:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0448599880 x1876568427396992/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789635535.975538:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789635535.975541:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789635535.975543:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d057604f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789635535.975547:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 539 00000100:00080000:3.0:1789635535.975550:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789635535.975556:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d057604f000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789635535.975583:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d044859b100 x1876568427397120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789635535.976092:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789635535.976109:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427397376:0@lo:400:kworker.0 00000100:00080000:3.0:1789635535.976258:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789635535.976264:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789635535.976267:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789635535.976288:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789635535.976343:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427396864:0@lo:400:kworker.0 00000100:00100000:3.0:1789635535.976411:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635535.976461:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1876568427397632:0@lo:400:kworker.0 00000100:00100000:3.0:1789635535.976494:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635535.976530:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789635535.976536:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876568427397248:0@lo:400:kworker.0 00000100:00100000:3.0:1789635535.976568:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635535.976589:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427397760:0@lo:400:kworker.0 00000100:00100000:3.0:1789635535.976650:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635535.976686:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427397632 00000100:00100000:3.0:1789635535.976696:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427397632 00000100:00100000:3.0:1789635535.976756:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427397248 00000100:00100000:3.0:1789635535.976760:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427397248 00000100:00100000:3.0:1789635535.976776:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427397760 00000100:00100000:3.0:1789635535.976778:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427397760 00000100:00100000:3.0:1789635535.976796:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789635535.976806:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876568427397632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635535.976866:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876568427397632:12345-0@lo:400:kworker.0 Request processed in 61us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635535.976874:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789635535.976894:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789635535.976900:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876568427397248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635535.976927:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876568427397248:12345-0@lo:400:kworker.0 Request processed in 27us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635535.976933:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789635535.976955:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789635535.976960:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427397760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635535.977012:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427397760:12345-0@lo:400:kworker.0 Request processed in 51us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635535.977020:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789635535.977043:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789635535.977055:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+19:3641:x1876568427396736:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789635535.977067:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789635535.977073:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635535.977095:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427396992:0@lo:8:kworker.0 00000100:00100000:1.0:1789635535.977106:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+19:3641:x1876568427396736:12345-0@lo:400:kworker.0 Request processed in 54us (2873us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635535.977113:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789635535.977136:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635535.977177:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427397120:0@lo:8:kworker.0 00000100:00100000:1.0:1789635535.977179:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427396992 00000100:00100000:1.0:1789635535.977185:0:18602:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427396992 00000100:00100000:3.0:1789635535.977205:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635535.977210:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789635535.977218:0:18602:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1876568427396992:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789635535.977257:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d044859b800 x1876568427397248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1789635535.977270:0:18602:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 554 last 0 00000100:00100000:3.0:1789635535.977275:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876568427397248:0@lo:400:kworker.0 00010000:00080000:3.0:1789635535.977291:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d044859ad80 x1876568427397760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635535.977300:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427397760:0@lo:400:kworker.0 00010000:00080000:3.0:1789635535.977309:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d044859b480 x1876568427397632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635535.977316:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1876568427397632:0@lo:400:kworker.0 00000100:00100000:3.0:1789635535.977357:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789635535.977366:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427397504:0@lo:400:kworker.0 00000100:00100000:3.0:1789635535.977389:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635535.977414:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427397504 00000100:00100000:3.0:1789635535.977424:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427397504 00000100:00100000:3.0:1789635535.977448:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789635535.977455:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427397504:12345-0@lo:400:kworker.0 00000020:00000080:1.0:1789635535.977458:0:18602:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb0c3a59caa4102b5 00002000:00100000:1.0:1789635535.977477:0:18602:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d0447796800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789635535.977483:0:18602:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1789635535.977488:0:18602:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1789635535.977494:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427397504:12345-0@lo:400:kworker.0 Request processed in 39us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635535.977501:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789635535.977527:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d044859bb80 x1876568427397504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635535.977536:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427397504:0@lo:400:kworker.0 00002000:00080000:1.0:1789635535.977744:0:18602:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789635535.977775:0:18602:0:(import.c:65:import_set_state_nolock()) ffff8d0447797800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789635535.977779:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427396864 00000100:00100000:0.0:1789635535.977787:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427396864 00000100:00100000:0.0:1789635535.977825:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789635535.977835:0:18602:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1876568427396992:12345-0@lo:8:kworker.0 Request processed in 615us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635535.977836:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427396864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635535.977849:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789635535.977868:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427397120 00000100:00100000:1.0:1789635535.977871:0:18602:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427397120 00000100:00100000:1.0:1789635535.977886:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789635535.977891:0:18602:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1876568427397120:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1789635535.977894:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427396864:12345-0@lo:400:kworker.0 Request processed in 61us (1482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635535.977904:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00020000:1.0:1789635535.977908:0:18602:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789635535.977991:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427396864:0@lo:400:kworker.0 00000100:00100000:2.0:1789635535.980818:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635535.980898:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3641:1876568427396736:0@lo:400:kworker.0 00010000:00080000:3.0:1789635535.981379:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0448599880 x1876568427396992/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789635555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635535.981392:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789635535.981405:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789635535.981418:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789635535.981426:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789635535.981430:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d0546439800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789635535.981447:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789635535.981455:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427396992:0@lo:8:kworker.0 00000004:00080000:3.0:1789635535.981483:0:17120:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789635535.981637:0:17120:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 554665039921ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789635535.981645:0:17120:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1789635535.981721:0:17121:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:3.0:1789635535.981746:0:17121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17121:1876568427398016:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789635535.981798:0:17121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635535.981832:0:17121:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0548894a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789635535.981848:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427397888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635535.981876:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635535.982168:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427397888 00000100:00100000:0.0:1789635535.982178:0:18606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427397888 00000100:00100000:0.0:1789635535.982249:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789635535.982259:0:18606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1876568427397888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789635535.982285:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923533824 avail 3692011520 00000100:00100000:0.0:1789635535.982341:0:18606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1876568427397888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635535.982348:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789635535.982377:0:18604:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789635535.982390:0:18604:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:0.0:1789635535.982514:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0448599880 x1876568427397888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635551 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635535.982534:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427397888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635535.982631:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427398016 00000100:00100000:0.0:1789635535.982636:0:18604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427398016 00000100:00100000:0.0:1789635535.982734:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789635535.982742:0:18696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17121:x1876568427398016:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:3.0:1789635535.983025:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789635535.983062:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427397376 00000100:00100000:3.0:1789635535.983068:0:18189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427397376 00000100:00100000:3.0:1789635535.983105:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789635535.983113:0:18189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427397376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635535.983166:0:18189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427397376:12345-0@lo:400:kworker.0 Request processed in 54us (2357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635535.983173:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789635535.983205:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427397376:0@lo:400:kworker.0 00000004:00080000:0.0:1789635535.990782:0:17076:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:2.0:1789635535.991014:0:18696:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1789635535.991033:0:18696:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1789635535.991042:0:18696:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00002000:00010000:2.0:1789635535.992361:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789635535.992373:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da721a8f/0xb0c3a59caa4102bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635535.992393:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=554s v=(0 0) 00010000:00010000:2.0:1789635535.992399:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635535.992406:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da721a8f/0xb0c3a59caa4102bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635535.992429:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da721a8f/0xb0c3a59caa4102bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635535.992439:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da721a8f/0xb0c3a59caa4102bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635535.992461:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da721a8f/0xb0c3a59caa4102bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635535.992479:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789635535.992495:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635535.992501:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da721a8f/0xb0c3a59caa4102bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635535.992509:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a2400 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635535.992514:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da721a8f/0xb0c3a59caa4102bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635535.992524:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da721a8f/0xb0c3a59caa4102bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635535.992545:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da721a8f/0xb0c3a59caa4102bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635535.992553:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da721a8f/0xb0c3a59caa4102bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635535.992611:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635535.992613:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635535.992615:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789635535.999026:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789635535.999047:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbb79571/0xb0c3a59caa4102c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635535.999072:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=554s v=(0 0) 00010000:00010000:3.0:1789635535.999077:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635535.999086:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbb79571/0xb0c3a59caa4102c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635536.000186:0:18602:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1876568427397120:12345-0@lo:8:kworker.0 Request processed in 22282us (22970us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789635536.000201:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789635536.000654:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fbb79571/0xb0c3a59caa4102c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.000670:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbb79571/0xb0c3a59caa4102c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.000691:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fbb79571/0xb0c3a59caa4102c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.000740:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789635536.000895:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635536.000910:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fbb79571/0xb0c3a59caa4102c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.000920:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488ff800 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635536.000925:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbb79571/0xb0c3a59caa4102c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.000936:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbb79571/0xb0c3a59caa4102c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.000958:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fbb79571/0xb0c3a59caa4102c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.000967:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbb79571/0xb0c3a59caa4102c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.000994:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635536.000996:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635536.000998:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789635536.001509:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d057604f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789635536.001518:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789635536.001524:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427397120:0@lo:8:kworker.0 00002000:00010000:3.0:1789635536.003089:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789635536.003106:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089720be8/0xb0c3a59caa4102ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.003125:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=554s v=(0 0) 00010000:00010000:3.0:1789635536.003130:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635536.003137:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089720be8/0xb0c3a59caa4102ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.003153:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089720be8/0xb0c3a59caa4102ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.003164:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089720be8/0xb0c3a59caa4102ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.003172:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089720be8/0xb0c3a59caa4102ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.003202:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789635536.003615:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635536.003624:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089720be8/0xb0c3a59caa4102ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.003634:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488ff200 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635536.003638:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089720be8/0xb0c3a59caa4102ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.003662:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089720be8/0xb0c3a59caa4102ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.003683:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089720be8/0xb0c3a59caa4102ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.003691:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089720be8/0xb0c3a59caa4102ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.003713:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635536.003715:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635536.003716:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789635536.003946:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789635536.003952:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec6d8b51/0xb0c3a59caa4102d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.003969:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=554s v=(0 0) 00010000:00010000:3.0:1789635536.004680:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635536.004687:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec6d8b51/0xb0c3a59caa4102d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.004702:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec6d8b51/0xb0c3a59caa4102d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.004713:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec6d8b51/0xb0c3a59caa4102d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.004721:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec6d8b51/0xb0c3a59caa4102d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.004741:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789635536.004892:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635536.004899:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec6d8b51/0xb0c3a59caa4102d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.004909:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488ff000 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635536.004914:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec6d8b51/0xb0c3a59caa4102d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.004922:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec6d8b51/0xb0c3a59caa4102d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.004938:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec6d8b51/0xb0c3a59caa4102d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.004959:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec6d8b51/0xb0c3a59caa4102d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.004980:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635536.004982:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635536.004983:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789635536.006023:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789635536.006036:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1a72c81/0xb0c3a59caa4102d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.006050:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=554s v=(0 0) 00010000:00010000:3.0:1789635536.006055:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635536.006061:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1a72c81/0xb0c3a59caa4102d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.006073:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1a72c81/0xb0c3a59caa4102d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.006098:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1a72c81/0xb0c3a59caa4102d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.006107:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1a72c81/0xb0c3a59caa4102d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.006131:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789635536.006916:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635536.006927:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1a72c81/0xb0c3a59caa4102d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.006939:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488fe400 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635536.006945:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1a72c81/0xb0c3a59caa4102d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.006956:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1a72c81/0xb0c3a59caa4102d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.006974:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1a72c81/0xb0c3a59caa4102d8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.006982:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1a72c81/0xb0c3a59caa4102d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.007005:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635536.007007:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635536.007009:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789635536.008387:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789635536.008404:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d084c98/0xb0c3a59caa4102df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.008421:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=554s v=(0 0) 00010000:00010000:3.0:1789635536.008426:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635536.008433:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d084c98/0xb0c3a59caa4102df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.008446:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d084c98/0xb0c3a59caa4102df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.008458:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d084c98/0xb0c3a59caa4102df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.008466:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d084c98/0xb0c3a59caa4102df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.008680:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789635536.011230:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789635536.011248:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a29d02e8/0xb0c3a59caa4102e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.011270:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=554s v=(0 0) 00010000:00010000:3.0:1789635536.011275:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635536.011283:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a29d02e8/0xb0c3a59caa4102e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.011298:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a29d02e8/0xb0c3a59caa4102e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.011310:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a29d02e8/0xb0c3a59caa4102e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.011318:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a29d02e8/0xb0c3a59caa4102e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.012948:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789635536.012968:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d084c98/0xb0c3a59caa4102df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.012984:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488ffa00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635536.012990:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d084c98/0xb0c3a59caa4102df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.013002:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d084c98/0xb0c3a59caa4102df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.013028:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d084c98/0xb0c3a59caa4102df lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.013036:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d084c98/0xb0c3a59caa4102df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.013057:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635536.013061:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a29d02e8/0xb0c3a59caa4102e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.013068:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488fea00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635536.013071:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a29d02e8/0xb0c3a59caa4102e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.013079:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a29d02e8/0xb0c3a59caa4102e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.013107:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a29d02e8/0xb0c3a59caa4102e6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.013116:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635536.013118:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635536.013120:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635536.013532:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789635536.013541:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a29d02e8/0xb0c3a59caa4102e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789635536.015192:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789635536.015207:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8a542fc/0xb0c3a59caa4102ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.015236:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=554s v=(0 0) 00010000:00010000:3.0:1789635536.015242:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635536.015250:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8a542fc/0xb0c3a59caa4102ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.015266:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8a542fc/0xb0c3a59caa4102ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.015278:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8a542fc/0xb0c3a59caa4102ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.015287:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8a542fc/0xb0c3a59caa4102ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.017895:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635536.017914:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8a542fc/0xb0c3a59caa4102ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.017933:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488ffe00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635536.017939:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8a542fc/0xb0c3a59caa4102ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.017952:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8a542fc/0xb0c3a59caa4102ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.017980:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8a542fc/0xb0c3a59caa4102ed lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.017994:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635536.017996:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635536.017998:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635536.018206:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789635536.018216:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8a542fc/0xb0c3a59caa4102ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.018284:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789635536.023015:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789635536.023033:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3d50b99/0xb0c3a59caa4102f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635536.023058:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=554s v=(0 0) 00010000:00010000:1.0:1789635536.023064:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635536.023071:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3d50b99/0xb0c3a59caa4102f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635536.023109:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3d50b99/0xb0c3a59caa4102f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635536.023122:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3d50b99/0xb0c3a59caa4102f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635536.023140:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3d50b99/0xb0c3a59caa4102f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635536.023284:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789635536.026857:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635536.026875:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3d50b99/0xb0c3a59caa4102f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.026891:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152000 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:3.0:1789635536.026897:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3d50b99/0xb0c3a59caa4102f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.026927:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3d50b99/0xb0c3a59caa4102f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.026955:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3d50b99/0xb0c3a59caa4102f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.026963:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3d50b99/0xb0c3a59caa4102f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.026989:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635536.026991:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635536.026993:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789635536.029100:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789635536.029120:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7215836/0xb0c3a59caa4102fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.029141:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1789635536.029146:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635536.029154:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7215836/0xb0c3a59caa4102fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.029172:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7215836/0xb0c3a59caa4102fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.029184:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7215836/0xb0c3a59caa4102fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.029193:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7215836/0xb0c3a59caa4102fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.029236:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789635536.029994:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635536.030005:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7215836/0xb0c3a59caa4102fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.030027:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1a800 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635536.030032:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7215836/0xb0c3a59caa4102fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.030044:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7215836/0xb0c3a59caa4102fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.030068:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7215836/0xb0c3a59caa4102fb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.030077:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7215836/0xb0c3a59caa4102fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.030102:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635536.030105:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635536.030107:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789635536.031052:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789635536.031064:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009776b18e/0xb0c3a59caa410302 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.031079:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1789635536.031084:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635536.031090:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009776b18e/0xb0c3a59caa410302 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.031102:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009776b18e/0xb0c3a59caa410302 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.031112:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009776b18e/0xb0c3a59caa410302 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.031119:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009776b18e/0xb0c3a59caa410302 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.031184:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789635536.031882:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635536.031893:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009776b18e/0xb0c3a59caa410302 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.031905:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1b800 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:3.0:1789635536.031910:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009776b18e/0xb0c3a59caa410302 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.031921:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009776b18e/0xb0c3a59caa410302 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.031941:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009776b18e/0xb0c3a59caa410302 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.031965:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009776b18e/0xb0c3a59caa410302 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.032071:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635536.032074:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635536.032075:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789635536.032291:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789635536.032299:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7e1938c/0xb0c3a59caa410309 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.032320:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1789635536.032324:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635536.032395:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7e1938c/0xb0c3a59caa410309 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.032410:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7e1938c/0xb0c3a59caa410309 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.032427:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7e1938c/0xb0c3a59caa410309 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.032435:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7e1938c/0xb0c3a59caa410309 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.032453:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789635536.032893:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635536.032901:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7e1938c/0xb0c3a59caa410309 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.032911:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1be00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635536.032914:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7e1938c/0xb0c3a59caa410309 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.032924:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7e1938c/0xb0c3a59caa410309 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.032946:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7e1938c/0xb0c3a59caa410309 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.032953:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7e1938c/0xb0c3a59caa410309 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.032977:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635536.032979:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635536.032981:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789635536.033366:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789635536.033375:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000360dcadc/0xb0c3a59caa410310 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.033386:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1789635536.033390:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635536.033394:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000360dcadc/0xb0c3a59caa410310 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.033405:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000360dcadc/0xb0c3a59caa410310 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.033425:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000360dcadc/0xb0c3a59caa410310 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.033432:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000360dcadc/0xb0c3a59caa410310 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.033454:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789635536.033741:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635536.033747:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000360dcadc/0xb0c3a59caa410310 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.033755:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1ae00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635536.033759:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000360dcadc/0xb0c3a59caa410310 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.033768:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000360dcadc/0xb0c3a59caa410310 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.033781:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000360dcadc/0xb0c3a59caa410310 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789635536.035073:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789635536.035088:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8876d51/0xb0c3a59caa410317 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.035104:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1789635536.035108:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635536.035113:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8876d51/0xb0c3a59caa410317 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.035125:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8876d51/0xb0c3a59caa410317 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.035135:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8876d51/0xb0c3a59caa410317 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.035144:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8876d51/0xb0c3a59caa410317 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.035229:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789635536.035528:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000360dcadc/0xb0c3a59caa410310 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.035579:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635536.035584:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8876d51/0xb0c3a59caa410317 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.035608:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1a000 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635536.035612:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8876d51/0xb0c3a59caa410317 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.035620:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8876d51/0xb0c3a59caa410317 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.035641:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8876d51/0xb0c3a59caa410317 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.035653:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8876d51/0xb0c3a59caa410317 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.035667:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635536.035668:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789635536.038146:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789635536.038161:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b97f25b/0xb0c3a59caa41031e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.038180:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1789635536.038185:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635536.038192:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b97f25b/0xb0c3a59caa41031e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.038207:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b97f25b/0xb0c3a59caa41031e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.038218:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b97f25b/0xb0c3a59caa41031e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.038225:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b97f25b/0xb0c3a59caa41031e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.038329:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635536.038337:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b97f25b/0xb0c3a59caa41031e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.038347:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0446d1b400 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:3.0:1789635536.038352:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b97f25b/0xb0c3a59caa41031e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.038361:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b97f25b/0xb0c3a59caa41031e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.038380:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b97f25b/0xb0c3a59caa41031e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.038392:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635536.038394:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635536.038396:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635536.040676:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635536.043030:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789635536.043049:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b97f25b/0xb0c3a59caa41031e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789635536.044045:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789635536.044056:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ac69fe5/0xb0c3a59caa410325 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.044081:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1789635536.044086:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635536.044094:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ac69fe5/0xb0c3a59caa410325 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.044112:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ac69fe5/0xb0c3a59caa410325 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.044123:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ac69fe5/0xb0c3a59caa410325 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.044132:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ac69fe5/0xb0c3a59caa410325 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.044154:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789635536.044402:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635536.044412:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ac69fe5/0xb0c3a59caa410325 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.044421:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0549f42a00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:3.0:1789635536.044434:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ac69fe5/0xb0c3a59caa410325 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.044444:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ac69fe5/0xb0c3a59caa410325 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.044466:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ac69fe5/0xb0c3a59caa410325 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.044473:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ac69fe5/0xb0c3a59caa410325 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.044496:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635536.044498:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635536.044500:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635536.044838:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789635536.046118:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789635536.046134:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005724791c/0xb0c3a59caa41032c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.046151:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1789635536.046157:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635536.046163:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005724791c/0xb0c3a59caa41032c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.046177:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005724791c/0xb0c3a59caa41032c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.046201:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005724791c/0xb0c3a59caa41032c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.046208:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005724791c/0xb0c3a59caa41032c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.046235:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789635536.048160:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635536.048179:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005724791c/0xb0c3a59caa41032c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.048195:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0549f43c00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:3.0:1789635536.048201:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005724791c/0xb0c3a59caa41032c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.048214:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005724791c/0xb0c3a59caa41032c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.048242:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005724791c/0xb0c3a59caa41032c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.048260:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005724791c/0xb0c3a59caa41032c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.048293:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635536.048295:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635536.048297:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789635536.049053:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789635536.049067:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058f2438b/0xb0c3a59caa410333 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.049082:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1789635536.049088:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635536.049095:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058f2438b/0xb0c3a59caa410333 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.049111:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058f2438b/0xb0c3a59caa410333 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.049120:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058f2438b/0xb0c3a59caa410333 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.049127:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058f2438b/0xb0c3a59caa410333 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.049158:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789635536.050725:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635536.050742:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058f2438b/0xb0c3a59caa410333 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.050758:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0549f42200 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635536.050779:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058f2438b/0xb0c3a59caa410333 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.050806:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058f2438b/0xb0c3a59caa410333 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.050832:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058f2438b/0xb0c3a59caa410333 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.050840:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058f2438b/0xb0c3a59caa410333 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.050874:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635536.050876:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635536.050878:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789635536.051325:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789635536.051336:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf1150c9/0xb0c3a59caa41033a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.051349:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1789635536.051354:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635536.051361:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf1150c9/0xb0c3a59caa41033a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.051374:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf1150c9/0xb0c3a59caa41033a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.051382:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf1150c9/0xb0c3a59caa41033a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.051390:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf1150c9/0xb0c3a59caa41033a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.051447:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789635536.052285:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789635536.052295:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b841da0d/0xb0c3a59caa410341 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.052309:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1789635536.052320:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635536.052326:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b841da0d/0xb0c3a59caa410341 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.052337:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b841da0d/0xb0c3a59caa410341 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.052345:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b841da0d/0xb0c3a59caa410341 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.052353:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b841da0d/0xb0c3a59caa410341 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.052413:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789635536.052423:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf1150c9/0xb0c3a59caa41033a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.052432:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0549f42400 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:3.0:1789635536.052436:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf1150c9/0xb0c3a59caa41033a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.052445:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf1150c9/0xb0c3a59caa41033a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.052462:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf1150c9/0xb0c3a59caa41033a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.052469:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf1150c9/0xb0c3a59caa41033a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.052491:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635536.052495:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b841da0d/0xb0c3a59caa410341 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.052521:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0549f42000 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:3.0:1789635536.052525:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b841da0d/0xb0c3a59caa410341 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.052534:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b841da0d/0xb0c3a59caa410341 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.052544:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b841da0d/0xb0c3a59caa410341 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.052553:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635536.052555:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635536.052557:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635536.052956:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789635536.052963:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b841da0d/0xb0c3a59caa410341 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789635536.053430:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789635536.053438:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053b7c2d0/0xb0c3a59caa410348 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.053449:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1789635536.053453:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635536.053458:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053b7c2d0/0xb0c3a59caa410348 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.053468:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053b7c2d0/0xb0c3a59caa410348 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.053484:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053b7c2d0/0xb0c3a59caa410348 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.053492:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053b7c2d0/0xb0c3a59caa410348 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.053822:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635536.053831:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053b7c2d0/0xb0c3a59caa410348 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.053840:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0549f42e00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635536.053844:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053b7c2d0/0xb0c3a59caa410348 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.053852:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053b7c2d0/0xb0c3a59caa410348 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.053868:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053b7c2d0/0xb0c3a59caa410348 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.053888:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635536.053891:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635536.053893:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635536.054025:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789635536.054031:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053b7c2d0/0xb0c3a59caa410348 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789635536.054436:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789635536.054444:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000805cce2/0xb0c3a59caa41034f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.054453:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1789635536.054456:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635536.054461:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000805cce2/0xb0c3a59caa41034f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.054473:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000805cce2/0xb0c3a59caa41034f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.054483:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000805cce2/0xb0c3a59caa41034f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.054502:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000805cce2/0xb0c3a59caa41034f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.054628:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635536.054636:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000805cce2/0xb0c3a59caa41034f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.054650:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0549f43200 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:3.0:1789635536.054653:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000805cce2/0xb0c3a59caa41034f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.054662:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000805cce2/0xb0c3a59caa41034f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.054675:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000805cce2/0xb0c3a59caa41034f lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.054692:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635536.054693:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635536.054695:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635536.054972:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789635536.054978:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000805cce2/0xb0c3a59caa41034f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.055307:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789635536.055392:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789635536.055399:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073d840cd/0xb0c3a59caa410356 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.055408:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1789635536.055412:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635536.055417:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073d840cd/0xb0c3a59caa410356 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.055425:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073d840cd/0xb0c3a59caa410356 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.055433:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073d840cd/0xb0c3a59caa410356 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.055439:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073d840cd/0xb0c3a59caa410356 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.055497:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789635536.055995:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789635536.056002:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000912fc1e7/0xb0c3a59caa41035d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.056012:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1789635536.056015:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635536.056019:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000912fc1e7/0xb0c3a59caa41035d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.056028:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000912fc1e7/0xb0c3a59caa41035d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.056036:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000912fc1e7/0xb0c3a59caa41035d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.056044:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000912fc1e7/0xb0c3a59caa41035d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.058461:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789635536.058480:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073d840cd/0xb0c3a59caa410356 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.058499:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0549f42600 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:3.0:1789635536.058505:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073d840cd/0xb0c3a59caa410356 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.058586:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073d840cd/0xb0c3a59caa410356 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.058743:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073d840cd/0xb0c3a59caa410356 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.058752:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073d840cd/0xb0c3a59caa410356 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.058779:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635536.058854:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000912fc1e7/0xb0c3a59caa41035d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.058864:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0549f42800 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:3.0:1789635536.058875:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000912fc1e7/0xb0c3a59caa41035d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.058883:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000912fc1e7/0xb0c3a59caa41035d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.058893:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000912fc1e7/0xb0c3a59caa41035d lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.058901:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635536.058902:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635536.058904:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635536.060093:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789635536.060109:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000912fc1e7/0xb0c3a59caa41035d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789635536.061072:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789635536.061083:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c2301e5/0xb0c3a59caa410364 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.061109:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1789635536.061115:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635536.061123:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c2301e5/0xb0c3a59caa410364 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.061139:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c2301e5/0xb0c3a59caa410364 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.061151:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c2301e5/0xb0c3a59caa410364 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.061160:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c2301e5/0xb0c3a59caa410364 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.061302:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635536.061311:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c2301e5/0xb0c3a59caa410364 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.061320:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0549f43a00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635536.061324:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c2301e5/0xb0c3a59caa410364 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.061334:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c2301e5/0xb0c3a59caa410364 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.061354:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c2301e5/0xb0c3a59caa410364 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.061367:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635536.061370:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635536.061372:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635536.061430:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789635536.061435:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c2301e5/0xb0c3a59caa410364 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.063355:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789635536.063873:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789635536.063887:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053b7c2d0/0xb0c3a59caa41036b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.063907:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1789635536.063913:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635536.063921:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053b7c2d0/0xb0c3a59caa41036b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.063953:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053b7c2d0/0xb0c3a59caa41036b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.063965:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053b7c2d0/0xb0c3a59caa41036b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.063973:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053b7c2d0/0xb0c3a59caa41036b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.064009:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789635536.066056:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789635536.066075:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b841da0d/0xb0c3a59caa410372 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.066095:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1789635536.066100:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635536.066106:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b841da0d/0xb0c3a59caa410372 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.066121:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b841da0d/0xb0c3a59caa410372 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.066133:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b841da0d/0xb0c3a59caa410372 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.066157:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b841da0d/0xb0c3a59caa410372 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.066183:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789635536.066394:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789635536.066404:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053b7c2d0/0xb0c3a59caa41036b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635536.066413:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0549f42e00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:1.0:1789635536.066418:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053b7c2d0/0xb0c3a59caa41036b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635536.066428:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053b7c2d0/0xb0c3a59caa41036b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635536.066451:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053b7c2d0/0xb0c3a59caa41036b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635536.066458:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053b7c2d0/0xb0c3a59caa41036b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635536.066484:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635536.066488:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b841da0d/0xb0c3a59caa410372 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635536.066506:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0549f42000 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:1.0:1789635536.066509:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b841da0d/0xb0c3a59caa410372 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635536.066517:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b841da0d/0xb0c3a59caa410372 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635536.066527:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b841da0d/0xb0c3a59caa410372 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635536.066534:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b841da0d/0xb0c3a59caa410372 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635536.066547:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635536.066549:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635536.066550:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635536.066746:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789635536.073044:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789635536.073066:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070c933e6/0xb0c3a59caa410379 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635536.073090:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=554s v=(0 0) 00010000:00010000:1.0:1789635536.073096:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635536.073104:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070c933e6/0xb0c3a59caa410379 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635536.073121:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070c933e6/0xb0c3a59caa410379 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635536.073145:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070c933e6/0xb0c3a59caa410379 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635536.073153:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070c933e6/0xb0c3a59caa410379 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635536.073183:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1789635536.073268:0:18696:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:1.0:1789635536.073402:0:18696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17121:x1876568427398016:12345-0@lo:5:osp-pre-0-0.0 Request processed in 90655us (91597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635536.073414:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789635536.073752:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635536.073762:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070c933e6/0xb0c3a59caa410379 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.073772:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e153a00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:0.0:1789635536.073777:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070c933e6/0xb0c3a59caa410379 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.073798:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070c933e6/0xb0c3a59caa410379 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.073821:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070c933e6/0xb0c3a59caa410379 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.073829:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070c933e6/0xb0c3a59caa410379 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.073853:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635536.073855:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635536.073856:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635536.074983:0:17121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17121:1876568427398016:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789635536.075009:0:17121:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:3.0:1789635536.075085:0:17121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17121:1876568427398144:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789635536.075158:0:17121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635536.075200:0:17121:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0565a28600 going to sleep for 11 seconds 00000100:00100000:0.0:1789635536.075418:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427398144 00000100:00100000:0.0:1789635536.075436:0:18604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427398144 00000100:00100000:0.0:1789635536.075502:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789635536.075513:0:18604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17121:x1876568427398144:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1789635536.075577:0:18604:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:0.0:1789635536.092756:0:18599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1789635536.092995:0:18599:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789635536.093233:0:18604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17121:x1876568427398144:12345-0@lo:5:osp-pre-0-0.0 Request processed in 17716us (18068us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789635536.093252:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789635536.093348:0:17121:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789635536.093358:0:17121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17121:1876568427398144:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789635536.093377:0:17121:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 10000000:01000000:3.0:1789635536.613736:0:17094:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789635536.613745:0:17094:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d0550104800 from 9 10000000:01000000:3.0:1789635536.613751:0:17094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789635536.613810:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05488ffe00/0xb0c3a59caa410380 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.613825:0:17094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d05488ffe00/0xb0c3a59caa410380 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.613850:0:17094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d05488ffe00/0xb0c3a59caa410380 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635536.613881:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427398272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789635536.613965:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635536.614026:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0548894300 going to sleep for 11 seconds 00000100:00100000:0.0:1789635536.614151:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427398272 00000100:00100000:0.0:1789635536.614161:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427398272 00000100:00100000:0.0:1789635536.614219:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789635536.614230:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+19:17094:x1876568427398272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789635536.614246:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635536.614261:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0549f43a00/0xb0c3a59caa410387 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa410380 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.614289:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0549f43a00/0xb0c3a59caa410387 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa410380 expref: 20 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.614301:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0549f43a00/0xb0c3a59caa410387 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa410380 expref: 20 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.614311:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0549f43a00, rc 0) 00000100:00100000:0.0:1789635536.614354:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+20:17094:x1876568427398272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635536.614361:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789635536.616295:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427398272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789635536.616324:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d05488ffe00/0xb0c3a59caa410380 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410387 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.616338:0:17094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d05488ffe00/0xb0c3a59caa410380 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa410387 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635536.616423:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427398400:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789635536.616492:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635536.616636:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0548894300 going to sleep for 11 seconds 00000100:00100000:2.0:1789635536.617070:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427398400 00000100:00100000:2.0:1789635536.617080:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427398400 00000100:00100000:2.0:1789635536.617148:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789635536.617159:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+20:17094:x1876568427398400:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789635536.617186:0:17091:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789635536.617206:0:17091:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789635536.617209:0:17091:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1789635536.617311:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+20:17094:x1876568427398400:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 154us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635536.617318:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789635536.617839:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427398400:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789635536.617921:0:17094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789635536.617932:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05488ffe00/0xb0c3a59caa410380 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410387 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.617943:0:17094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d05488ffe00/0xb0c3a59caa410380 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410387 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635536.617956:0:17094:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789635536.617958:0:17094:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d054b800800 from 9 10000000:01000000:3.0:1789635536.617966:0:17094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789635536.617999:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05488fea00/0xb0c3a59caa41038e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.618007:0:17094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d05488fea00/0xb0c3a59caa41038e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635536.618018:0:17094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d05488fea00/0xb0c3a59caa41038e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635536.618035:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044859b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427398528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789635536.618070:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635536.619676:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0548894300 going to sleep for 11 seconds 00000100:00100000:0.0:1789635536.623104:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427398528 00000100:00100000:0.0:1789635536.623127:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427398528 00000100:00100000:0.0:1789635536.623248:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789635536.623262:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+20:17094:x1876568427398528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789635536.623286:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635536.623310:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0549f42800/0xb0c3a59caa410395 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa41038e expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.623346:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0549f42800/0xb0c3a59caa410395 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa41038e expref: 21 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.623360:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0549f42800/0xb0c3a59caa410395 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa41038e expref: 21 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.623370:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0549f42800, rc 0) 00000100:00100000:0.0:1789635536.623468:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+21:17094:x1876568427398528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 210us (5396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635536.623475:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789635536.627141:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044859b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427398528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635536.627174:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d05488fea00/0xb0c3a59caa41038e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410395 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.627190:0:17094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d05488fea00/0xb0c3a59caa41038e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa410395 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635536.627277:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427398656:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789635536.627352:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635536.627533:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b5ebc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789635536.627808:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427398656 00000100:00100000:3.0:1789635536.627817:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427398656 00000100:00100000:2.0:1789635536.627942:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789635536.627952:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+21:17094:x1876568427398656:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789635536.627977:0:17091:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789635536.627999:0:17091:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789635536.628003:0:17091:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1789635536.628212:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+21:17094:x1876568427398656:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 261us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635536.628221:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789635536.633302:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427398656:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789635536.634995:0:17094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789635536.635012:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05488fea00/0xb0c3a59caa41038e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410395 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635536.635027:0:17094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d05488fea00/0xb0c3a59caa41038e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410395 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635536.935691:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635537.829897:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789635537.829926:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427398784:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789635537.830019:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635537.830746:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789635537.830761:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427398912:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789635537.830807:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635537.830936:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427398784 00000100:00100000:0.0:1789635537.830947:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427398784 00000100:00100000:2.0:1789635537.831120:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427398912 00000100:00100000:2.0:1789635537.831124:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427398912 00000100:00100000:2.0:1789635537.831151:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789635537.831162:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427398784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789635537.831203:0:17102:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789635537.831271:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427398784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (1251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635537.831278:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789635537.831297:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789635537.831303:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427398912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789635537.831320:0:17102:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789635537.831354:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427398912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 51us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635537.831360:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789635537.831937:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427398912:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789635537.831989:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427398784:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789635537.957587:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635538.982764:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635540.003949:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789635540.705176:0:18967:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789635541.028868:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635541.412026:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427399040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789635541.412119:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789635541.413265:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789635541.413270:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789635541.413274:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d057604f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789635541.413280:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 554 00000100:00080000:2.0:1789635541.413285:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789635541.413295:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d057604f000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1789635541.413316:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d05759d3100 x1876568427399424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789635541.413370:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789635541.413373:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789635541.413376:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789635541.413378:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789635541.413409:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427399296:0@lo:400:kworker.0 00000100:00100000:2.0:1789635541.413454:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635541.413487:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e017b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1876568427399936:0@lo:400:kworker.0 00000100:00100000:2.0:1789635541.413513:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635541.413548:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789635541.413554:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3641:1876568427399168:0@lo:400:kworker.0 00000100:00100000:2.0:1789635541.413583:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635541.413643:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876568427399808:0@lo:400:kworker.0 00000100:00100000:2.0:1789635541.413665:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635541.413693:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427399296 00000100:00100000:2.0:1789635541.413701:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427399296 00000100:00100000:2.0:1789635541.413742:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789635541.413751:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e014700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427399296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635541.413799:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e014700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427399296:12345-0@lo:400:kworker.0 Request processed in 50us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635541.413806:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789635541.413828:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427399936 00000100:00100000:2.0:1789635541.413831:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427399936 00000100:00100000:2.0:1789635541.413868:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427399808 00000100:00100000:2.0:1789635541.413872:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427399808 00000100:00100000:2.0:1789635541.413903:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789635541.413909:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876568427399936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635541.413940:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876568427399936:12345-0@lo:400:kworker.0 Request processed in 32us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635541.413946:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789635541.413958:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789635541.413964:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876568427399808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635541.414276:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876568427399808:12345-0@lo:400:kworker.0 Request processed in 311us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635541.414283:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789635541.414301:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427399168 00000100:00100000:2.0:1789635541.414305:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427399168 00000100:00100000:2.0:1789635541.414340:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789635541.414348:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+21:3641:x1876568427399168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635541.414379:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+21:3641:x1876568427399168:12345-0@lo:400:kworker.0 Request processed in 33us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635541.414385:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1789635541.414417:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635541.414436:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876568427399552:0@lo:400:kworker.0 00000100:00100000:2.0:1789635541.414459:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635541.414478:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e015500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427400064:0@lo:400:kworker.0 00000100:00100000:2.0:1789635541.414495:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635541.414509:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789635541.414515:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427399680:0@lo:400:kworker.0 00000100:00100000:2.0:1789635541.414549:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635541.414573:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427399680 00000100:00100000:2.0:1789635541.414584:0:18189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427399680 00000100:00100000:3.0:1789635541.414887:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3641:1876568427399168:0@lo:400:kworker.0 00010000:00080000:3.0:1789635541.414901:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d05759d0380 x1876568427399808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635541.414912:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876568427399808:0@lo:400:kworker.0 00000100:00100000:3.0:1789635541.414923:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427399296:0@lo:400:kworker.0 00010000:00080000:3.0:1789635541.414932:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d056e017b80 x1876568427399936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635541.414939:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e017b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1876568427399936:0@lo:400:kworker.0 00000100:00100000:3.0:1789635541.415153:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427399552 00000100:00100000:3.0:1789635541.415158:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427399552 00000100:00100000:3.0:1789635541.415182:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427400064 00000100:00100000:3.0:1789635541.415184:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427400064 00000100:00100000:3.0:1789635541.415205:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789635541.415211:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876568427399552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635541.415251:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876568427399552:12345-0@lo:400:kworker.0 Request processed in 40us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635541.415257:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789635541.415268:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789635541.415273:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427400064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635541.415299:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427400064:12345-0@lo:400:kworker.0 Request processed in 26us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635541.415304:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1789635541.415330:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789635541.415357:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d05759d1c00 x1876568427399552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635541.415366:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876568427399552:0@lo:400:kworker.0 00010000:00080000:3.0:1789635541.415375:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d056e015500 x1876568427400064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635541.415382:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e015500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427400064:0@lo:400:kworker.0 00000100:00100000:3.0:1789635541.415413:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427399040 00000100:00100000:3.0:1789635541.415417:0:18606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427399040 00000100:00100000:3.0:1789635541.415451:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789635541.415457:0:18606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543295500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427399040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789635541.415486:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789635541.415536:0:18606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543295500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427399040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (3417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635541.415542:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789635541.415555:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789635541.415575:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427399040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789635541.417316:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789635541.417335:0:18189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427399680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635541.417416:0:18189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427399680:12345-0@lo:400:kworker.0 Request processed in 89us (2864us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635541.417422:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789635541.417459:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427399680:0@lo:400:kworker.0 00000100:00100000:3.0:1789635541.417563:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427399424:0@lo:8:kworker.0 00000100:00100000:3.0:1789635541.417621:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635541.418339:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427399424 00000100:00100000:1.0:1789635541.418350:0:18602:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427399424 00000100:00100000:1.0:1789635541.418391:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789635541.418396:0:18602:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1876568427399424:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789635541.418422:0:18602:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789635541.455457:0:18602:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1876568427399424:12345-0@lo:8:kworker.0 Request processed in 37051us (37827us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789635541.455472:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789635541.455581:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d057604f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789635541.455587:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789635541.455591:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427399424:0@lo:8:kworker.0 00000020:00000004:3.0:1789635541.607395:0:19020:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789635541.607787:0:19020:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789635542.051892:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789635542.372583:0:17130:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1789635542.535319:0:19070:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789635542.535590:0:19070:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789635542.948095:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789635542.948125:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427400192:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789635542.948213:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635542.948274:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427400192 00000100:00100000:1.0:1789635542.948284:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427400192 00000100:00100000:1.0:1789635542.948346:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789635542.948356:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427400192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789635542.948402:0:17101:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789635542.948458:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427400192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635542.948466:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789635542.948545:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427400192:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789635542.948861:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789635542.948874:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543293b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427400320:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789635542.948911:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635542.948956:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427400320 00000100:00100000:0.0:1789635542.948960:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427400320 00000100:00100000:0.0:1789635542.949001:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789635542.949008:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427400320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789635542.949032:0:17102:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789635542.949070:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427400320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635542.949077:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789635542.949109:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543293b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427400320:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789635543.075988:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635544.099736:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789635544.873116:0:17847:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789635545.124719:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635546.152678:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789635546.531970:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789635546.531979:0:492:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789635546.531984:0:492:0:(import.c:65:import_set_state_nolock()) ffff8d057604f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789635546.531993:0:492:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 560 00000100:00080000:0.0:1789635546.531999:0:492:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1789635546.532014:0:492:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d057604f000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1789635546.532051:0:492:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0543292680 x1876568427400832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789635546.532088:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789635546.532092:0:492:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789635546.532095:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789635546.532098:0:492:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789635546.532141:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427400576:0@lo:400:kworker.0 00000100:00100000:0.0:1789635546.532227:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635546.532283:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543292300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876568427401216:0@lo:400:kworker.0 00000100:00100000:0.0:1789635546.532307:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635546.532333:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789635546.532337:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427400704:0@lo:400:kworker.0 00000100:00100000:0.0:1789635546.532359:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635546.532373:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1876568427401344:0@lo:400:kworker.0 00000100:00100000:0.0:1789635546.532396:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635546.532426:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427400576 00000100:00100000:0.0:1789635546.532435:0:18189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427400576 00000100:00100000:0.0:1789635546.532503:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789635546.532513:0:18189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427400576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635546.532580:0:18189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427400576:12345-0@lo:400:kworker.0 Request processed in 68us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635546.532588:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789635546.532911:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543293b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3641:1876568427400448:0@lo:400:kworker.0 00000100:00100000:2.0:1789635546.532951:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635546.532990:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543291c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427401088:0@lo:400:kworker.0 00000100:00100000:2.0:1789635546.533014:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635546.533036:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789635546.533042:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876568427400960:0@lo:400:kworker.0 00000100:00100000:2.0:1789635546.533065:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635546.533085:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1876568427401472:0@lo:400:kworker.0 00000100:00100000:2.0:1789635546.533107:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635546.533137:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427400704 00000100:00100000:2.0:1789635546.533142:0:18604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427400704 00000100:00100000:2.0:1789635546.533186:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789635546.533193:0:18604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427400704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635546.533225:0:18604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427400704:12345-0@lo:400:kworker.0 Request processed in 32us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635546.533230:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789635546.533259:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427400448 00000100:00100000:2.0:1789635546.533263:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427400448 00000100:00100000:2.0:1789635546.533286:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789635546.533292:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+21:3641:x1876568427400448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635546.533324:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+21:3641:x1876568427400448:12345-0@lo:400:kworker.0 Request processed in 32us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635546.533330:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789635546.533356:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427401088 00000100:00100000:2.0:1789635546.533360:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427401088 00000100:00100000:2.0:1789635546.533380:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789635546.533386:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427401088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635546.533413:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427401088:12345-0@lo:400:kworker.0 Request processed in 28us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635546.533419:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789635546.533438:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427401216 00000100:00100000:2.0:1789635546.533442:0:17848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427401216 00000100:00100000:2.0:1789635546.533458:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427401344 00000100:00100000:2.0:1789635546.533460:0:17848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427401344 00000100:00100000:2.0:1789635546.533473:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427400960 00000100:00100000:2.0:1789635546.533475:0:17848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427400960 00000100:00100000:2.0:1789635546.533497:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427401472 00000100:00100000:2.0:1789635546.533499:0:17848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427401472 00000100:00100000:2.0:1789635546.533513:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789635546.533519:0:17848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876568427401216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635546.533553:0:17848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876568427401216:12345-0@lo:400:kworker.0 Request processed in 34us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635546.533558:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789635546.533569:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789635546.533575:0:17848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876568427401344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635546.533647:0:17848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876568427401344:12345-0@lo:400:kworker.0 Request processed in 72us (1249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635546.533654:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789635546.533668:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789635546.533675:0:17848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876568427400960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635546.533769:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427400832:0@lo:8:kworker.0 00000100:00100000:3.0:1789635546.533818:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635546.533859:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789635546.533869:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876568427401472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635546.533904:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876568427401472:12345-0@lo:400:kworker.0 Request processed in 37us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635546.533910:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789635546.534213:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427400832 00000100:00100000:3.0:1789635546.534219:0:18696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427400832 00000100:00100000:3.0:1789635546.534251:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789635546.534258:0:18696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3639:x1876568427400832:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789635546.534284:0:18696:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789635546.534331:0:18696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3639:x1876568427400832:12345-0@lo:8:kworker.0 Request processed in 72us (512us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789635546.534339:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789635546.534372:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789635546.534384:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427401600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635546.534402:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427400576:0@lo:400:kworker.0 00010000:00080000:0.0:1789635546.534470:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0543292300 x1876568427401216/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635546.534498:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543292300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876568427401216:0@lo:400:kworker.0 00000100:00100000:0.0:1789635546.535810:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427400704:0@lo:400:kworker.0 00010000:00080000:0.0:1789635546.535833:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0543292a00 x1876568427401344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635546.535846:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1876568427401344:0@lo:400:kworker.0 00000100:00100000:2.0:1789635546.536061:0:17848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876568427400960:12345-0@lo:400:kworker.0 Request processed in 2384us (2991us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635546.536107:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635546.536141:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1789635546.536180:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d057604f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789635546.536183:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789635546.536187:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00080000:2.0:1789635546.536191:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635546.536192:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427400832:0@lo:8:kworker.0 00000100:00080000:2.0:1789635546.536198:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789635546.536246:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0543293800 x1876568427400960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635546.536259:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876568427400960:0@lo:400:kworker.0 00010000:00080000:2.0:1789635546.536276:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0543291180 x1876568427401472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635546.536285:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1876568427401472:0@lo:400:kworker.0 00000100:00100000:2.0:1789635546.536299:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543293b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3641:1876568427400448:0@lo:400:kworker.0 00000100:00100000:2.0:1789635546.536315:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543291c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427401088:0@lo:400:kworker.0 00000100:00100000:0.0:1789635546.536394:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427401600 00000100:00100000:0.0:1789635546.536402:0:18606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427401600 00000100:00100000:0.0:1789635546.536457:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789635546.536466:0:18606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427401600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789635546.536516:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789635546.536574:0:18606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427401600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635546.536581:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789635546.537154:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427401600:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789635547.174548:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635547.556805:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789635532/real 1789635532] req@ffff8d05759d0000 x1876568427392384/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789635547 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635547.556834:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d05759d0000 x1876568427392384/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789635547 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635547.556846:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789635532/real 1789635532] req@ffff8d05759d1880 x1876568427392512/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789635547 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635547.556858:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d05759d1880 x1876568427392512/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789635547 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789635547.556892:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d04478c5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789635547.556916:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789635547.556920:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1876568427392384:0@lo:8:kworker.0 00000100:00080000:0.0:1789635547.556927:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d057b5c7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789635547.556932:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789635547.556935:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1876568427392512:0@lo:8:kworker.0 00000100:00100000:1.0:1789635547.557073:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789635547.558666:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427401856:0@lo:400:kworker.0 00000100:00100000:0.0:1789635547.559155:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635547.559193:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3643:1876568427401728:0@lo:400:kworker.0 00000100:00100000:0.0:1789635547.559218:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635547.559258:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427401728 00000100:00100000:0.0:1789635547.559266:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427401728 00000100:00100000:0.0:1789635547.559310:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789635547.559319:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+21:3643:x1876568427401728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635547.559371:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+21:3643:x1876568427401728:12345-0@lo:400:kworker.0 Request processed in 52us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635547.559378:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789635547.559426:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3643:1876568427401728:0@lo:400:kworker.0 00000100:00100000:2.0:1789635547.559492:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427401856 00000100:00100000:2.0:1789635547.559497:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427401856 00000100:00100000:2.0:1789635547.559531:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789635547.559539:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427401856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635547.559589:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427401856:12345-0@lo:400:kworker.0 Request processed in 51us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635547.559621:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789635547.559761:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427401856:0@lo:400:kworker.0 00000100:00080000:3.0:1789635547.560022:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789635547.560027:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789635547.560030:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d057604f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789635547.560034:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 565 00000100:00080000:3.0:1789635547.560039:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1789635547.560045:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d057604f000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789635547.560064:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0448599880 x1876568427402112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789635547.560107:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427401984:0@lo:400:kworker.0 00000100:00100000:1.0:1789635547.560141:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635547.560175:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427401984 00000100:00100000:1.0:1789635547.560180:0:18604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427401984 00000100:00100000:1.0:1789635547.560209:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789635547.560217:0:18604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543296a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427401984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635547.560255:0:18604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543296a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427401984:12345-0@lo:400:kworker.0 Request processed in 39us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635547.560274:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789635547.560310:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427401984:0@lo:400:kworker.0 00000100:00100000:1.0:1789635547.563793:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789635547.563840:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427402112:0@lo:8:kworker.0 00000100:00100000:0.0:1789635547.563912:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635547.563969:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427402112 00000100:00100000:0.0:1789635547.563977:0:18603:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427402112 00000100:00100000:0.0:1789635547.564012:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789635547.564019:0:18603:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3639:x1876568427402112:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789635547.564049:0:18603:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789635547.564090:0:18603:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3639:x1876568427402112:12345-0@lo:8:kworker.0 Request processed in 70us (177us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789635547.564097:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1789635547.564137:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d057604f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789635547.564142:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789635547.564145:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427402112:0@lo:8:kworker.0 00000100:00080000:3.0:1789635547.564216:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789635547.564220:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789635547.564223:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d04478c5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789635547.564228:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 551 00000100:00080000:3.0:1789635547.564232:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789635547.564239:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d04478c5800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789635547.564261:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d056e015500 x1876568427402496/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789635547.564274:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789635547.564277:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789635547.564279:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d057b5c7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789635547.564289:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 551 00000100:00080000:3.0:1789635547.564291:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789635547.564297:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d057b5c7800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789635547.564310:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d056e017b80 x1876568427402624/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789635547.567552:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427402368:0@lo:400:kworker.0 00000100:00100000:0.0:1789635547.567655:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635547.567698:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789635547.567705:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876568427402752:0@lo:400:kworker.0 00000100:00100000:0.0:1789635547.567730:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635547.567766:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427402368 00000100:00100000:0.0:1789635547.567775:0:18189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427402368 00000100:00100000:0.0:1789635547.567817:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789635547.567825:0:18189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427402368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635547.567877:0:18189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427402368:12345-0@lo:400:kworker.0 Request processed in 53us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635547.567885:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789635547.567911:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427402752 00000100:00100000:0.0:1789635547.567915:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427402752 00000100:00100000:0.0:1789635547.567941:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789635547.567948:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876568427402752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635547.567978:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876568427402752:12345-0@lo:400:kworker.0 Request processed in 31us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635547.567998:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1789635547.568040:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d05759d1880 x1876568427402752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635547.568053:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876568427402752:0@lo:400:kworker.0 00000100:00100000:0.0:1789635547.568064:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427402368:0@lo:400:kworker.0 00000100:00100000:0.0:1789635547.568095:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e015500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1876568427402496:0@lo:8:kworker.0 00000100:00100000:0.0:1789635547.568127:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635547.568156:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e017b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1876568427402624:0@lo:8:kworker.0 00000100:00100000:0.0:1789635547.568181:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635547.568208:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427402496 00000100:00100000:0.0:1789635547.568212:0:18696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427402496 00000100:00100000:0.0:1789635547.568228:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427402624 00000100:00100000:0.0:1789635547.568230:0:18696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427402624 00000100:00100000:0.0:1789635547.568243:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789635547.568248:0:18696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543291c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3639:x1876568427402496:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789635547.568272:0:18696:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 566 last 0 00000020:00000080:0.0:1789635547.568297:0:18696:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb0c3a59caa41039c 00002000:00100000:0.0:1789635547.568311:0:18696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8d0447ba0000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1789635547.568315:0:18696:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1789635547.568318:0:18696:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789635547.568386:0:18696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1789635547.568407:0:18696:0:(import.c:65:import_set_state_nolock()) ffff8d0447ba3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789635547.568440:0:18696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543291c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3639:x1876568427402496:12345-0@lo:8:kworker.0 Request processed in 190us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635547.568446:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789635547.568463:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789635547.568467:0:18696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543293b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3639:x1876568427402624:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789635547.568491:0:18696:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789635547.568518:0:18696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543293b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3639:x1876568427402624:12345-0@lo:8:kworker.0 Request processed in 49us (336us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789635547.568524:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789635547.568556:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789635547.568563:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789635547.568570:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789635547.568575:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789635547.568577:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d04478c5800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789635547.568618:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789635547.568623:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e015500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1876568427402496:0@lo:8:kworker.0 00000100:00080000:0.0:1789635547.568635:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d057b5c7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789635547.568639:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789635547.568642:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e017b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1876568427402624:0@lo:8:kworker.0 00000100:00100000:1.0:1789635547.568782:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427402880:0@lo:400:kworker.0 00000100:00100000:1.0:1789635547.568815:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635547.568836:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427402240:0@lo:400:kworker.0 00000100:00100000:1.0:1789635547.568856:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635547.568875:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789635547.568880:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427403008:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789635547.568900:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635547.568973:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427402880 00000100:00100000:1.0:1789635547.568978:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427402880 00000100:00100000:1.0:1789635547.568998:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427402240 00000100:00100000:1.0:1789635547.569001:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427402240 00000100:00100000:1.0:1789635547.569016:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789635547.569021:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427402880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635547.569054:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876568427402880:12345-0@lo:400:kworker.0 Request processed in 32us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635547.569059:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789635547.569077:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789635547.569082:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427402240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635547.569105:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876568427402240:12345-0@lo:400:kworker.0 Request processed in 23us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635547.569111:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789635547.569136:0:18607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427403008 00000100:00100000:1.0:1789635547.569145:0:18607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427403008 00000100:00100000:1.0:1789635547.569178:0:18607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789635547.569198:0:18607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543296680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1876568427403008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789635547.569225:0:18607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789635547.569257:0:18607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543296680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1876568427403008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635547.569262:0:18607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1789635547.569278:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789635547.569306:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427403008:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1789635547.569318:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d05759d0000 x1876568427402880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635547.569328:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1876568427402880:0@lo:400:kworker.0 00010000:00080000:1.0:1789635547.569337:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0448598e00 x1876568427402240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635547.569344:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876568427402240:0@lo:400:kworker.0 00000004:00080000:3.0:1789635547.569881:0:17836:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789635547.569958:0:17836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 566253360842ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789635547.569965:0:17836:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1789635547.570118:0:17837:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789635547.570141:0:17837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543293800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17837:1876568427403264:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1789635547.570175:0:17837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635547.570194:0:17837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05461e8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789635547.570205:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789635547.570212:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427403136:0@lo:400:kworker.0 00000100:00100000:0.0:1789635547.570252:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635547.570279:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427403264 00000100:00100000:0.0:1789635547.570284:0:18696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427403264 00000100:00100000:0.0:1789635547.570313:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789635547.570327:0:18696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17837:x1876568427403264:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1789635547.573289:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427403136 00000100:00100000:1.0:1789635547.573301:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427403136 00000100:00100000:1.0:1789635547.573360:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789635547.573370:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876568427403136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635547.575637:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876568427403136:12345-0@lo:400:kworker.0 Request processed in 2259us (5374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635547.575652:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00002000:00080000:1.0:1789635547.575972:0:18696:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1789635547.575979:0:18696:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1789635547.576050:0:18696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17837:x1876568427403264:12345-0@lo:7:osp-pre-0-1.0 Request processed in 5723us (5872us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635547.576065:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789635547.576147:0:17837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543293800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17837:1876568427403264:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1789635547.576164:0:17837:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1789635547.576203:0:17837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543293800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17837:1876568427403392:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1789635547.576238:0:17837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635547.576268:0:17837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d04477dfd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789635547.576312:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427403392 00000100:00100000:1.0:1789635547.576319:0:18604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427403392 00000100:00100000:1.0:1789635547.576362:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789635547.576370:0:18604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e017b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17837:x1876568427403392:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1789635547.576395:0:18604:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1789635547.576428:0:18604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e017b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17837:x1876568427403392:12345-0@lo:5:osp-pre-0-1.0 Request processed in 59us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635547.576436:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789635547.576465:0:17837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543293800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17837:1876568427403392:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1789635547.576482:0:17837:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1789635547.576507:0:17837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17837:1876568427403520:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1789635547.576530:0:17837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635547.576546:0:17837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0548894300 going to sleep for 11 seconds 00000100:00100000:1.0:1789635547.576559:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427403520 00000100:00100000:1.0:1789635547.576562:0:18602:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427403520 00000100:00100000:1.0:1789635547.576582:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789635547.576588:0:18602:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543294e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17837:x1876568427403520:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1789635547.576639:0:18602:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00010000:00080000:3.0:1789635547.579461:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d05759d3100 x1876568427403136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635547.579489:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427403136:0@lo:400:kworker.0 00000004:00080000:2.0:1789635547.583378:0:17828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000001:00080000:2.0:1789635547.598358:0:18599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1789635547.598373:0:18599:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1789635547.598574:0:18602:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543294e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17837:x1876568427403520:12345-0@lo:5:osp-pre-0-1.0 Request processed in 21980us (22038us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789635547.598777:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789635547.599028:0:17837:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1789635547.599037:0:17837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17837:1876568427403520:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1789635547.599053:0:17837:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1789635547.599103:0:17837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17837:1876568427403648:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1789635547.599136:0:17837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635547.599201:0:17837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0548894300 going to sleep for 11 seconds 00000100:00100000:2.0:1789635547.599252:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427403648 00000100:00100000:2.0:1789635547.599258:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427403648 00000100:00100000:2.0:1789635547.599289:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789635547.599299:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17837:x1876568427403648:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1789635547.599401:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17837:x1876568427403648:12345-0@lo:900:osp-pre-0-1.0 Request processed in 102us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635547.599412:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789635547.599429:0:17837:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0543294000 x1876568427403648/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789635563 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635547.599440:0:17837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17837:1876568427403648:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1789635548.068498:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789635548.068521:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d056e015500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427403776:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789635548.068678:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635548.072112:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427403904:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789635548.072118:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427403776 00000100:00100000:0.0:1789635548.072127:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427403776 00000100:00100000:3.0:1789635548.072179:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635548.072186:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789635548.072198:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427403776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789635548.072234:0:17101:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789635548.072295:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427403776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (3616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635548.072302:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789635548.072320:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427403904 00000100:00100000:0.0:1789635548.072324:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427403904 00000100:00100000:2.0:1789635548.072338:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d056e015500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427403776:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789635548.072343:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789635548.072352:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427403904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789635548.072369:0:17101:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789635548.072411:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427403904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635548.072417:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789635548.072885:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427403904:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789635548.196820:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789635548.900778:0:19415:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789635548.900788:0:19415:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789635548.900789:0:19415:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789635548.900930:0:19415:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d04410af800 00000020:01000004:0.0:1789635548.900947:0:19415:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789635548.900960:0:19415:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789635548.900973:0:19415:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d05747299c0) 00000020:00000080:0.0:1789635548.900989:0:19415:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789635548.940293:0:19415:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789635548.942268:0:19415:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1789635548.942504:0:19415:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789635548.942914:0:19415:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789635548.943140:0:19415:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1789635548.943376:0:19415:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1789635548.943677:0:19415:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:0.0:1789635548.944860:0:19415:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789635548.945065:0:19415:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1789635548.945080:0:19415:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789635548.945092:0:19415:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb0c3a59caa4103aa 00000020:01000004:0.0:1789635548.945099:0:19415:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789635548.945141:0:19415:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.120@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789635548.945145:0:19415:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789635548.945152:0:19415:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1789635548.945180:0:19415:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1789635548.945184:0:19415:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.120@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789635548.953830:0:19415:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789635548.953870:0:19415:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.120@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1789635548.953874:0:19415:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789635548.953876:0:19415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789635548.953878:0:19415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789635548.953879:0:19415:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789635548.953880:0:19415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789635548.953882:0:19415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789635548.953883:0:19415:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789635548.953885:0:19415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789635548.953886:0:19415:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789635548.953889:0:19415:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1789635548.953891:0:19415:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789635548.953892:0:19415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789635548.953899:0:19415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789635548.953900:0:19415:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789635548.953901:0:19415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789635548.953902:0:19415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789635548.953903:0:19415:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789635548.953904:0:19415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789635548.953904:0:19415:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789635548.953933:0:19415:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789635548.953952:0:19415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427404032:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789635548.954019:0:19415:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635548.954067:0:19415:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05742f4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635548.954165:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427404032 00000100:00100000:2.0:1789635548.954172:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427404032 00000100:00100000:2.0:1789635548.954224:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789635548.954233:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+21:19415:x1876568427404032:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789635548.954262:0:17091:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789635548.954265:0:17091:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1789635548.954269:0:17091:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789635548.954669:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+21:19415:x1876568427404032:12345-0@lo:253:mount.lustre.0 Request processed in 435us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635548.954687:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789635548.954795:0:19415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427404032:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789635548.954805:0:19415:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789635548.954808:0:19415:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789635548.954809:0:19415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789635548.954810:0:19415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789635548.954811:0:19415:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789635548.954812:0:19415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789635548.954814:0:19415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789635548.954815:0:19415:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789635548.954816:0:19415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789635548.954817:0:19415:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789635548.954834:0:19415:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d04410af800 from lustre-OST0001 10000000:01000000:3.0:1789635548.954858:0:19415:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789635548.954861:0:19415:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789635548.954869:0:19415:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d056f55b380 local copy 00010000:00010000:3.0:1789635548.954879:0:19415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2a00/0xb0c3a59caa40fff9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410000 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635548.954956:0:19415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427404160:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789635548.954987:0:19415:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635548.955019:0:19415:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b5eb240 going to sleep for 11 seconds 00000100:00100000:0.0:1789635548.955076:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427404160 00000100:00100000:0.0:1789635548.955081:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427404160 00000100:00100000:0.0:1789635548.955178:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789635548.955187:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+21:19415:x1876568427404160:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789635548.955259:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+21:19415:x1876568427404160:12345-0@lo:501:mount.lustre.0 Request processed in 73us (271us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789635548.955276:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789635548.955335:0:19415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427404160:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789635548.955355:0:19415:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789635548.955371:0:19415:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789635548.955377:0:19415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2a00/0xb0c3a59caa40fff9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410000 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635548.955385:0:19415:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e1a2a00/0xb0c3a59caa40fff9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410000 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635548.955408:0:19415:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d04410af800 10000000:01000000:3.0:1789635548.955413:0:19415:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789635548.955417:0:19415:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789635548.955420:0:19415:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789635548.955423:0:19415:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789635548.955426:0:19415:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789635548.955446:0:19415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05488ff600/0xb0c3a59caa4103b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635548.955454:0:19415:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d05488ff600/0xb0c3a59caa4103b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635548.955475:0:19415:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d05488ff600/0xb0c3a59caa4103b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635548.955488:0:19415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427404288:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789635548.955514:0:19415:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635548.955592:0:19415:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b5eb240 going to sleep for 11 seconds 00000100:00100000:1.0:1789635548.955748:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427404288 00000100:00100000:1.0:1789635548.955753:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427404288 00000100:00100000:1.0:1789635548.955776:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789635548.955783:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+21:19415:x1876568427404288:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789635548.955792:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635548.955804:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056e153000/0xb0c3a59caa4103b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa4103b1 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635548.955825:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e153000/0xb0c3a59caa4103b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa4103b1 expref: 22 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635548.955834:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056e153000/0xb0c3a59caa4103b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa4103b1 expref: 22 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635548.955842:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e153000, rc 0) 00000100:00100000:1.0:1789635548.955883:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+22:19415:x1876568427404288:12345-0@lo:101:mount.lustre.0 Request processed in 100us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635548.955889:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789635548.955970:0:19415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427404288:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789635548.955982:0:19415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d05488ff600/0xb0c3a59caa4103b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4103b8 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635548.955997:0:19415:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d05488ff600/0xb0c3a59caa4103b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa4103b8 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789635548.956892:0:19415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789635548.957382:0:19415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789635548.959304:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789635548.959352:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789635548.959369:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789635548.959383:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789635548.959398:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789635548.959411:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789635548.959432:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789635548.959436:0:19415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789635548.959832:0:19415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427404416:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789635548.959901:0:19415:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635548.959976:0:19415:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b5ebb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789635548.960008:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427404416 00000100:00100000:1.0:1789635548.960015:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427404416 00000100:00100000:1.0:1789635548.960088:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789635548.960098:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+22:19415:x1876568427404416:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789635548.960246:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+22:19415:x1876568427404416:12345-0@lo:501:mount.lustre.0 Request processed in 149us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635548.960265:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789635548.960337:0:19415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427404416:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789635548.960370:0:19415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427404544:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789635548.960409:0:19415:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635548.960514:0:19415:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b5ebb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789635548.960718:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427404544 00000100:00100000:0.0:1789635548.960724:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427404544 00000100:00100000:0.0:1789635548.960750:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789635548.960757:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+22:19415:x1876568427404544:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789635548.961453:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+22:19415:x1876568427404544:12345-0@lo:503:mount.lustre.0 Request processed in 694us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635548.961473:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789635548.961797:0:19415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427404544:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789635548.962211:0:19415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789635548.962296:0:19415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427404672:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789635548.962342:0:19415:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635548.962379:0:19415:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057590dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789635548.962442:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427404672 00000100:00100000:0.0:1789635548.962448:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427404672 00000100:00100000:0.0:1789635548.962496:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789635548.962505:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+22:19415:x1876568427404672:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789635548.962947:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+22:19415:x1876568427404672:12345-0@lo:502:mount.lustre.0 Request processed in 443us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635548.962956:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789635548.963036:0:19415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427404672:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789635548.963213:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1789635548.963238:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789635548.963251:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1789635548.963264:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789635548.963280:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789635548.963309:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789635548.963327:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1789635548.963343:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1789635548.963359:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1789635548.963383:0:19415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427404800:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789635548.963419:0:19415:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635548.963442:0:19415:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057590dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789635548.963505:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427404800 00000100:00100000:0.0:1789635548.963510:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427404800 00000100:00100000:0.0:1789635548.963531:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789635548.963538:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+22:19415:x1876568427404800:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789635548.963826:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+22:19415:x1876568427404800:12345-0@lo:502:mount.lustre.0 Request processed in 288us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635548.963834:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789635548.963956:0:19415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427404800:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789635548.963998:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1789635548.964006:0:19415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1789635548.967747:0:19419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789635548.967760:0:19419:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1789635548.967767:0:19419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635548.967769:0:19419:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789635548.967790:0:19419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789635548.967808:0:19419:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d0558610000) 00000020:00000080:0.0:1789635548.967837:0:19419:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789635548.967843:0:19419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789635548.967928:0:19419:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d04410af800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789635548.967937:0:19419:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789635548.967943:0:19419:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb0c3a59caa4103c6 00010000:00010000:0.0:1789635548.973213:0:19419:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1789635548.973889:0:19419:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:0.0:1789635548.975224:0:19419:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1789635548.976684:0:19419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789635548.976695:0:19419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635548.976702:0:19419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635548.976704:0:19419:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789635548.976708:0:19419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789635548.976712:0:19419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635548.976713:0:19419:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789635548.976716:0:19419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789635548.976718:0:19419:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789635548.976720:0:19419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635548.976723:0:19419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635548.976724:0:19419:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789635548.976726:0:19419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789635548.976729:0:19419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635548.976730:0:19419:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789635548.976734:0:19419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789635548.976758:0:19419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635548.976762:0:19419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635548.976764:0:19419:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789635548.976767:0:19419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1789635548.976930:0:19415:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1789635548.976964:0:19415:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789635548.976985:0:19415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05488ff600/0xb0c3a59caa4103b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4103b8 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635548.976996:0:19415:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d05488ff600/0xb0c3a59caa4103b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4103b8 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635548.977016:0:19415:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d04410af800 from 1 10000000:01000000:3.0:1789635548.977019:0:19415:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789635548.977055:0:19415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05488ff400/0xb0c3a59caa4103cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635548.977063:0:19415:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d05488ff400/0xb0c3a59caa4103cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635548.977074:0:19415:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d05488ff400/0xb0c3a59caa4103cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635548.977096:0:19415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427404928:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789635548.977161:0:19415:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635548.977192:0:19415:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b5eb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635548.977260:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427404928 00000100:00100000:1.0:1789635548.977267:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427404928 00000100:00100000:1.0:1789635548.977319:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789635548.977329:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+22:19415:x1876568427404928:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789635548.977342:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635548.977354:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056e152c00/0xb0c3a59caa4103d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa4103cd expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635548.977376:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e152c00/0xb0c3a59caa4103d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa4103cd expref: 23 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635548.977386:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056e152c00/0xb0c3a59caa4103d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa4103cd expref: 23 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635548.977395:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e152c00, rc 0) 00000100:00100000:1.0:1789635548.977432:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+23:19415:x1876568427404928:12345-0@lo:101:mount.lustre.0 Request processed in 104us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635548.977440:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789635548.977546:0:19415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427404928:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789635548.977560:0:19415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d05488ff400/0xb0c3a59caa4103cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4103d4 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635548.977569:0:19415:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d05488ff400/0xb0c3a59caa4103cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa4103d4 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789635548.978758:0:19415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789635548.979014:0:19415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789635548.979176:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789635548.979201:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789635548.979220:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789635548.979227:0:19415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789635548.979288:0:19415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427405056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789635548.979344:0:19415:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635548.979382:0:19415:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b5eba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789635548.979483:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427405056 00000100:00100000:0.0:1789635548.979491:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427405056 00000100:00100000:0.0:1789635548.979527:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789635548.979536:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+23:19415:x1876568427405056:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789635548.979687:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+23:19415:x1876568427405056:12345-0@lo:501:mount.lustre.0 Request processed in 151us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635548.979694:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789635548.982034:0:19415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427405056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789635548.982092:0:19415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427405184:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789635548.982163:0:19415:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635548.982203:0:19415:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b5eba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789635548.984655:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427405184 00000100:00100000:0.0:1789635548.984668:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427405184 00000100:00100000:0.0:1789635548.984721:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789635548.984732:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+23:19415:x1876568427405184:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789635548.984888:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+23:19415:x1876568427405184:12345-0@lo:503:mount.lustre.0 Request processed in 158us (2724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635548.984897:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789635548.985423:0:19415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427405184:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789635548.985918:0:19415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789635548.985997:0:19415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427405312:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789635548.986052:0:19415:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635548.986097:0:19415:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05677b0840 going to sleep for 11 seconds 00000100:00100000:3.0:1789635548.986296:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427405312 00000100:00100000:3.0:1789635548.986303:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427405312 00000100:00100000:3.0:1789635548.986345:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789635548.986355:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+23:19415:x1876568427405312:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789635548.986471:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+23:19415:x1876568427405312:12345-0@lo:502:mount.lustre.0 Request processed in 109us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635548.986478:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789635548.986653:0:19415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427405312:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789635548.986848:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789635548.986878:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789635548.986895:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789635548.986920:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789635548.986936:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789635548.986952:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789635548.986967:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789635548.986982:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1789635548.986998:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1789635548.987013:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1789635548.987032:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1789635548.987057:0:19415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427405440:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789635548.987098:0:19415:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635548.987123:0:19415:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05677b0840 going to sleep for 11 seconds 00000100:00100000:3.0:1789635548.987187:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427405440 00000100:00100000:3.0:1789635548.987192:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427405440 00000100:00100000:3.0:1789635548.987227:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789635548.987234:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+23:19415:x1876568427405440:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789635548.987308:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+23:19415:x1876568427405440:12345-0@lo:502:mount.lustre.0 Request processed in 74us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635548.987315:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789635548.987396:0:19415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427405440:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789635548.987437:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1789635548.987445:0:19415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789635548.990029:0:19423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789635548.990044:0:19423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635548.990047:0:19423:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789635548.990055:0:19423:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d04410af800 00000020:00000080:3.0:1789635548.990057:0:19423:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789635548.990065:0:19423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789635548.990067:0:19423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635548.990076:0:19423:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789635548.990080:0:19423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789635548.990083:0:19423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635548.990084:0:19423:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789635548.990087:0:19423:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d04410af800 00000020:00000080:3.0:1789635548.990090:0:19423:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789635548.990569:0:19423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789635548.990574:0:19423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635548.990575:0:19423:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789635548.990578:0:19423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789635548.990581:0:19423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635548.990582:0:19423:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789635548.990586:0:19423:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d04410af800 00000020:00000080:3.0:1789635548.990588:0:19423:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789635548.992684:0:19423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789635548.992693:0:19423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635548.992696:0:19423:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789635548.992700:0:19423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789635548.992704:0:19423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635548.992705:0:19423:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789635548.992709:0:19423:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d04410af800 00000020:00000080:3.0:1789635548.992711:0:19423:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789635548.992765:0:19423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789635548.992768:0:19423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635548.992769:0:19423:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789635548.992773:0:19423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1789635548.992931:0:19415:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789635548.992960:0:19415:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789635548.996670:0:19415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05488ff400/0xb0c3a59caa4103cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4103d4 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635548.996693:0:19415:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d05488ff400/0xb0c3a59caa4103cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4103d4 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635548.996785:0:19415:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789635548.996789:0:19415:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d04410af800 10000000:01000000:1.0:1789635548.996792:0:19415:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d04410af800 10000000:01000000:1.0:1789635548.996796:0:19415:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789635548.996803:0:19415:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d04410af800 from 1 10000000:01000000:1.0:1789635548.996805:0:19415:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789635548.996845:0:19415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa4103db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635548.996854:0:19415:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa4103db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635548.996866:0:19415:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa4103db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635548.996890:0:19415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427405568:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789635548.996953:0:19415:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635548.996992:0:19415:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0545287cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635548.997348:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427405568 00000100:00100000:3.0:1789635548.997356:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427405568 00000100:00100000:3.0:1789635548.997447:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789635548.997457:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+23:19415:x1876568427405568:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789635548.997481:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635548.997494:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d05488ffa00/0xb0c3a59caa4103e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa4103db expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635548.997525:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d05488ffa00/0xb0c3a59caa4103e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa4103db expref: 24 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635548.997535:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d05488ffa00/0xb0c3a59caa4103e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa4103db expref: 24 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635548.997557:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05488ffa00, rc 0) 00000100:00100000:3.0:1789635548.997626:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+24:19415:x1876568427405568:12345-0@lo:101:mount.lustre.0 Request processed in 171us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635548.997633:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789635548.997719:0:19415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427405568:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789635548.997734:0:19415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa4103db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4103e2 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635548.997743:0:19415:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa4103db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa4103e2 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789635548.999029:0:19415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1789635548.999292:0:19415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789635548.999556:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789635548.999586:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789635548.999631:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789635548.999647:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789635548.999660:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789635548.999675:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789635548.999691:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789635548.999705:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789635548.999720:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789635548.999731:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789635548.999744:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789635548.999758:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789635548.999772:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789635548.999784:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789635548.999797:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789635548.999808:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789635548.999820:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789635548.999833:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789635548.999852:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789635548.999866:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789635548.999879:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789635548.999893:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789635548.999906:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789635548.999919:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789635548.999931:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1789635548.999943:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1789635548.999955:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1789635548.999967:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1789635548.999994:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1789635549.000016:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1789635549.000029:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1789635549.000040:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1789635549.000053:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1789635549.000065:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1789635549.000078:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1789635549.000091:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1789635549.000102:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1789635549.000113:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1789635549.000125:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1789635549.000136:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1789635549.000147:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1789635549.000159:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1789635549.000169:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1789635549.000181:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1789635549.000206:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1789635549.000220:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1789635549.000238:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1789635549.000243:0:19415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1789635549.000325:0:19415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427405696:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789635549.000385:0:19415:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635549.000908:0:19415:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0545287e40 going to sleep for 10 seconds 00000100:00100000:2.0:1789635549.001011:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427405696 00000100:00100000:2.0:1789635549.001019:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427405696 00000100:00100000:2.0:1789635549.001061:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789635549.001071:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+24:19415:x1876568427405696:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789635549.001199:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+24:19415:x1876568427405696:12345-0@lo:501:mount.lustre.0 Request processed in 128us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635549.001206:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789635549.001304:0:19415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427405696:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789635549.001341:0:19415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427405824:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789635549.001384:0:19415:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635549.001408:0:19415:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0545287e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789635549.001471:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427405824 00000100:00100000:2.0:1789635549.001476:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427405824 00000100:00100000:2.0:1789635549.001496:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789635549.001502:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+24:19415:x1876568427405824:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789635549.001685:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+24:19415:x1876568427405824:12345-0@lo:503:mount.lustre.0 Request processed in 183us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635549.001693:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789635549.001783:0:19415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427405824:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789635549.002158:0:19415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789635549.002219:0:19415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427405952:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789635549.002262:0:19415:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635549.002297:0:19415:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0545287cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635549.002348:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427405952 00000100:00100000:2.0:1789635549.002354:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427405952 00000100:00100000:2.0:1789635549.002375:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789635549.002382:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+24:19415:x1876568427405952:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789635549.002510:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+24:19415:x1876568427405952:12345-0@lo:502:mount.lustre.0 Request processed in 127us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635549.002517:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789635549.008726:0:19415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427405952:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789635549.008989:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789635549.009024:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789635549.009043:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789635549.009059:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789635549.009074:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789635549.009087:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789635549.009103:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789635549.009117:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789635549.009132:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789635549.009147:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789635549.009162:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789635549.009194:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789635549.009210:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789635549.009221:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789635549.009233:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789635549.009246:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789635549.009259:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789635549.009272:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789635549.009284:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789635549.009295:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789635549.009308:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789635549.009320:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789635549.009334:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789635549.009349:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789635549.009362:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1789635549.009375:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1789635549.009389:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1789635549.009418:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1789635549.009445:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1789635549.009473:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1789635549.009490:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1789635549.009505:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1789635549.009520:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1789635549.009534:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1789635549.009756:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1789635549.009774:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1789635549.009787:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1789635549.009799:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1789635549.009811:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1789635549.009825:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1789635549.011638:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1789635549.011678:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1789635549.011695:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1789635549.011727:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1789635549.011745:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1789635549.011760:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1789635549.011774:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1789635549.011787:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1789635549.011841:0:19415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427406080:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789635549.011915:0:19415:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635549.011961:0:19415:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0545287cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635549.012080:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427406080 00000100:00100000:2.0:1789635549.012088:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427406080 00000100:00100000:2.0:1789635549.012177:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789635549.012186:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+24:19415:x1876568427406080:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789635549.012311:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+24:19415:x1876568427406080:12345-0@lo:502:mount.lustre.0 Request processed in 125us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635549.012319:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789635549.012396:0:19415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427406080:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789635549.015705:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1789635549.015767:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1789635549.015818:0:19415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427406208:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789635549.015898:0:19415:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635549.017712:0:19415:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0545287cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635549.017787:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427406208 00000100:00100000:0.0:1789635549.017796:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427406208 00000100:00100000:0.0:1789635549.017844:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789635549.017853:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+24:19415:x1876568427406208:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789635549.018012:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+24:19415:x1876568427406208:12345-0@lo:502:mount.lustre.0 Request processed in 160us (2113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635549.018021:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789635549.018696:0:19415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427406208:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789635549.018789:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1789635549.018803:0:19415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1789635549.026148:0:19429:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789635549.026164:0:19429:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d05655a3380) 00000020:00000080:3.0:1789635549.026189:0:19429:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1789635549.026274:0:19429:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d04410af800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789635549.026279:0:19429:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d04410af800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789635549.026282:0:19429:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d04410af800 3 00010000:00080000:3.0:1789635549.026314:0:19429:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d0447b18000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.120@tcp at head 00010000:00010000:3.0:1789635549.028113:0:19429:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1789635549.030485:0:19429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789635549.030540:0:19429:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789635549.030660:0:19429:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xb0c3a59caa4103f0 00000100:00080000:3.0:1789635549.030671:0:19429:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789635549.030684:0:19429:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d0447b18000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789635549.030723:0:19429:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d05759d2a00 x1876568427406336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789635549.030763:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d05759d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1876568427406336:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789635549.030826:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635549.030899:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427406336 00000100:00100000:3.0:1789635549.030906:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427406336 00000100:00100000:3.0:1789635549.030935:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789635549.030941:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1876568427406336:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789635549.030962:0:17098:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 567 last 0 00000020:00000080:3.0:1789635549.030991:0:17098:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xb0c3a59caa4103f7 00000004:00100000:3.0:1789635549.031004:0:17098:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789635549.031036:0:17098:0:(import.c:65:import_set_state_nolock()) ffff8d054c119800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789635549.031086:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876568427406336:12345-0@lo:38:llog_process_th.0 Request processed in 143us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635549.031094:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789635549.031133:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d05759d2a00 x1876568427406336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789635559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635549.031144:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789635549.031151:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1789635549.031157:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789635549.031161:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789635549.031163:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d0447b18000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789635549.031170:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d05759d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1876568427406336:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789635549.031188:0:19429:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789635549.032529:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789635549.032534:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789635549.032537:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d057604f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1789635549.033697:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427406464:0@lo:400:kworker.0 00000100:00100000:3.0:1789635549.033765:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635549.033822:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789635549.033832:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427406592:0@lo:400:kworker.0 00000100:00100000:3.0:1789635549.033860:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635549.033924:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427406464 00000100:00100000:3.0:1789635549.033932:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427406464 00000100:00100000:3.0:1789635549.033978:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789635549.033988:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427406464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635549.034046:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427406464:12345-0@lo:400:kworker.0 Request processed in 59us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635549.034053:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789635549.034077:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427406592 00000100:00100000:3.0:1789635549.034081:0:18604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427406592 00000100:00100000:3.0:1789635549.034118:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789635549.034124:0:18604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427406592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635549.034161:0:18604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427406592:12345-0@lo:400:kworker.0 Request processed in 37us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635549.034167:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789635549.034187:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789635549.034219:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427406592:0@lo:400:kworker.0 00000100:00100000:3.0:1789635549.034247:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427406464:0@lo:400:kworker.0 00000100:00080000:0.0:1789635549.034315:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 566 00000100:00080000:0.0:1789635549.034320:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1789635549.034329:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d057604f000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1789635549.034358:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0448599880 x1876568427406720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789635549.034427:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789635549.034431:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789635549.034434:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d057b5c7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789635549.034437:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 566 00000100:00080000:0.0:1789635549.034440:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789635549.034445:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d057b5c7800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1789635549.034469:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d04459eb100 x1876568427407232/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789635549.035692:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876568427407360:0@lo:400:kworker.0 00000100:00100000:2.0:1789635549.035750:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635549.035795:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789635549.035802:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876568427406848:0@lo:400:kworker.0 00000100:00100000:2.0:1789635549.035824:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635549.035845:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1876568427407488:0@lo:400:kworker.0 00000100:00100000:2.0:1789635549.035866:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635549.035898:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427407360 00000100:00100000:2.0:1789635549.035904:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427407360 00000100:00100000:2.0:1789635549.035939:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427406848 00000100:00100000:2.0:1789635549.035942:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427406848 00000100:00100000:2.0:1789635549.035952:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427407488 00000100:00100000:2.0:1789635549.035954:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427407488 00000100:00100000:2.0:1789635549.035988:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789635549.035995:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876568427407360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635549.036046:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876568427407360:12345-0@lo:400:kworker.0 Request processed in 50us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635549.036053:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789635549.036069:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789635549.036075:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876568427406848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635549.036101:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876568427406848:12345-0@lo:400:kworker.0 Request processed in 27us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635549.036107:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789635549.036117:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789635549.036123:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876568427407488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635549.036146:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876568427407488:12345-0@lo:400:kworker.0 Request processed in 23us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635549.036150:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1789635549.036181:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0448598e00 x1876568427406848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635549.036194:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876568427406848:0@lo:400:kworker.0 00010000:00080000:2.0:1789635549.036206:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d04459e8e00 x1876568427407488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635549.036214:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1876568427407488:0@lo:400:kworker.0 00010000:00080000:2.0:1789635549.036223:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d04459e8a80 x1876568427407360/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635549.036231:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876568427407360:0@lo:400:kworker.0 00000100:00100000:3.0:1789635549.038905:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427406976:0@lo:400:kworker.0 00000100:00100000:3.0:1789635549.038972:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635549.039006:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1876568427407616:0@lo:400:kworker.0 00000100:00100000:3.0:1789635549.039030:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635549.039066:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789635549.039073:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427407104:0@lo:400:kworker.0 00000100:00100000:3.0:1789635549.039098:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635549.039129:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427406976 00000100:00100000:3.0:1789635549.039136:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427406976 00000100:00100000:3.0:1789635549.039189:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789635549.039198:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427406976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635549.039255:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427406976:12345-0@lo:400:kworker.0 Request processed in 57us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635549.039263:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789635549.039286:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427407104 00000100:00100000:3.0:1789635549.039290:0:18603:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427407104 00000100:00100000:3.0:1789635549.039321:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789635549.039329:0:18603:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427407104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635549.039362:0:18603:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427407104:12345-0@lo:400:kworker.0 Request processed in 34us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635549.039368:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789635549.039389:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789635549.039394:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635549.039415:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427406720:0@lo:8:kworker.0 00000100:00100000:3.0:1789635549.039442:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635549.039473:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1876568427407232:0@lo:8:kworker.0 00000100:00100000:3.0:1789635549.039497:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635549.039524:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427406720 00000100:00100000:3.0:1789635549.039528:0:18696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427406720 00000100:00100000:3.0:1789635549.039953:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427407232 00000100:00100000:3.0:1789635549.039958:0:18696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427407232 00000100:00100000:3.0:1789635549.039977:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789635549.039982:0:18696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3639:x1876568427406720:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1789635549.040049:0:18696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3639:x1876568427406720:12345-0@lo:8:kworker.0 Request processed in 65us (606us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789635549.040056:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789635549.040069:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789635549.040079:0:18696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044791a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3639:x1876568427407232:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1789635549.040111:0:18696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044791a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3639:x1876568427407232:12345-0@lo:8:kworker.0 Request processed in 32us (613us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789635549.040117:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789635549.040885:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427407616 00000100:00100000:2.0:1789635549.040892:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427407616 00000100:00100000:2.0:1789635549.040940:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789635549.040949:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876568427407616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635549.040994:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876568427407616:12345-0@lo:400:kworker.0 Request processed in 47us (1963us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635549.041000:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789635549.041714:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427407104:0@lo:400:kworker.0 00000100:00100000:2.0:1789635549.041730:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427406976:0@lo:400:kworker.0 00010000:00080000:2.0:1789635549.041745:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d04459ea300 x1876568427407616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635549.041769:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1876568427407616:0@lo:400:kworker.0 00000020:01000004:2.0:1789635549.042069:0:19429:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789635549.042082:0:19429:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8d057ae48000) 00000020:00000080:2.0:1789635549.042295:0:19429:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1789635549.042395:0:19429:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d04410af800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789635549.042399:0:19429:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d04410af800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789635549.042401:0:19429:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d04410af800 3 00010000:00080000:2.0:1789635549.042428:0:19429:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d054580c800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.120@tcp at head 00000100:00080000:3.0:1789635549.044067:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789635549.045401:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789635549.045413:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d057604f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789635549.045420:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789635549.045425:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427406720:0@lo:8:kworker.0 00000100:00100000:3.0:1789635549.045439:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789635549.045442:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d057b5c7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789635549.045445:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789635549.045449:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1876568427407232:0@lo:8:kworker.0 00010000:00010000:3.0:1789635549.053475:0:19429:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1789635549.053736:0:19429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1789635549.053970:0:19429:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789635549.053985:0:19429:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xb0c3a59caa410405 00000100:00080000:3.0:1789635549.053996:0:19429:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789635549.054008:0:19429:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8d054580c800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1789635549.054043:0:19429:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d044791a300 x1876568427407744/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789635549.054077:0:19429:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789635549.056387:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044791a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3639:1876568427407744:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789635549.056474:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635549.056882:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427407744 00000100:00100000:3.0:1789635549.056891:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427407744 00000100:00100000:3.0:1789635549.056932:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789635549.056940:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1876568427407744:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789635549.056977:0:17097:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 567 last 0 00000020:00000080:3.0:1789635549.057008:0:17097:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xb0c3a59caa41040c 00000004:00100000:3.0:1789635549.057023:0:17097:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789635549.057058:0:17097:0:(import.c:65:import_set_state_nolock()) ffff8d057b952000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789635549.057668:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876568427407744:12345-0@lo:38:llog_process_th.0 Request processed in 725us (1204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635549.057677:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789635549.057741:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d044791a300 x1876568427407744/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789635559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635549.057751:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789635549.057833:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1789635549.057841:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789635549.057846:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789635549.057849:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d054580c800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789635549.057855:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044791a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3639:1876568427407744:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1789635549.057967:0:19429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1789635549.058016:0:19415:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789635549.058047:0:19415:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789635549.058059:0:19415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa4103db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4103e2 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635549.058069:0:19415:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e152000/0xb0c3a59caa4103db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4103e2 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789635549.058253:0:19415:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789635549.058255:0:19415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789635549.058261:0:19415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789635549.058262:0:19415:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789635549.058264:0:19415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789635549.058265:0:19415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789635549.058266:0:19415:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789635549.058268:0:19415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789635549.058269:0:19415:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789635549.058272:0:19415:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1789635549.058274:0:19415:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789635549.058275:0:19415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789635549.058276:0:19415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789635549.058277:0:19415:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789635549.058277:0:19415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789635549.058278:0:19415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789635549.058279:0:19415:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789635549.058280:0:19415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789635549.058281:0:19415:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789635549.058300:0:19415:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789635549.058316:0:19415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044791a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427407872:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789635549.058359:0:19415:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635549.058377:0:19415:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d057b5703c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635549.058529:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427407872 00000100:00100000:0.0:1789635549.058535:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427407872 00000100:00100000:0.0:1789635549.058582:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789635549.058590:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+24:19415:x1876568427407872:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789635549.058635:0:17091:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789635549.058648:0:17091:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789635549.063701:0:17091:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789635549.063723:0:17091:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789635549.064021:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+24:19415:x1876568427407872:12345-0@lo:253:mount.lustre.0 Request processed in 5427us (5655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635549.064032:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 20000000:01000000:3.0:1789635549.064225:0:17112:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789635549.064230:0:17112:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789635549.064252:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d05488fe400/0xb0c3a59caa410413 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635549.064268:0:17112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0549f43a00/0xb0c3a59caa410387 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa410380 expref: 23 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635549.064276:0:17112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0549f42800/0xb0c3a59caa410395 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa41038e expref: 23 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635549.064283:0:17112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d05488fe400/0xb0c3a59caa410413 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635549.064325:0:17112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0549f42800/0xb0c3a59caa410395 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa41038e expref: 23 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635549.064351:0:17112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d0549f42800/0xb0c3a59caa410395 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa41038e expref: 23 pid: 17090 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635549.064365:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447919180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17112:1876568427408000:0@lo:104: 00000100:00100000:3.0:1789635549.064403:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789635549.065980:0:17112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0549f43a00/0xb0c3a59caa410387 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa410380 expref: 23 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635549.065994:0:17112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d0549f43a00/0xb0c3a59caa410387 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa410380 expref: 23 pid: 17089 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635549.066007:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044791ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17112:1876568427408128:0@lo:104: 00000100:00100000:3.0:1789635549.066050:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635549.067683:0:19415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044791a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e3d8f284-7347-44bd-9697-6e3097b3c5ae:19415:1876568427407872:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789635549.067702:0:19415:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789635549.067706:0:19415:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789635549.067708:0:19415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789635549.067709:0:19415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789635549.067711:0:19415:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789635549.067712:0:19415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789635549.067720:0:19415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789635549.067721:0:19415:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789635549.067723:0:19415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789635549.067724:0:19415:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789635549.067740:0:19415:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789635549.071683:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427408000 00000100:00100000:0.0:1789635549.071697:0:17079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427408000 00000100:00100000:0.0:1789635549.071754:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427408128 00000100:00100000:0.0:1789635549.071757:0:17079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427408128 00000100:00100000:0.0:1789635549.071773:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789635549.071792:0:17079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447919f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+4:17112:x1876568427408000:12345-0@lo:104: 00010000:00010000:0.0:1789635549.071812:0:17079:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d05488fea00/0xb0c3a59caa41038e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa410395 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635549.071902:0:17079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789635549.071909:0:17079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447919f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+4:17112:x1876568427408000:12345-0@lo:104: Request processed in 119us (7505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635549.071916:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789635549.071997:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789635549.072004:0:17079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447919500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+3:17112:x1876568427408128:12345-0@lo:104: 00010000:00010000:0.0:1789635549.072012:0:17079:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d05488ffe00/0xb0c3a59caa410380 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa410387 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635549.072047:0:17079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789635549.072051:0:17079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447919500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+3:17112:x1876568427408128:12345-0@lo:104: Request processed in 49us (6003us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635549.072057:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1789635549.072079:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789635549.072085:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d05488fea00/0xb0c3a59caa41038e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa410395 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635549.072092:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488fea00 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:0.0:1789635549.072096:0:17085:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d05488fea00/0xb0c3a59caa41038e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa410395 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635549.072104:0:17085:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d05488fea00/0xb0c3a59caa41038e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa410395 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789635549.072111:0:17085:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d05488fea00/0xb0c3a59caa41038e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa410395 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635549.072123:0:17085:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789635549.072159:0:17085:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d05488fea00/0xb0c3a59caa41038e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa410395 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635549.072165:0:17085:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789635549.072303:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d05488fea00/0xb0c3a59caa41038e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa410395 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635549.072312:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d05488fea00/0xb0c3a59caa41038e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa410395 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635549.072327:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635549.072331:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d05488ffe00/0xb0c3a59caa410380 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa410387 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635549.072337:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488ffe00 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:0.0:1789635549.072340:0:17085:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d05488ffe00/0xb0c3a59caa410380 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa410387 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635549.072347:0:17085:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d05488ffe00/0xb0c3a59caa410380 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa410387 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789635549.072354:0:17085:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d05488ffe00/0xb0c3a59caa410380 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa410387 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635549.072358:0:17085:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789635549.072372:0:17085:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d05488ffe00/0xb0c3a59caa410380 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa410387 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635549.072378:0:17085:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789635549.072400:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d05488ffe00/0xb0c3a59caa410380 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa410387 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635549.072408:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d05488ffe00/0xb0c3a59caa410380 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa410387 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635549.072423:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635549.072425:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635549.072427:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635549.072443:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789635549.072470:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3640:1876568427408256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789635549.072512:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635549.072562:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3642:1876568427408384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789635549.072586:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635549.072637:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427408256 00000100:00100000:0.0:1789635549.072642:0:17081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427408256 00010000:00010000:0.0:1789635549.072662:0:17081:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0549f42800/0xb0c3a59caa410395 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa41038e expref: 24 pid: 17090 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635549.072685:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427408384 00000100:00100000:0.0:1789635549.072689:0:17081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427408384 00010000:00010000:0.0:1789635549.072700:0:17081:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0549f43a00/0xb0c3a59caa410387 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa410380 expref: 25 pid: 17089 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635549.072715:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789635549.072722:0:17081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+25:3640:x1876568427408256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789635549.072732:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635549.072737:0:17081:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0549f42800/0xb0c3a59caa410395 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa41038e expref: 25 pid: 17090 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635549.072760:0:17081:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0549f42800/0xb0c3a59caa410395 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa41038e expref: 25 pid: 17090 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635549.072778:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635549.072811:0:17081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+25:3640:x1876568427408256:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635549.072819:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789635549.072834:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789635549.072842:0:17081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+24:3642:x1876568427408384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789635549.072851:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635549.072856:0:17081:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0549f43a00/0xb0c3a59caa410387 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa410380 expref: 24 pid: 17089 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635549.072866:0:17081:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0549f43a00/0xb0c3a59caa410387 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa410380 expref: 24 pid: 17089 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635549.072879:0:17081:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d05488fe400/0xb0c3a59caa410413 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635549.072887:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d05488fe400/0xb0c3a59caa410413 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789635549.072902:0:17081:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015693848s 00010000:00010000:0.0:1789635549.072908:0:17081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d05488fe400/0xb0c3a59caa410413 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635549.072916:0:17081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d05488fe400/0xb0c3a59caa410413 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635549.073067:0:17081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d05488fe400/0xb0c3a59caa410413 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635549.073074:0:17081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d05488fe400/0xb0c3a59caa410413 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635549.073080:0:17081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488fe400 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:0.0:1789635549.073085:0:17081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d05488fe400/0xb0c3a59caa410413 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635549.073093:0:17081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d05488fe400/0xb0c3a59caa410413 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635549.073107:0:17081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d05488fe400/0xb0c3a59caa410413 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635549.073117:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635549.073158:0:17081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+24:3642:x1876568427408384:12345-0@lo:103:ldlm_bl.0 Request processed in 318us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635549.073165:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789635549.073207:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3640:1876568427408256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789635549.073301:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3642:1876568427408384:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789635549.074111:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635549.076218:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0544f0a900 going to sleep for 11 seconds 00010000:00010000:3.0:1789635549.076256:0:17112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0549f42800/0xb0c3a59caa410395 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa41038e expref: 23 pid: 17090 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635549.076271:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447919180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17112:1876568427408000:0@lo:104: 00010000:00010000:3.0:1789635549.076282:0:17112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0549f43a00/0xb0c3a59caa410387 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa410380 expref: 22 pid: 17089 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635549.076289:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044791ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17112:1876568427408128:0@lo:104: 00010000:00010000:3.0:1789635549.076316:0:17112:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d05488fe400/0xb0c3a59caa410413 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635549.076326:0:17112:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d05488fe400/0xb0c3a59caa410413 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635549.076354:0:17112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d05488fe400/0xb0c3a59caa410413 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635549.076361:0:17112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d05488fe400/0xb0c3a59caa410413 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1789635549.083519:0:19415:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1789635549.087869:0:19415:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789635549.087878:0:19415:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789635549.087917:0:19415:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789635549.087965:0:19415:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.120@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789635549.087981:0:19415:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1789635549.088010:0:19415:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1789635549.089025:0:19415:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789635549.089407:0:19415:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789635549.219741:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789635549.876215:0:19483:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789635549.876449:0:19483:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1789635550.115778:0:17094:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789635550.115784:0:17094:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d0550104800 from 10 10000000:01000000:2.0:1789635550.115789:0:17094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789635550.115834:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3c00/0xb0c3a59caa41041a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635550.115846:0:17094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3c00/0xb0c3a59caa41041a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635550.115857:0:17094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3c00/0xb0c3a59caa41041a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635550.115883:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427408512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789635550.115948:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635550.115990:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05655b9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635550.116070:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427408512 00000100:00100000:3.0:1789635550.116079:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427408512 00000100:00100000:3.0:1789635550.116125:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789635550.116134:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+22:17094:x1876568427408512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789635550.116146:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635550.116157:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d05488fe400/0xb0c3a59caa410421 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa41041a expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635550.116179:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d05488fe400/0xb0c3a59caa410421 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa41041a expref: 23 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635550.116189:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d05488fe400/0xb0c3a59caa410421 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa41041a expref: 23 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635550.116198:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05488fe400, rc 0) 00000100:00100000:3.0:1789635550.116290:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+23:17094:x1876568427408512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635550.116297:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789635550.117359:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427408512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635550.117379:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3c00/0xb0c3a59caa41041a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410421 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635550.117391:0:17094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3c00/0xb0c3a59caa41041a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa410421 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635550.117849:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427408640:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789635550.117901:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635550.117982:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05655b9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635550.119272:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427408640 00000100:00100000:0.0:1789635550.119284:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427408640 00000100:00100000:0.0:1789635550.119332:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789635550.119341:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+23:17094:x1876568427408640:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789635550.119364:0:17091:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789635550.119383:0:17091:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789635550.119387:0:17091:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1789635550.119508:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+23:17094:x1876568427408640:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 167us (1606us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635550.119516:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789635550.119699:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427408640:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789635550.119771:0:17094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789635550.119780:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3c00/0xb0c3a59caa41041a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410421 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635550.119791:0:17094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3c00/0xb0c3a59caa41041a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa410421 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635550.119802:0:17094:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789635550.119804:0:17094:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d054b800800 from 10 10000000:01000000:1.0:1789635550.119808:0:17094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789635550.119837:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05820d3a00/0xb0c3a59caa410428 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635550.119846:0:17094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d05820d3a00/0xb0c3a59caa410428 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635550.119855:0:17094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d05820d3a00/0xb0c3a59caa410428 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635550.119871:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427408768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789635550.119899:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635550.119923:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0545287180 going to sleep for 11 seconds 00000100:00100000:0.0:1789635550.119972:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427408768 00000100:00100000:0.0:1789635550.119977:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427408768 00000100:00100000:0.0:1789635550.120006:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789635550.120012:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+23:17094:x1876568427408768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789635550.120021:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635550.120032:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0549f43400/0xb0c3a59caa41042f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa410428 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635550.120051:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0549f43400/0xb0c3a59caa41042f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa410428 expref: 24 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635550.120062:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0549f43400/0xb0c3a59caa41042f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa410428 expref: 24 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635550.120070:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0549f43400, rc 0) 00000100:00100000:0.0:1789635550.120104:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+24:17094:x1876568427408768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635550.120110:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789635550.120181:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427408768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635550.120198:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d05820d3a00/0xb0c3a59caa410428 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa41042f expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635550.120207:0:17094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d05820d3a00/0xb0c3a59caa410428 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa41042f expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635550.120244:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427408896:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789635550.120270:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635550.120291:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05655b9540 going to sleep for 11 seconds 00000100:00100000:0.0:1789635550.120410:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427408896 00000100:00100000:0.0:1789635550.120414:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427408896 00000100:00100000:0.0:1789635550.120444:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789635550.120459:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+24:17094:x1876568427408896:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789635550.120471:0:17090:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789635550.120485:0:17090:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789635550.120487:0:17090:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1789635550.120697:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+24:17094:x1876568427408896:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 246us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635550.120704:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789635550.120770:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427408896:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789635550.120816:0:17094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789635550.120822:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05820d3a00/0xb0c3a59caa410428 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa41042f expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635550.120830:0:17094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d05820d3a00/0xb0c3a59caa410428 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa41042f expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635550.243688:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635551.269546:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635551.653202:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789635551.653226:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427409024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635551.653332:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635551.653452:0:18607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427409024 00000100:00100000:1.0:1789635551.653460:0:18607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427409024 00000100:00100000:1.0:1789635551.653530:0:18607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789635551.653541:0:18607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427409024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789635551.653569:0:18607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789635551.653640:0:18607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427409024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635551.653647:0:18607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789635551.653700:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427409024:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789635551.653821:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789635552.291724:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789635552.613057:0:17130:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789635552.681789:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789635552.681810:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427409152:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789635552.681878:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635552.681936:0:18607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427409152 00000100:00100000:0.0:1789635552.681944:0:18607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427409152 00000100:00100000:0.0:1789635552.681996:0:18607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789635552.682006:0:18607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427409152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789635552.682028:0:18607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789635552.682069:0:18607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427409152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635552.682085:0:18607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789635552.682105:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789635552.682139:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427409152:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789635553.187802:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789635553.187825:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427409280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789635553.188058:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635553.188176:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789635553.188185:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044791ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427409408:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789635553.188649:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635553.200612:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427409280 00000100:00100000:2.0:1789635553.200630:0:18189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427409280 00000100:00100000:2.0:1789635553.200701:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427409408 00000100:00100000:2.0:1789635553.200705:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427409408 00000100:00100000:2.0:1789635553.200728:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789635553.200738:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427409280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789635553.200775:0:17101:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789635553.200896:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427409280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 158us (12837us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635553.200904:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789635553.200930:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789635553.200936:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427409408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789635553.200954:0:17101:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789635553.201005:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427409408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (12356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635553.201011:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789635553.201061:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427409280:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789635553.201106:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044791ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427409408:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789635553.317774:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789635554.084260:0:17847:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1789635554.218153:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789635554.218159:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789635554.218162:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d057604f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789635554.218178:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d057604f000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1789635554.219062:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3643:1876568427409536:0@lo:400:kworker.0 00000100:00100000:2.0:1789635554.219128:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635554.219189:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427409664:0@lo:400:kworker.0 00000100:00100000:0.0:1789635554.219391:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427409792:0@lo:400:kworker.0 00000100:00100000:0.0:1789635554.219440:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635554.219478:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427409792 00000100:00100000:0.0:1789635554.219486:0:18696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427409792 00000100:00100000:0.0:1789635554.219543:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789635554.219551:0:18696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427409792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635554.219618:0:18696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427409792:12345-0@lo:400:kworker.0 Request processed in 67us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635554.219624:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789635554.220314:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789635554.220362:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789635554.220401:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427409792:0@lo:400:kworker.0 00000100:00100000:1.0:1789635554.220485:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0546df0380 x1876568427409920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789635554.220548:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789635554.220552:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789635554.220555:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d057b5c7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789635554.220563:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d057b5c7800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1789635554.220578:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0546df1f80 x1876568427410432/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789635554.221067:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427409536 00000100:00100000:2.0:1789635554.221074:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427409536 00000100:00100000:2.0:1789635554.221113:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789635554.221121:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+24:3643:x1876568427409536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635554.221167:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+24:3643:x1876568427409536:12345-0@lo:400:kworker.0 Request processed in 47us (2039us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635554.221174:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789635554.222057:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427409920:0@lo:8:kworker.0 00000100:00100000:0.0:1789635554.222101:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635554.222128:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1876568427410432:0@lo:8:kworker.0 00000100:00100000:0.0:1789635554.222150:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635554.222285:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876568427410048:0@lo:400:kworker.0 00000100:00100000:1.0:1789635554.222324:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635554.222343:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1876568427410688:0@lo:400:kworker.0 00000100:00100000:1.0:1789635554.222361:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635554.222381:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789635554.222386:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427410176:0@lo:400:kworker.0 00000100:00100000:1.0:1789635554.222405:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635554.222431:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427410816:0@lo:400:kworker.0 00000100:00100000:1.0:1789635554.222452:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635554.222481:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427409920 00000100:00100000:1.0:1789635554.222487:0:18603:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427409920 00000100:00100000:1.0:1789635554.222509:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427410432 00000100:00100000:1.0:1789635554.222512:0:18603:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427410432 00000100:00100000:1.0:1789635554.222527:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789635554.222532:0:18603:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3639:x1876568427409920:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789635554.222561:0:18603:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 572 last 0 00000020:00000080:1.0:1789635554.222587:0:18603:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb0c3a59caa410436 00002000:00100000:1.0:1789635554.222616:0:18603:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d0447792000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789635554.222621:0:18603:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789635554.222623:0:18603:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1789635554.222749:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427409664 00000100:00100000:2.0:1789635554.222754:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427409664 00000100:00100000:2.0:1789635554.222781:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427410176 00000100:00100000:2.0:1789635554.222784:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427410176 00000100:00100000:2.0:1789635554.222795:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789635554.222802:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427409664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635554.222847:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427409664:12345-0@lo:400:kworker.0 Request processed in 46us (2535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635554.222862:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789635554.222877:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789635554.222882:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427410176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635554.222918:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427410176:12345-0@lo:400:kworker.0 Request processed in 36us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635554.222924:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789635554.223467:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427410048 00000100:00100000:0.0:1789635554.223473:0:17848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427410048 00000100:00100000:0.0:1789635554.223505:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427410688 00000100:00100000:0.0:1789635554.223508:0:17848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427410688 00000100:00100000:0.0:1789635554.223532:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427410816 00000100:00100000:0.0:1789635554.223534:0:17848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427410816 00000100:00100000:0.0:1789635554.223561:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789635554.223568:0:17848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876568427410048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635554.225816:0:17848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876568427410048:12345-0@lo:400:kworker.0 Request processed in 2243us (3485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635554.225830:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789635554.225858:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789635554.225870:0:17848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876568427410688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635554.225922:0:17848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876568427410688:12345-0@lo:400:kworker.0 Request processed in 56us (3559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635554.225927:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00002000:00080000:1.0:1789635554.227086:0:18603:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789635554.227123:0:18603:0:(import.c:65:import_set_state_nolock()) ffff8d0447790000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789635554.227399:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3643:1876568427409536:0@lo:400:kworker.0 00000100:00100000:2.0:1789635554.227454:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427410304:0@lo:400:kworker.0 00000100:00100000:2.0:1789635554.227493:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635554.227512:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427410944:0@lo:400:kworker.0 00000100:00100000:2.0:1789635554.227539:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635554.227558:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427409664:0@lo:400:kworker.0 00000100:00100000:2.0:1789635554.227571:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789635554.227577:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427410560:0@lo:400:kworker.0 00000100:00100000:2.0:1789635554.227757:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635554.227779:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1876568427411072:0@lo:400:kworker.0 00000100:00100000:2.0:1789635554.227805:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635554.227884:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427410944 00000100:00100000:2.0:1789635554.227891:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427410944 00000100:00100000:2.0:1789635554.227924:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427410560 00000100:00100000:2.0:1789635554.227927:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427410560 00000100:00100000:0.0:1789635554.228096:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427411072 00000100:00100000:0.0:1789635554.228101:0:17848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427411072 00000100:00100000:0.0:1789635554.228126:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789635554.228135:0:17848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427410816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635554.228179:0:17848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427410816:12345-0@lo:400:kworker.0 Request processed in 45us (5724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635554.228185:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789635554.228283:0:18603:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1876568427409920:12345-0@lo:8:kworker.0 Request processed in 4663us (5095us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635554.228293:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789635554.228317:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427410304 00000100:00100000:1.0:1789635554.228320:0:18603:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427410304 00000100:00100000:1.0:1789635554.228342:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789635554.228359:0:18603:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427410304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635554.228400:0:18603:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427410304:12345-0@lo:400:kworker.0 Request processed in 41us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635554.228406:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789635554.228430:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789635554.228435:0:18603:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3639:x1876568427410432:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789635554.228459:0:18603:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 572 last 0 00000020:00000080:1.0:1789635554.228482:0:18603:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb0c3a59caa41043d 00002000:00100000:1.0:1789635554.228496:0:18603:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8d0447794000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1789635554.228500:0:18603:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1789635554.228503:0:18603:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789635554.228557:0:18603:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1789635554.228575:0:18603:0:(import.c:65:import_set_state_nolock()) ffff8d0447793800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789635554.228623:0:18603:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3639:x1876568427410432:12345-0@lo:8:kworker.0 Request processed in 186us (6472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635554.228630:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789635554.228652:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789635554.228659:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427410944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635554.228688:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427410944:12345-0@lo:400:kworker.0 Request processed in 30us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635554.228693:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789635554.228706:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789635554.228712:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876568427411072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635554.228735:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876568427411072:12345-0@lo:400:kworker.0 Request processed in 25us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635554.228762:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1789635554.228800:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0546df3100 x1876568427411072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635554.228812:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1876568427411072:0@lo:400:kworker.0 00000100:00100000:1.0:1789635554.228823:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427410304:0@lo:400:kworker.0 00010000:00080000:1.0:1789635554.228834:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0546df3800 x1876568427410944/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635554.228842:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427410944:0@lo:400:kworker.0 00010000:00080000:1.0:1789635554.228879:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0546df0380 x1876568427409920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789635579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789635554.228891:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789635554.228898:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789635554.228903:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789635554.228906:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d057604f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789635554.228927:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789635554.228932:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1876568427409920:0@lo:8:kworker.0 00000004:00080000:0.0:1789635554.229329:0:17123:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1789635554.229348:0:17123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17123:1876568427411328:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789635554.229393:0:17123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635554.229414:0:17123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05461e8c00 going to sleep for 11 seconds 00000100:00080000:0.0:1789635554.229437:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789635554.229441:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789635554.229443:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635554.229478:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427411328 00000100:00100000:0.0:1789635554.229483:0:18603:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427411328 00000100:00100000:0.0:1789635554.229512:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789635554.229526:0:18603:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17123:x1876568427411328:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:0.0:1789635554.229789:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789635554.230363:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789635554.230374:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427410560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635554.230447:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427410560:12345-0@lo:400:kworker.0 Request processed in 77us (2850us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635554.230461:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000004:00080000:3.0:1789635554.230745:0:17122:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789635554.230841:0:17122:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572914244346ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789635554.230847:0:17122:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00080000:1.0:1789635554.231500:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0546df1f80 x1876568427410432/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789635579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789635554.231518:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1789635554.231526:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789635554.231532:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789635554.231535:0:3639:0:(import.c:65:import_set_state_nolock()) ffff8d057b5c7800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789635554.231549:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789635554.231562:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1876568427410432:0@lo:8:kworker.0 00000004:00080000:1.0:1789635554.231611:0:17838:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789635554.232138:0:17839:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789635554.232159:0:17839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459eb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17839:1876568427411584:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1789635554.232296:0:17838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 572915698737ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789635554.232303:0:17838:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1789635554.233177:0:17839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635554.233815:0:17839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05461e8600 going to sleep for 11 seconds 00010000:00080000:3.0:1789635554.235186:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0546df2a00 x1876568427410560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635554.235490:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427411584 00000100:00100000:1.0:1789635554.235499:0:18696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427411584 00000100:00100000:1.0:1789635554.235553:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789635554.235562:0:18696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17839:x1876568427411584:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:1.0:1789635554.235636:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789635554.237009:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427410560:0@lo:400:kworker.0 00000100:00100000:3.0:1789635554.237049:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427411456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789635554.237114:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635554.237148:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789635554.237155:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427411200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789635554.237178:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635554.238061:0:18607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427411456 00000100:00100000:2.0:1789635554.238072:0:18607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427411456 00000100:00100000:2.0:1789635554.238107:0:18607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427411200 00000100:00100000:2.0:1789635554.238110:0:18607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427411200 00000100:00100000:2.0:1789635554.238126:0:18607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789635554.238134:0:18607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3643:x1876568427411456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789635554.238163:0:18607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789635554.239076:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427410176:0@lo:400:kworker.0 00010000:00080000:3.0:1789635554.239094:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0546df1500 x1876568427410816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635554.239106:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427410816:0@lo:400:kworker.0 00010000:00080000:3.0:1789635554.239120:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0546df0e00 x1876568427410048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635554.239128:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876568427410048:0@lo:400:kworker.0 00010000:00080000:3.0:1789635554.239138:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0546df1180 x1876568427410688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635554.239146:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1876568427410688:0@lo:400:kworker.0 00000004:00080000:1.0:1789635554.240069:0:17076:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1789635554.240415:0:18607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3643:x1876568427411456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2278us (3297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635554.240437:0:18607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789635554.241078:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04459e9180 x1876568427411456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635570 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635554.241101:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427411456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789635554.241180:0:18607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789635554.241193:0:18607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044791bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1876568427411200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789635554.241348:0:18607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789635554.241437:0:18607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044791bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1876568427411200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 249us (4258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635554.241443:0:18607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789635554.241558:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04459e8380 x1876568427411200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635570 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635554.241574:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427411200:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1789635554.252130:0:17828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:1.0:1789635554.254663:0:18603:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1789635554.254674:0:18603:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1789635554.254681:0:18603:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00002000:00080000:3.0:1789635554.265015:0:18696:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1789635554.265024:0:18696:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789635554.265121:0:18696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17839:x1876568427411584:12345-0@lo:7:osp-pre-1-1.0 Request processed in 29556us (31942us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635554.265131:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1789635554.265230:0:17839:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04459eb100 x1876568427411584/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789635570 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635554.265246:0:17839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459eb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17839:1876568427411584:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1789635554.265261:0:17839:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1789635554.265305:0:17839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447ac0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17839:1876568427411712:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1789635554.265356:0:17839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635554.265388:0:17839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05452873c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635554.265483:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427411712 00000100:00100000:3.0:1789635554.265491:0:18602:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427411712 00000100:00100000:3.0:1789635554.265547:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789635554.265556:0:18602:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17839:x1876568427411712:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1789635554.265582:0:18602:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1789635554.265636:0:18602:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17839:x1876568427411712:12345-0@lo:5:osp-pre-1-1.0 Request processed in 81us (279us total) trans 0 rc 0/0 00010000:00080000:2.0:1789635554.265761:0:17839:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447ac0380 x1876568427411712/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789635570 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635554.265771:0:17839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447ac0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17839:1876568427411712:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1789635554.265781:0:17839:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1789635554.265805:0:17839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448598e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17839:1876568427411840:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1789635554.265827:0:17839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635554.265855:0:17839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05452873c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635554.265869:0:18604:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1789635554.265876:0:18604:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1789635554.265961:0:18696:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1789635554.265967:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427411840 00000100:00100000:2.0:1789635554.265971:0:18696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427411840 00000100:00100000:2.0:1789635554.266065:0:19724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789635554.266072:0:19724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+7:17839:x1876568427411840:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1789635554.266096:0:19724:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00000100:00100000:3.0:1789635554.266291:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00002000:00010000:2.0:1789635554.275273:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789635554.275283:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068239b60/0xb0c3a59caa410444 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.275300:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=572s v=(0 0) 00010000:00010000:2.0:1789635554.275304:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635554.275310:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068239b60/0xb0c3a59caa410444 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.275327:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068239b60/0xb0c3a59caa410444 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.275337:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068239b60/0xb0c3a59caa410444 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.275345:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068239b60/0xb0c3a59caa410444 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.275365:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789635554.275382:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635554.275388:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068239b60/0xb0c3a59caa410444 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.275396:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a2200 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635554.275401:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068239b60/0xb0c3a59caa410444 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.275411:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068239b60/0xb0c3a59caa410444 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.276112:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068239b60/0xb0c3a59caa410444 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.276121:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068239b60/0xb0c3a59caa410444 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.276150:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635554.276153:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635554.276154:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789635554.278475:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789635554.278487:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da721a8f/0xb0c3a59caa41044b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.278504:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=572s v=(0 0) 00010000:00010000:2.0:1789635554.278509:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635554.278515:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da721a8f/0xb0c3a59caa41044b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.278541:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da721a8f/0xb0c3a59caa41044b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.278551:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da721a8f/0xb0c3a59caa41044b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.278559:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da721a8f/0xb0c3a59caa41044b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.278587:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789635554.278627:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635554.278634:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da721a8f/0xb0c3a59caa41044b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.278711:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a2400 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:3.0:1789635554.278715:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da721a8f/0xb0c3a59caa41044b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.278725:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da721a8f/0xb0c3a59caa41044b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.278745:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da721a8f/0xb0c3a59caa41044b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.278759:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da721a8f/0xb0c3a59caa41044b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.278787:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635554.278789:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635554.278791:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789635554.279191:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789635554.279355:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000deaab9c2/0xb0c3a59caa410452 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.279365:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=572s v=(0 0) 00010000:00010000:2.0:1789635554.279368:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635554.279373:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000deaab9c2/0xb0c3a59caa410452 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.279382:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000deaab9c2/0xb0c3a59caa410452 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.279391:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000deaab9c2/0xb0c3a59caa410452 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.279409:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000deaab9c2/0xb0c3a59caa410452 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.279441:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789635554.279562:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635554.279568:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000deaab9c2/0xb0c3a59caa410452 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.279576:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3e00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:3.0:1789635554.279580:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000deaab9c2/0xb0c3a59caa410452 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.279588:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000deaab9c2/0xb0c3a59caa410452 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.279636:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000deaab9c2/0xb0c3a59caa410452 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.279644:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000deaab9c2/0xb0c3a59caa410452 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.279659:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635554.279661:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635554.279663:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789635554.282726:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789635554.282737:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec6d8b51/0xb0c3a59caa410459 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.282755:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=572s v=(0 0) 00010000:00010000:3.0:1789635554.282760:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635554.282766:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec6d8b51/0xb0c3a59caa410459 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.282781:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec6d8b51/0xb0c3a59caa410459 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.282790:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec6d8b51/0xb0c3a59caa410459 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.282798:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec6d8b51/0xb0c3a59caa410459 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.282823:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789635554.282845:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635554.282852:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec6d8b51/0xb0c3a59caa410459 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.282860:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488ff000 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635554.282864:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec6d8b51/0xb0c3a59caa410459 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.282873:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec6d8b51/0xb0c3a59caa410459 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.282889:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec6d8b51/0xb0c3a59caa410459 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.282895:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec6d8b51/0xb0c3a59caa410459 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.282912:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635554.282914:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635554.282915:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789635554.283299:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789635554.283306:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089720be8/0xb0c3a59caa410460 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.283314:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=572s v=(0 0) 00010000:00010000:3.0:1789635554.283318:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635554.283323:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089720be8/0xb0c3a59caa410460 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.283344:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089720be8/0xb0c3a59caa410460 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.283352:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089720be8/0xb0c3a59caa410460 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.283360:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089720be8/0xb0c3a59caa410460 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.283790:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789635554.284021:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635554.284028:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089720be8/0xb0c3a59caa410460 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.284037:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488ff200 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:0.0:1789635554.284041:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089720be8/0xb0c3a59caa410460 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.284050:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089720be8/0xb0c3a59caa410460 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.284066:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089720be8/0xb0c3a59caa410460 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.284073:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089720be8/0xb0c3a59caa410460 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.284089:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635554.284091:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635554.284093:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789635554.284303:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789635554.284309:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbb79571/0xb0c3a59caa410467 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.284318:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=572s v=(0 0) 00010000:00010000:3.0:1789635554.284322:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635554.284327:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbb79571/0xb0c3a59caa410467 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.284336:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fbb79571/0xb0c3a59caa410467 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.284344:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbb79571/0xb0c3a59caa410467 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.284362:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fbb79571/0xb0c3a59caa410467 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.285076:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789635554.285670:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789635554.285678:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa41046e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.285689:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=572s v=(0 0) 00010000:00010000:3.0:1789635554.285694:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635554.285699:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa41046e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.285709:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa41046e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.285719:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa41046e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.285727:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa41046e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.286164:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789635554.286176:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fbb79571/0xb0c3a59caa410467 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.286186:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488ff800 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635554.286191:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbb79571/0xb0c3a59caa410467 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.286199:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbb79571/0xb0c3a59caa410467 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.286216:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fbb79571/0xb0c3a59caa410467 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.286224:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fbb79571/0xb0c3a59caa410467 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.286240:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635554.286244:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa41046e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.286250:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488ffe00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635554.286253:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa41046e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.286260:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa41046e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.286282:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa41046e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.286290:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635554.286292:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635554.286294:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635554.288069:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789635554.288082:0:18603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa41046e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.288316:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789635554.295487:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789635554.295555:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a29d02e8/0xb0c3a59caa410475 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.295573:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=572s v=(0 0) 00010000:00010000:3.0:1789635554.295578:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635554.295585:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a29d02e8/0xb0c3a59caa410475 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.297405:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a29d02e8/0xb0c3a59caa410475 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.297432:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a29d02e8/0xb0c3a59caa410475 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.297440:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a29d02e8/0xb0c3a59caa410475 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.297513:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789635554.304650:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635554.304663:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a29d02e8/0xb0c3a59caa410475 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.304676:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488fea00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635554.304682:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a29d02e8/0xb0c3a59caa410475 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.304692:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a29d02e8/0xb0c3a59caa410475 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.304713:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a29d02e8/0xb0c3a59caa410475 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.304721:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a29d02e8/0xb0c3a59caa410475 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635554.305628:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635554.305632:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635554.305634:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789635554.305711:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789635554.305720:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cc746e5/0xb0c3a59caa41047c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635554.305747:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789635554.305753:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635554.305759:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cc746e5/0xb0c3a59caa41047c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635554.305774:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cc746e5/0xb0c3a59caa41047c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635554.305784:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cc746e5/0xb0c3a59caa41047c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635554.305792:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cc746e5/0xb0c3a59caa41047c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635554.305816:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789635554.305838:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635554.305849:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cc746e5/0xb0c3a59caa41047c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.305857:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05820d3000 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:0.0:1789635554.305860:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cc746e5/0xb0c3a59caa41047c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.305868:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cc746e5/0xb0c3a59caa41047c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.305881:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cc746e5/0xb0c3a59caa41047c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.305887:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cc746e5/0xb0c3a59caa41047c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.305901:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635554.305903:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635554.305905:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789635554.308173:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789635554.308187:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa410483 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.308268:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=572s v=(0 0) 00010000:00010000:3.0:1789635554.308280:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635554.308286:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa410483 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.308299:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa410483 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.308309:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa410483 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.308315:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa410483 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.308339:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789635554.308915:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635554.308923:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa410483 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.308956:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488ffe00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635554.308960:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa410483 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.308980:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa410483 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.309284:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa410483 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.309292:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa410483 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.309315:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635554.309317:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635554.309319:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789635554.310676:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789635554.310686:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089720be8/0xb0c3a59caa41048a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.310700:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=572s v=(0 0) 00010000:00010000:3.0:1789635554.310705:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635554.310711:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089720be8/0xb0c3a59caa41048a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.310724:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089720be8/0xb0c3a59caa41048a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.310735:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089720be8/0xb0c3a59caa41048a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.310750:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089720be8/0xb0c3a59caa41048a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.310764:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789635554.310912:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635554.310918:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089720be8/0xb0c3a59caa41048a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.310927:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488ff200 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:0.0:1789635554.310931:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089720be8/0xb0c3a59caa41048a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.310950:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089720be8/0xb0c3a59caa41048a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.310966:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089720be8/0xb0c3a59caa41048a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.310973:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089720be8/0xb0c3a59caa41048a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.310989:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635554.310991:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635554.310992:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789635554.313335:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789635554.313346:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cc746e5/0xb0c3a59caa410491 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635554.313361:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789635554.313366:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635554.313371:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cc746e5/0xb0c3a59caa410491 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635554.313385:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cc746e5/0xb0c3a59caa410491 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635554.313408:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cc746e5/0xb0c3a59caa410491 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635554.313416:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cc746e5/0xb0c3a59caa410491 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635554.313493:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789635554.315703:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789635554.315713:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bbd5d5f/0xb0c3a59caa410498 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635554.315728:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789635554.315732:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635554.315738:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bbd5d5f/0xb0c3a59caa410498 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635554.315751:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bbd5d5f/0xb0c3a59caa410498 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635554.315761:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bbd5d5f/0xb0c3a59caa410498 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635554.315768:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bbd5d5f/0xb0c3a59caa410498 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.317385:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789635554.317396:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cc746e5/0xb0c3a59caa410491 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.317409:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05820d3000 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635554.317414:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cc746e5/0xb0c3a59caa410491 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.317438:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cc746e5/0xb0c3a59caa410491 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.317471:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cc746e5/0xb0c3a59caa410491 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.317554:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cc746e5/0xb0c3a59caa410491 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.317721:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635554.317848:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bbd5d5f/0xb0c3a59caa410498 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.317856:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05820d3600 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635554.317859:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bbd5d5f/0xb0c3a59caa410498 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.317867:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bbd5d5f/0xb0c3a59caa410498 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.317878:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bbd5d5f/0xb0c3a59caa410498 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.317886:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635554.317888:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635554.317890:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635554.321271:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789635554.321287:0:18603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bbd5d5f/0xb0c3a59caa410498 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789635554.322349:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789635554.322361:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbb79571/0xb0c3a59caa41049f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.322376:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=573s v=(0 0) 00010000:00010000:3.0:1789635554.322380:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635554.322387:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbb79571/0xb0c3a59caa41049f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.322402:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fbb79571/0xb0c3a59caa41049f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.322412:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbb79571/0xb0c3a59caa41049f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.322429:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fbb79571/0xb0c3a59caa41049f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.322454:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789635554.322586:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635554.322714:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fbb79571/0xb0c3a59caa41049f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.322868:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488ff800 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635554.322873:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbb79571/0xb0c3a59caa41049f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.322883:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbb79571/0xb0c3a59caa41049f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.322901:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fbb79571/0xb0c3a59caa41049f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.322909:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fbb79571/0xb0c3a59caa41049f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.322931:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635554.322933:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635554.322935:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789635554.323080:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789635554.323129:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec6d8b51/0xb0c3a59caa4104a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.323144:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=573s v=(0 0) 00010000:00010000:3.0:1789635554.323147:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635554.323151:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec6d8b51/0xb0c3a59caa4104a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.323160:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec6d8b51/0xb0c3a59caa4104a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.323167:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec6d8b51/0xb0c3a59caa4104a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.323174:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec6d8b51/0xb0c3a59caa4104a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.323184:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789635554.323469:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635554.323482:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635554.323487:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec6d8b51/0xb0c3a59caa4104a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.323495:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488ff000 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:0.0:1789635554.323498:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec6d8b51/0xb0c3a59caa4104a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.323506:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec6d8b51/0xb0c3a59caa4104a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.323519:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec6d8b51/0xb0c3a59caa4104a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.323533:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec6d8b51/0xb0c3a59caa4104a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.323548:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635554.323551:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635554.323553:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789635554.324403:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789635554.324413:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa4104ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.324434:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=573s v=(0 0) 00010000:00010000:3.0:1789635554.324439:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635554.324443:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa4104ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.324455:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa4104ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.324476:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa4104ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.324483:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa4104ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.324520:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789635554.324529:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635554.324537:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa4104ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.324547:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488ffe00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635554.324551:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa4104ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.324560:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa4104ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.324579:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa4104ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.324586:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa4104ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.324624:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635554.324626:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635554.324628:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789635554.327095:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789635554.327109:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000805cce2/0xb0c3a59caa4104b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.327125:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1789635554.327129:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635554.327135:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000805cce2/0xb0c3a59caa4104b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.327148:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000805cce2/0xb0c3a59caa4104b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.327158:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000805cce2/0xb0c3a59caa4104b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.327167:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000805cce2/0xb0c3a59caa4104b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.327187:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789635554.327325:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635554.327333:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000805cce2/0xb0c3a59caa4104b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.327341:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0549f43200 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:3.0:1789635554.327346:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000805cce2/0xb0c3a59caa4104b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.327355:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000805cce2/0xb0c3a59caa4104b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.327371:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000805cce2/0xb0c3a59caa4104b4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.327379:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000805cce2/0xb0c3a59caa4104b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.327398:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635554.327406:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635554.327408:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789635554.329104:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789635554.329124:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b841da0d/0xb0c3a59caa4104bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.329139:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1789635554.329145:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635554.329150:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b841da0d/0xb0c3a59caa4104bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.329163:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b841da0d/0xb0c3a59caa4104bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.329174:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b841da0d/0xb0c3a59caa4104bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.329181:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b841da0d/0xb0c3a59caa4104bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.329244:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789635554.333267:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635554.333282:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b841da0d/0xb0c3a59caa4104bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.333295:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0549f42000 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635554.333301:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b841da0d/0xb0c3a59caa4104bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.333312:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b841da0d/0xb0c3a59caa4104bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.333338:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b841da0d/0xb0c3a59caa4104bb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.333347:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b841da0d/0xb0c3a59caa4104bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.333401:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635554.333403:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635554.333405:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789635554.334268:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789635554.334279:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053b7c2d0/0xb0c3a59caa4104c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.334294:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1789635554.334299:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635554.334306:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053b7c2d0/0xb0c3a59caa4104c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.334328:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053b7c2d0/0xb0c3a59caa4104c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.334349:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053b7c2d0/0xb0c3a59caa4104c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.334357:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053b7c2d0/0xb0c3a59caa4104c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.334378:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789635554.334409:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635554.334415:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053b7c2d0/0xb0c3a59caa4104c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.334432:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0549f42e00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:3.0:1789635554.334436:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053b7c2d0/0xb0c3a59caa4104c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.334443:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053b7c2d0/0xb0c3a59caa4104c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.334457:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053b7c2d0/0xb0c3a59caa4104c2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.334463:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053b7c2d0/0xb0c3a59caa4104c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.334479:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635554.334481:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635554.334482:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789635554.335856:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789635554.335866:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073d840cd/0xb0c3a59caa4104c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.335879:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1789635554.335882:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635554.335888:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073d840cd/0xb0c3a59caa4104c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.335898:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073d840cd/0xb0c3a59caa4104c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.335908:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073d840cd/0xb0c3a59caa4104c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.335915:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073d840cd/0xb0c3a59caa4104c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.335949:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789635554.336360:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789635554.336366:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058f2438b/0xb0c3a59caa4104d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.336374:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1789635554.336377:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635554.336381:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058f2438b/0xb0c3a59caa4104d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.336390:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058f2438b/0xb0c3a59caa4104d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.336397:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058f2438b/0xb0c3a59caa4104d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.336404:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058f2438b/0xb0c3a59caa4104d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635554.336416:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000001:00080000:2.0:1789635554.337058:0:19416:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1789635554.337109:0:19416:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1789635554.337114:0:19416:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789635554.337629:0:19724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:17839:x1876568427411840:12345-0@lo:5:osp-pre-1-1.0 Request processed in 71523us (71767us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789635554.337649:0:19724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789635554.337992:0:17839:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789635554.338000:0:17839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448598e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17839:1876568427411840:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1789635554.338015:0:17839:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1789635554.338066:0:17839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0448598e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17839:1876568427411968:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1789635554.338102:0:17839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635554.338135:0:17839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d04410f9900 going to sleep for 11 seconds 00002000:00010000:2.0:1789635554.338212:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789635554.338219:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068239b60/0xb0c3a59caa4104d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.338231:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1789635554.338235:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635554.338240:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068239b60/0xb0c3a59caa4104d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.338252:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068239b60/0xb0c3a59caa4104d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.338260:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068239b60/0xb0c3a59caa4104d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.338279:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068239b60/0xb0c3a59caa4104d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.338288:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1789635554.338969:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789635554.338978:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fc91803/0xb0c3a59caa4104de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.338988:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1789635554.338992:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635554.338995:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fc91803/0xb0c3a59caa4104de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.339005:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fc91803/0xb0c3a59caa4104de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.339013:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fc91803/0xb0c3a59caa4104de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.339019:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fc91803/0xb0c3a59caa4104de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.339027:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1789635554.339178:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789635554.339186:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073d840cd/0xb0c3a59caa4104c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.339206:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0549f42600 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:3.0:1789635554.339210:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073d840cd/0xb0c3a59caa4104c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635554.339222:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427411968 00010000:00010000:3.0:1789635554.339226:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073d840cd/0xb0c3a59caa4104c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635554.339229:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427411968 00010000:00010000:3.0:1789635554.339248:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073d840cd/0xb0c3a59caa4104c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.339255:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073d840cd/0xb0c3a59caa4104c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.339277:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:0.0:1789635554.339277:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789635554.339280:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058f2438b/0xb0c3a59caa4104d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.339286:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0549f42200 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:3.0:1789635554.339289:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058f2438b/0xb0c3a59caa4104d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635554.339291:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e015500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17839:x1876568427411968:12345-0@lo:900:osp-pre-1-1.0 00010000:00010000:3.0:1789635554.339297:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058f2438b/0xb0c3a59caa4104d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.339305:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058f2438b/0xb0c3a59caa4104d0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.339311:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058f2438b/0xb0c3a59caa4104d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.339334:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789635554.339338:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068239b60/0xb0c3a59caa4104d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.339344:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a2200 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:3.0:1789635554.339347:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068239b60/0xb0c3a59caa4104d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.339354:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068239b60/0xb0c3a59caa4104d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.339363:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068239b60/0xb0c3a59caa4104d7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.339370:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068239b60/0xb0c3a59caa4104d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635554.339372:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e015500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17839:x1876568427411968:12345-0@lo:900:osp-pre-1-1.0 Request processed in 83us (1270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635554.339379:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789635554.339393:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635554.339396:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fc91803/0xb0c3a59caa4104de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.339402:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3000 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:3.0:1789635554.339406:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fc91803/0xb0c3a59caa4104de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.339434:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fc91803/0xb0c3a59caa4104de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.339445:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fc91803/0xb0c3a59caa4104de lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.339452:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fc91803/0xb0c3a59caa4104de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.339464:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635554.339465:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635554.339467:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635554.339474:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1789635554.339715:0:17839:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0448598e00 x1876568427411968/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789635570 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635554.339742:0:17839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0448598e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17839:1876568427411968:0@lo:900:osp-pre-1-1.0 00002000:00010000:2.0:1789635554.340542:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789635554.340550:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000adffe8d/0xb0c3a59caa4104e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.340562:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1789635554.340565:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635554.340571:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000adffe8d/0xb0c3a59caa4104e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.340581:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000adffe8d/0xb0c3a59caa4104e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.340591:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000adffe8d/0xb0c3a59caa4104e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.340626:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000adffe8d/0xb0c3a59caa4104e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.340803:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789635554.342635:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789635554.342925:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005519c673/0xb0c3a59caa4104ec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.342942:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1789635554.342947:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635554.342960:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005519c673/0xb0c3a59caa4104ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.342974:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005519c673/0xb0c3a59caa4104ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.342984:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005519c673/0xb0c3a59caa4104ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.342992:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005519c673/0xb0c3a59caa4104ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.343059:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789635554.343067:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000adffe8d/0xb0c3a59caa4104e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.343076:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a2e00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:3.0:1789635554.343081:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000adffe8d/0xb0c3a59caa4104e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.343090:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000adffe8d/0xb0c3a59caa4104e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.343107:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000adffe8d/0xb0c3a59caa4104e5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.343127:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000adffe8d/0xb0c3a59caa4104e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.343157:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635554.343160:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005519c673/0xb0c3a59caa4104ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.343166:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a2600 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:3.0:1789635554.343169:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005519c673/0xb0c3a59caa4104ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.343176:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005519c673/0xb0c3a59caa4104ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.343186:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005519c673/0xb0c3a59caa4104ec lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.343193:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635554.343206:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635554.343208:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635554.350692:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635554.351957:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789635554.351970:0:18603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005519c673/0xb0c3a59caa4104ec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.352014:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789635554.354232:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789635554.354245:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a29d02e8/0xb0c3a59caa4104f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.354278:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=573s v=(0 0) 00010000:00010000:3.0:1789635554.354283:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635554.354291:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a29d02e8/0xb0c3a59caa4104f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.354307:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a29d02e8/0xb0c3a59caa4104f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.354319:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a29d02e8/0xb0c3a59caa4104f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.354327:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a29d02e8/0xb0c3a59caa4104f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.354351:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789635554.354372:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635554.354378:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a29d02e8/0xb0c3a59caa4104f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.354387:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488fea00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635554.354391:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a29d02e8/0xb0c3a59caa4104f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.354402:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a29d02e8/0xb0c3a59caa4104f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.354932:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a29d02e8/0xb0c3a59caa4104f3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.354943:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635554.354945:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635554.354947:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635554.355131:0:18603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a29d02e8/0xb0c3a59caa4104f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789635554.356254:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789635554.356264:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa4104fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.356277:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=573s v=(0 0) 00010000:00010000:3.0:1789635554.356282:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635554.356287:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa4104fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.356311:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa4104fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.356333:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa4104fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.356341:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa4104fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635554.356365:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1789635554.356416:0:18603:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00010000:00010000:2.0:1789635554.356482:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635554.356488:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa4104fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.356497:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488ffe00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:2.0:1789635554.356742:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa4104fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.356752:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa4104fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.356770:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa4104fa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.356919:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8a542fc/0xb0c3a59caa4104fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635554.356940:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635554.356942:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635554.356944:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635554.357261:0:18603:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17123:x1876568427411328:12345-0@lo:5:osp-pre-1-0.0 Request processed in 127732us (127863us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635554.357272:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789635554.357343:0:17123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17123:1876568427411328:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789635554.357359:0:17123:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1789635554.357403:0:17123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044791b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17123:1876568427412096:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789635554.357447:0:17123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635554.357473:0:17123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d055166b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635554.357490:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427412096 00000100:00100000:3.0:1789635554.357496:0:18603:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427412096 00000100:00100000:3.0:1789635554.357540:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789635554.357547:0:18603:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17123:x1876568427412096:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1789635554.357581:0:18603:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:3.0:1789635554.363663:0:17123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044791b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17123:1876568427412096:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789635554.363684:0:17123:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000100:00100000:2.0:1789635554.363692:0:18603:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17123:x1876568427412096:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6092us (6191us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789635554.363704:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000001:02000400:3.0:1789635554.757267:0:19773:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789635555.364068:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789635555.509304:0:19825:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789635555.509542:0:19825:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1789635556.289185:0:19876:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789635556.289445:0:19876:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789635556.394780:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635556.487554:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635556.487701:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411590400 00000100:00100000:1.0:1789635556.487711:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411590400 00000100:00100000:1.0:1789635556.487761:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 115 00000100:00100000:1.0:1789635556.487770:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2395:x1876568411590400:12345-192.168.203.20@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789635556.487800:0:17091:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 5e0fbe02-afe7-4e1d-af83-76bf8fc579b6@192.168.203.20@tcp t0 exp 0000000000000000 cur 575 last 0 00000020:00000080:1.0:1789635556.487828:0:17091:0:(genops.c:1384:class_connect()) connect: client 5e0fbe02-afe7-4e1d-af83-76bf8fc579b6, cookie 0xb0c3a59caa410501 00000100:00080000:1.0:1789635556.487969:0:17091:0:(import.c:65:import_set_state_nolock()) ffff8d0447793000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789635556.488045:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+5:2395:x1876568411590400:12345-192.168.203.20@tcp:250:mount.lustre.0 Request processed in 274us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635556.488053:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 115 00000100:00100000:0.0:1789635556.498011:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635556.498513:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411590528 00000100:00100000:2.0:1789635556.498523:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411590528 00000100:00100000:2.0:1789635556.498580:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 116 00000100:00100000:2.0:1789635556.498591:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+5:14872:x1876568411590528:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789635556.498640:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635556.498658:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056e1a3600/0xb0c3a59caa410508 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74394 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635556.498687:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e1a3600/0xb0c3a59caa410508 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74394 expref: 6 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635556.498698:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056e1a3600/0xb0c3a59caa410508 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74394 expref: 6 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635556.498706:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a3600, rc 0) 00000100:00100000:0.0:1789635556.498810:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+6:14872:x1876568411590528:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 218us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635556.498818:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 116 00000100:00100000:0.0:1789635556.500499:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635556.500576:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411590656 00000100:00100000:1.0:1789635556.500584:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411590656 00000100:00100000:1.0:1789635556.500644:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 117 00000100:00100000:1.0:1789635556.500653:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+6:14872:x1876568411590656:12345-192.168.203.20@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789635556.500755:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+6:14872:x1876568411590656:12345-192.168.203.20@tcp:501:mount.lustre.0 Request processed in 103us (261us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789635556.500764:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 117 00000100:00100000:3.0:1789635556.512041:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635556.512115:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411590784 00000100:00100000:0.0:1789635556.512130:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411590784 00000100:00100000:0.0:1789635556.512196:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 118 00000100:00100000:0.0:1789635556.512211:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+6:14872:x1876568411590784:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789635556.512229:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635556.512247:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0549f43a00/0xb0c3a59caa41050f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7439b expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635556.512274:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0549f43a00/0xb0c3a59caa41050f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7439b expref: 7 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635556.512285:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0549f43a00/0xb0c3a59caa41050f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7439b expref: 7 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635556.512294:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0549f43a00, rc 0) 00000100:00100000:0.0:1789635556.512360:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+7:14872:x1876568411590784:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 155us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635556.512383:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 118 00000100:00100000:0.0:1789635556.516294:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635556.516866:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411590912 00000100:00100000:1.0:1789635556.516895:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411590912 00000100:00100000:1.0:1789635556.516962:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 119 00000100:00100000:1.0:1789635556.516972:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+7:14872:x1876568411590912:12345-192.168.203.20@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789635556.517141:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+8:14872:x1876568411590912:12345-192.168.203.20@tcp:501:mount.lustre.0 Request processed in 170us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635556.517149:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 119 00000100:00100000:1.0:1789635556.519846:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635556.521488:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411591040 00000100:00100000:0.0:1789635556.521503:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411591040 00000100:00100000:0.0:1789635556.521563:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 120 00000100:00100000:0.0:1789635556.521573:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+8:14872:x1876568411591040:12345-192.168.203.20@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789635556.521909:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+8:14872:x1876568411591040:12345-192.168.203.20@tcp:503:mount.lustre.0 Request processed in 335us (2069us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635556.521918:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 120 00000100:00100000:3.0:1789635556.527135:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635556.527230:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411591168 00000100:00100000:1.0:1789635556.527246:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411591168 00000100:00100000:1.0:1789635556.527317:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 121 00000100:00100000:1.0:1789635556.527327:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+8:14890:x1876568411591168:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789635556.527510:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+8:14890:x1876568411591168:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 184us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635556.527518:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 121 00000100:00100000:2.0:1789635556.546126:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635556.546240:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411591296 00000100:00100000:0.0:1789635556.546256:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411591296 00000100:00100000:0.0:1789635556.546380:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 122 00000100:00100000:0.0:1789635556.546391:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+8:14890:x1876568411591296:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789635556.546568:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+8:14890:x1876568411591296:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 177us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635556.546576:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 122 00000100:00100000:3.0:1789635556.550145:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635556.553830:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411591424 00000100:00100000:1.0:1789635556.553847:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411591424 00000100:00100000:1.0:1789635556.553922:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 123 00000100:00100000:1.0:1789635556.553934:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+8:14890:x1876568411591424:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789635556.554174:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+8:14890:x1876568411591424:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 241us (4042us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635556.554182:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 123 00000100:00100000:3.0:1789635556.560186:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635556.560302:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411591552 00000100:00100000:1.0:1789635556.560314:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411591552 00000100:00100000:1.0:1789635556.560389:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 124 00000100:00100000:1.0:1789635556.560410:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+8:14872:x1876568411591552:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789635556.560455:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635556.560480:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d05820d3e00/0xb0c3a59caa410516 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab743cc expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635556.560521:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d05820d3e00/0xb0c3a59caa410516 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab743cc expref: 9 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635556.560535:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d05820d3e00/0xb0c3a59caa410516 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab743cc expref: 9 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635556.560546:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05820d3e00, rc 0) 00000100:00100000:1.0:1789635556.560665:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+9:14872:x1876568411591552:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 267us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635556.560673:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 124 00000100:00100000:3.0:1789635556.564659:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635556.564777:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411591680 00000100:00100000:2.0:1789635556.564791:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411591680 00000100:00100000:2.0:1789635556.564867:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 125 00000100:00100000:2.0:1789635556.564880:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+9:14872:x1876568411591680:12345-192.168.203.20@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789635556.564917:0:17089:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789635556.564950:0:17089:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789635556.564955:0:17089:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789635556.564959:0:17089:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789635556.564968:0:17089:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789635556.564971:0:17089:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1789635556.567964:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+9:14872:x1876568411591680:12345-192.168.203.20@tcp:256:mount.lustre.0 Request processed in 3070us (3303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635556.567982:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 125 00000100:00100000:0.0:1789635556.572082:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635556.576141:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411591808 00000100:00100000:2.0:1789635556.576167:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411591808 00000100:00100000:2.0:1789635556.576257:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 126 00000100:00100000:2.0:1789635556.576271:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+9:14872:x1876568411591808:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789635556.576295:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635556.576319:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa41051d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab743d3 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635556.576356:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa41051d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab743d3 expref: 10 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635556.576370:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa41051d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab743d3 expref: 10 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635556.576381:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a2800, rc 0) 00000100:00100000:2.0:1789635556.576480:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+10:14872:x1876568411591808:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 212us (4411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635556.576488:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 126 00000100:00100000:3.0:1789635556.578846:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635556.583438:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411591936 00000100:00100000:0.0:1789635556.583460:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411591936 00000100:00100000:0.0:1789635556.583684:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 127 00000100:00100000:0.0:1789635556.583698:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+10:14872:x1876568411591936:12345-192.168.203.20@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789635556.583923:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+10:14872:x1876568411591936:12345-192.168.203.20@tcp:501:mount.lustre.0 Request processed in 227us (5092us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635556.583932:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 127 00000100:00100000:3.0:1789635556.597870:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635556.598050:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411592064 00000100:00100000:1.0:1789635556.598065:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411592064 00000100:00100000:1.0:1789635556.598139:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 128 00000100:00100000:1.0:1789635556.598150:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+10:14872:x1876568411592064:12345-192.168.203.20@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789635556.598341:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+10:14872:x1876568411592064:12345-192.168.203.20@tcp:503:mount.lustre.0 Request processed in 192us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635556.598349:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 128 00000100:00100000:3.0:1789635556.609418:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635556.609544:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411592192 00000100:00100000:0.0:1789635556.609557:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411592192 00000100:00100000:0.0:1789635556.609670:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 129 00000100:00100000:0.0:1789635556.609683:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+10:14894:x1876568411592192:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789635556.609875:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+10:14894:x1876568411592192:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 195us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635556.609883:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 129 00000100:00100000:3.0:1789635556.620758:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635556.620881:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411592320 00000100:00100000:2.0:1789635556.620894:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411592320 00000100:00100000:2.0:1789635556.620961:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 130 00000100:00100000:2.0:1789635556.620973:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546405450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+10:14894:x1876568411592320:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789635556.621186:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546405450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+10:14894:x1876568411592320:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 214us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635556.621204:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 130 00000100:00100000:3.0:1789635556.624814:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635556.624991:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411592448 00000100:00100000:0.0:1789635556.625007:0:17848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411592448 00000100:00100000:0.0:1789635556.625080:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:0.0:1789635556.625092:0:17848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2395:x1876568411592448:12345-192.168.203.20@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789635556.625136:0:17848:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from e93c6359-edaa-4c8b-af3f-bf6e406e4e94@192.168.203.20@tcp t0 exp 0000000000000000 cur 575 last 0 00000020:00000080:0.0:1789635556.625206:0:17848:0:(genops.c:1384:class_connect()) connect: client e93c6359-edaa-4c8b-af3f-bf6e406e4e94, cookie 0xb0c3a59caa410524 00000004:00100000:0.0:1789635556.625240:0:17848:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789635556.625534:0:17848:0:(import.c:65:import_set_state_nolock()) ffff8d0446690800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789635556.625903:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635556.625994:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411592704 00000100:00100000:2.0:1789635556.626001:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411592704 00000100:00100000:2.0:1789635556.626048:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:2.0:1789635556.626055:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2395:x1876568411592704:12345-192.168.203.20@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789635556.626085:0:17096:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from e93c6359-edaa-4c8b-af3f-bf6e406e4e94@192.168.203.20@tcp t0 exp 0000000000000000 cur 575 last 0 00000020:00000080:2.0:1789635556.626145:0:17096:0:(genops.c:1384:class_connect()) connect: client e93c6359-edaa-4c8b-af3f-bf6e406e4e94, cookie 0xb0c3a59caa41052b 00000004:00100000:2.0:1789635556.626163:0:17096:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789635556.626325:0:17096:0:(import.c:65:import_set_state_nolock()) ffff8d0545809800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789635556.626417:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+6:2395:x1876568411592704:12345-192.168.203.20@tcp:38:mount.lustre.0 Request processed in 360us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635556.626424:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:1.0:1789635556.632575:0:17848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+6:2395:x1876568411592448:12345-192.168.203.20@tcp:38:mount.lustre.0 Request processed in 7466us (7759us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635556.632646:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:3.0:1789635556.633067:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635556.633451:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411592832 00000100:00100000:2.0:1789635556.633464:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411592832 00000100:00100000:2.0:1789635556.633562:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:2.0:1789635556.633574:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044791b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+6:0:x1876568411592832:12345-192.168.203.20@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789635556.633657:0:17096:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00080000:1.0:1789635556.633854:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789635556.633887:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044791b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+6:0:x1876568411592832:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 315us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635556.633895:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:3.0:1789635556.642776:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635556.642899:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411592576 00000100:00100000:1.0:1789635556.642934:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411592576 00000100:00100000:1.0:1789635556.643037:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:1.0:1789635556.643050:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+6:0:x1876568411592576:12345-192.168.203.20@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789635556.643103:0:17097:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789635556.643222:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+6:0:x1876568411592576:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 174us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635556.643230:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:3.0:1789635556.643817:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635556.643893:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411592960 00000100:00100000:2.0:1789635556.643899:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411592960 00000100:00100000:2.0:1789635556.643943:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:2.0:1789635556.643952:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044791b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+6:14872:x1876568411592960:12345-192.168.203.20@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789635556.643975:0:17098:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789635556.644042:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044791b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+6:14872:x1876568411592960:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 91us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635556.644050:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00080000:0.0:1789635556.644486:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635556.651705:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635556.651820:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411593088 00000100:00100000:1.0:1789635556.651834:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411593088 00000100:00100000:1.0:1789635556.651918:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:1.0:1789635556.651930:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044791aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+6:14872:x1876568411593088:12345-192.168.203.20@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789635556.652044:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044791aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+6:14872:x1876568411593088:12345-192.168.203.20@tcp:40:mount.lustre.0 Request processed in 116us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635556.652052:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:1.0:1789635556.655003:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635556.655050:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635556.655079:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635556.655269:0:19724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411593216 00000100:00100000:2.0:1789635556.655283:0:19724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411593216 00000100:00100000:2.0:1789635556.655336:0:19724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411593344 00000100:00100000:2.0:1789635556.655341:0:19724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411593344 00000100:00100000:2.0:1789635556.655365:0:19724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:2.0:1789635556.655374:0:19724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2395:x1876568411593216:12345-192.168.203.20@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789635556.655432:0:19724:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from e93c6359-edaa-4c8b-af3f-bf6e406e4e94@192.168.203.20@tcp t0 exp 0000000000000000 cur 575 last 0 00000020:00000080:2.0:1789635556.655500:0:19724:0:(genops.c:1384:class_connect()) connect: client e93c6359-edaa-4c8b-af3f-bf6e406e4e94, cookie 0xb0c3a59caa410532 00002000:00100000:2.0:1789635556.655516:0:19724:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e93c6359-edaa-4c8b-af3f-bf6e406e4e94/ffff8d054580e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789635556.655540:0:19724:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789635556.655799:0:19724:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789635556.655841:0:19724:0:(import.c:65:import_set_state_nolock()) ffff8d054580d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789635556.655947:0:19724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+6:2395:x1876568411593216:12345-192.168.203.20@tcp:8:mount.lustre.0 Request processed in 571us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635556.655955:0:19724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:2.0:1789635556.655976:0:19724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:2.0:1789635556.655980:0:19724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2395:x1876568411593344:12345-192.168.203.20@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789635556.656000:0:19724:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from e93c6359-edaa-4c8b-af3f-bf6e406e4e94@192.168.203.20@tcp t0 exp 0000000000000000 cur 575 last 0 00000020:00000080:2.0:1789635556.656020:0:19724:0:(genops.c:1384:class_connect()) connect: client e93c6359-edaa-4c8b-af3f-bf6e406e4e94, cookie 0xb0c3a59caa410539 00002000:00100000:2.0:1789635556.656027:0:19724:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e93c6359-edaa-4c8b-af3f-bf6e406e4e94/ffff8d054580f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789635556.656040:0:19724:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789635556.656292:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411593472 00000100:00100000:0.0:1789635556.656300:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411593472 00000100:00100000:0.0:1789635556.656357:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 3 00002000:00080000:2.0:1789635556.656366:0:19724:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:0.0:1789635556.656367:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+6:14872:x1876568411593472:12345-192.168.203.20@tcp:900:mount.lustre.0 00000100:00080000:2.0:1789635556.656435:0:19724:0:(import.c:65:import_set_state_nolock()) ffff8d054643e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789635556.656438:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+6:14872:x1876568411593472:12345-192.168.203.20@tcp:900:mount.lustre.0 Request processed in 70us (1447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635556.656451:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:2.0:1789635556.656517:0:19724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+6:2395:x1876568411593344:12345-192.168.203.20@tcp:8:mount.lustre.0 Request processed in 530us (1433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635556.656531:0:19724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:0.0:1789635556.661440:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635556.664083:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411593600 00000100:00100000:3.0:1789635556.664108:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411593600 00000100:00100000:3.0:1789635556.664201:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:3.0:1789635556.664214:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+6:14872:x1876568411593600:12345-192.168.203.20@tcp:33:mount.lustre.0 00000004:00080000:1.0:1789635556.667870:0:17099:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3513us 00000004:00200000:1.0:1789635556.694487:0:17099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789635556.694649:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+6:14872:x1876568411593600:12345-192.168.203.20@tcp:33:mount.lustre.0 Request processed in 30432us (33218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635556.694664:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:0.0:1789635556.771819:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789635556.771843:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0546df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427412224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635556.771925:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635556.772010:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427412224 00000100:00100000:3.0:1789635556.772019:0:18606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427412224 00000100:00100000:3.0:1789635556.772089:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789635556.772102:0:18606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427412224:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789635556.772186:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1789635556.772265:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789635556.772318:0:18606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427412224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 220us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635556.772325:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789635556.772428:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0546df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427412224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789635556.868981:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635556.872887:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411593728 00000100:00100000:3.0:1789635556.872902:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411593728 00000100:00100000:3.0:1789635556.872982:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:3.0:1789635556.872993:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+6:14918:x1876568411593728:12345-192.168.203.20@tcp:101:mkdir.0 00010000:00010000:3.0:1789635556.873014:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635556.873039:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff800/0xb0c3a59caa410540 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74404 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635556.873114:0:17098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa410547 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635556.873127:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa410547 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635556.873140:0:17098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa410547 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635556.873184:0:17098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789635556.873188:0:17098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789635556.873223:0:17098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa410547 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635556.873249:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff800/0xb0c3a59caa410540 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74404 expref: 8 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635556.873268:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa410547 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74404 expref: 7 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635556.873276:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d05446d0700) 00010000:00010000:3.0:1789635556.873293:0:17098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789635556.873297:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05488fea00, rc 0) 00000100:00100000:3.0:1789635556.873364:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+7:14918:x1876568411593728:12345-192.168.203.20@tcp:101:mkdir.0 Request processed in 373us (4393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635556.873372:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 13 00010000:00010000:2.0:1789635557.418139:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635557.799017:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427412352:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789635557.799103:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635557.799322:0:18607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427412352 00000100:00100000:3.0:1789635557.799331:0:18607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427412352 00000100:00100000:3.0:1789635557.799412:0:18607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789635557.799422:0:18607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427412352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789635557.799446:0:18607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00080000:2.0:1789635557.799513:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789635557.800000:0:18607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427412352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 580us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635557.800009:0:18607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789635557.800120:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427412352:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789635558.307929:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550661f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427412480:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789635558.308009:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635558.308359:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427412608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789635558.308477:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635558.308554:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427412480 00000100:00100000:3.0:1789635558.308563:0:18189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427412480 00000100:00100000:3.0:1789635558.308646:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427412608 00000100:00100000:3.0:1789635558.308650:0:18189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427412608 00000100:00100000:3.0:1789635558.308668:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789635558.308676:0:18189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427412480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789635558.308710:0:18189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789635558.308756:0:18189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427412480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635558.308763:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789635558.308780:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789635558.308786:0:18189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427412608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789635558.308802:0:18189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789635558.308831:0:18189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427412608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 45us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635558.308851:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789635558.309051:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427412608:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789635558.309278:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550661f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427412480:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789635558.435848:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635558.616804:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635558.616882:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411593856 00000100:00100000:0.0:1789635558.616891:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411593856 00000100:00100000:0.0:1789635558.616963:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00100000:0.0:1789635558.616972:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+7:14970:x1876568411593856:12345-192.168.203.20@tcp:41:lfs.0 00000004:00000024:0.0:1789635558.617024:0:17097:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789635558.617104:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+7:14970:x1876568411593856:12345-192.168.203.20@tcp:41:lfs.0 Request processed in 132us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635558.617110:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00080000:2.0:1789635558.617826:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635558.619704:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635558.620238:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411593984 00000100:00100000:3.0:1789635558.620249:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411593984 00000100:00100000:3.0:1789635558.620372:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00100000:3.0:1789635558.620382:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+6:14970:x1876568411593984:12345-192.168.203.20@tcp:41:lfs.0 00000004:00000024:3.0:1789635558.620430:0:17098:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789635558.620582:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+6:14970:x1876568411593984:12345-192.168.203.20@tcp:41:lfs.0 Request processed in 202us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635558.620588:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00080000:2.0:1789635558.622330:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789635558.627167:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635558.627324:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411594112 00000100:00100000:2.0:1789635558.627334:0:18606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411594112 00000100:00100000:2.0:1789635558.627416:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:2.0:1789635558.627427:0:18606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+6:14970:x1876568411594112:12345-192.168.203.20@tcp:13:lfs.0 00002000:00000024:2.0:1789635558.627480:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789635558.627573:0:18606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+6:14970:x1876568411594112:12345-192.168.203.20@tcp:13:lfs.0 Request processed in 147us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635558.627581:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00080000:1.0:1789635558.628003:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789635558.631085:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635558.631288:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411594240 00000100:00100000:2.0:1789635558.631298:0:18606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411594240 00000100:00100000:2.0:1789635558.631366:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:2.0:1789635558.631375:0:18606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+6:14970:x1876568411594240:12345-192.168.203.20@tcp:13:lfs.0 00002000:00000024:2.0:1789635558.631417:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789635558.631507:0:18606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+6:14970:x1876568411594240:12345-192.168.203.20@tcp:13:lfs.0 Request processed in 133us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635558.631515:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00080000:1.0:1789635558.632168:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789635558.785481:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635558.785554:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411594368 00000100:00100000:1.0:1789635558.785566:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411594368 00000100:00100000:1.0:1789635558.785648:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 131 00000100:00100000:1.0:1789635558.785658:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+10:15003:x1876568411594368:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789635558.785674:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635558.785702:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d05820d2e00/0xb0c3a59caa41054e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7440b expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635558.785739:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d05820d2e00/0xb0c3a59caa41054e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7440b expref: 11 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635558.785750:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d05820d2e00/0xb0c3a59caa41054e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7440b expref: 11 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635558.785759:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05820d2e00, rc 0) 00000100:00100000:1.0:1789635558.785819:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+11:15003:x1876568411594368:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 163us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635558.785825:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 131 00000100:00100000:0.0:1789635558.797456:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635558.797636:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411594496 00000100:00100000:2.0:1789635558.797646:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411594496 00000100:00100000:2.0:1789635558.797698:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 132 00000100:00100000:2.0:1789635558.797708:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546404850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+11:15003:x1876568411594496:12345-192.168.203.20@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789635558.797864:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546404850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+11:15003:x1876568411594496:12345-192.168.203.20@tcp:501:mount.lustre.0 Request processed in 157us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635558.797871:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 132 00000100:00100000:3.0:1789635558.801075:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635558.801288:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411594624 00000100:00100000:2.0:1789635558.801298:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411594624 00000100:00100000:2.0:1789635558.801353:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 133 00000100:00100000:2.0:1789635558.801362:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+11:15003:x1876568411594624:12345-192.168.203.20@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789635558.801515:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+11:15003:x1876568411594624:12345-192.168.203.20@tcp:503:mount.lustre.0 Request processed in 154us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635558.801523:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 133 00000100:00100000:0.0:1789635558.810989:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635558.811148:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411594752 00000100:00100000:2.0:1789635558.811159:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411594752 00000100:00100000:2.0:1789635558.811217:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 134 00000100:00100000:2.0:1789635558.811226:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+11:15009:x1876568411594752:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789635558.811395:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+11:15009:x1876568411594752:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 159us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635558.811403:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 134 00000100:00100000:0.0:1789635558.830054:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635558.830352:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411594880 00000100:00100000:1.0:1789635558.830425:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411594880 00000100:00100000:1.0:1789635558.830557:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 135 00000100:00100000:1.0:1789635558.830571:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+11:15009:x1876568411594880:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789635558.830830:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+11:15009:x1876568411594880:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 261us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635558.830838:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 135 00000100:00100000:3.0:1789635558.833665:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635558.833832:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411595008 00000100:00100000:2.0:1789635558.833848:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411595008 00000100:00100000:2.0:1789635558.833925:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 136 00000100:00100000:2.0:1789635558.833937:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+11:15009:x1876568411595008:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789635558.834105:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+11:15009:x1876568411595008:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 170us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635558.834114:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 136 00000100:00100000:3.0:1789635558.836905:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635558.837340:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411595136 00000100:00100000:0.0:1789635558.837354:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411595136 00000100:00100000:0.0:1789635558.837438:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 137 00000100:00100000:0.0:1789635558.837451:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+11:15003:x1876568411595136:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789635558.837485:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635558.837539:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0549f42200/0xb0c3a59caa410555 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7443c expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635558.837576:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0549f42200/0xb0c3a59caa410555 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7443c expref: 12 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635558.837591:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0549f42200/0xb0c3a59caa410555 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7443c expref: 12 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635558.837638:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0549f42200, rc 0) 00000100:00100000:0.0:1789635558.837717:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+12:15003:x1876568411595136:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 267us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635558.837724:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 137 00000100:00100000:0.0:1789635558.841928:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635558.842841:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411595264 00000100:00100000:1.0:1789635558.842857:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411595264 00000100:00100000:0.0:1789635558.843098:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 138 00000100:00100000:0.0:1789635558.843111:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+12:15003:x1876568411595264:12345-192.168.203.20@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789635558.843719:0:17090:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789635558.843758:0:17090:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789635558.843855:0:17090:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789635558.843859:0:17090:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789635558.843863:0:17090:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789635558.843866:0:17090:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1789635558.847210:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+12:15003:x1876568411595264:12345-192.168.203.20@tcp:256:mount.lustre.0 Request processed in 3794us (4992us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635558.847231:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 138 00000100:00100000:3.0:1789635558.852319:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635558.852422:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411595392 00000100:00100000:2.0:1789635558.852436:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411595392 00000100:00100000:2.0:1789635558.852533:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 139 00000100:00100000:2.0:1789635558.852544:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+12:15003:x1876568411595392:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789635558.852569:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635558.852592:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d056e1a3a00/0xb0c3a59caa41055c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74443 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635558.852639:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e1a3a00/0xb0c3a59caa41055c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74443 expref: 13 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635558.852649:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d056e1a3a00/0xb0c3a59caa41055c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74443 expref: 13 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635558.852656:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a3a00, rc 0) 00000100:00100000:2.0:1789635558.852717:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+13:15003:x1876568411595392:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 176us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635558.852730:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 139 00000100:00100000:1.0:1789635558.858810:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635558.859316:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411595520 00000100:00100000:0.0:1789635558.859331:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411595520 00000100:00100000:0.0:1789635558.859474:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 140 00000100:00100000:0.0:1789635558.859487:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+13:15003:x1876568411595520:12345-192.168.203.20@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789635558.862536:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+13:15003:x1876568411595520:12345-192.168.203.20@tcp:501:mount.lustre.0 Request processed in 3034us (3724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635558.862554:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 140 00000100:00100000:1.0:1789635558.866229:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635558.866878:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411595648 00000100:00100000:0.0:1789635558.866894:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411595648 00000100:00100000:2.0:1789635558.867065:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 141 00000100:00100000:2.0:1789635558.867078:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+13:15003:x1876568411595648:12345-192.168.203.20@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789635558.867531:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+13:15003:x1876568411595648:12345-192.168.203.20@tcp:503:mount.lustre.0 Request processed in 454us (1314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635558.867550:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 141 00000100:00100000:2.0:1789635558.876161:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635558.877527:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411595776 00000100:00100000:0.0:1789635558.877549:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411595776 00000100:00100000:0.0:1789635558.877810:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 142 00000100:00100000:0.0:1789635558.877834:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+13:15013:x1876568411595776:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789635558.878056:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+13:15013:x1876568411595776:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 225us (1909us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635558.878064:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 142 00000100:00100000:1.0:1789635558.882086:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635558.882266:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411595904 00000100:00100000:2.0:1789635558.882281:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411595904 00000100:00100000:2.0:1789635558.882353:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 143 00000100:00100000:2.0:1789635558.882365:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+13:15013:x1876568411595904:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789635558.882649:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+13:15013:x1876568411595904:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 286us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635558.882659:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 143 00000100:00100000:3.0:1789635558.922144:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635558.922191:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635558.922222:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635558.922261:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635558.922286:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635558.922322:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635558.922360:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411596032 00000100:00100000:3.0:1789635558.922373:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411596032 00000100:00100000:3.0:1789635558.922424:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411596288 00000100:00100000:3.0:1789635558.922427:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411596288 00000100:00100000:3.0:1789635558.922436:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411596544 00000100:00100000:3.0:1789635558.922449:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411596544 00000100:00100000:3.0:1789635558.922484:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411596672 00000100:00100000:3.0:1789635558.922487:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411596672 00000100:00100000:3.0:1789635558.922528:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 35 00000100:00100000:3.0:1789635558.922540:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+7:2396:x1876568411596544:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635558.922681:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+7:2396:x1876568411596544:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 142us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635558.922689:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 35 00000100:00100000:3.0:1789635558.922710:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 36 00000100:00100000:3.0:1789635558.922716:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044791a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+6:2396:x1876568411596672:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635558.922738:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044791a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+6:2396:x1876568411596672:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 23us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635558.922744:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 36 00000100:00100000:3.0:1789635558.922755:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:3.0:1789635558.922759:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2395:x1876568411596032:12345-192.168.203.20@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789635558.922787:0:17096:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 1dd3fc4f-a707-4c13-a2d4-7afae80fdb16@192.168.203.20@tcp t0 exp 0000000000000000 cur 577 last 0 00000020:00000080:3.0:1789635558.922830:0:17096:0:(genops.c:1384:class_connect()) connect: client 1dd3fc4f-a707-4c13-a2d4-7afae80fdb16, cookie 0xb0c3a59caa410563 00000004:00100000:3.0:1789635558.922863:0:17096:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789635558.922977:0:17096:0:(import.c:65:import_set_state_nolock()) ffff8d0544683000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789635558.923007:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+6:2395:x1876568411596032:12345-192.168.203.20@tcp:38:mount.lustre.0 Request processed in 246us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635558.923013:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:3.0:1789635558.923026:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:3.0:1789635558.923030:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2395:x1876568411596288:12345-192.168.203.20@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789635558.923044:0:17096:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 1dd3fc4f-a707-4c13-a2d4-7afae80fdb16@192.168.203.20@tcp t0 exp 0000000000000000 cur 577 last 0 00000020:00000080:3.0:1789635558.923065:0:17096:0:(genops.c:1384:class_connect()) connect: client 1dd3fc4f-a707-4c13-a2d4-7afae80fdb16, cookie 0xb0c3a59caa41056a 00000004:00100000:3.0:1789635558.923078:0:17096:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789635558.923132:0:17096:0:(import.c:65:import_set_state_nolock()) ffff8d0544687800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789635558.923156:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+6:2395:x1876568411596288:12345-192.168.203.20@tcp:38:mount.lustre.0 Request processed in 124us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635558.923162:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:0.0:1789635558.925508:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411596800 00000100:00100000:0.0:1789635558.925528:0:18604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411596800 00000100:00100000:0.0:1789635558.925658:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411596928 00000100:00100000:0.0:1789635558.925663:0:18604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411596928 00000100:00100000:0.0:1789635558.925694:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:0.0:1789635558.925706:0:18604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044791ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+6:2396:x1876568411596800:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635558.925808:0:18604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044791ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+6:2396:x1876568411596800:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 104us (3546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635558.925817:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:0.0:1789635558.925838:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:0.0:1789635558.925845:0:18604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+6:2396:x1876568411596928:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635558.925871:0:18604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+6:2396:x1876568411596928:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 27us (3549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635558.925899:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:3.0:1789635558.934881:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635558.935972:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635558.938687:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635558.943200:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411596416 00000100:00100000:0.0:1789635558.943226:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411596416 00000100:00100000:3.0:1789635558.943341:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411597056 00000100:00100000:0.0:1789635558.943341:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411596160 00000100:00100000:0.0:1789635558.943345:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411596160 00000100:00100000:3.0:1789635558.943346:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411597056 00000100:00100000:0.0:1789635558.943375:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:0.0:1789635558.943401:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+6:0:x1876568411596416:12345-192.168.203.20@tcp:41:mount.lustre.0 00000100:00100000:3.0:1789635558.943424:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:3.0:1789635558.943431:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+7:0:x1876568411596160:12345-192.168.203.20@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789635558.943451:0:17097:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789635558.943554:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+7:0:x1876568411596160:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 122us (7590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635558.943563:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 19 00000004:00000024:0.0:1789635558.943573:0:17096:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789635558.943583:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:3.0:1789635558.943590:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+6:15003:x1876568411597056:12345-192.168.203.20@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789635558.943627:0:17097:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789635558.943627:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+6:0:x1876568411596416:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 244us (8762us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635558.943634:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:3.0:1789635558.943649:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+6:15003:x1876568411597056:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 59us (4977us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635558.943655:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00080000:1.0:1789635558.943698:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789635558.943704:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789635558.945852:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635558.946004:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411597184 00000100:00100000:0.0:1789635558.946017:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411597184 00000100:00100000:0.0:1789635558.946090:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:0.0:1789635558.946103:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+6:15003:x1876568411597184:12345-192.168.203.20@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789635558.946226:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+6:15003:x1876568411597184:12345-192.168.203.20@tcp:40:mount.lustre.0 Request processed in 126us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635558.946234:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:1.0:1789635558.948284:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635558.948330:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635558.948436:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411597568 00000100:00100000:0.0:1789635558.948450:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411597568 00000100:00100000:0.0:1789635558.948542:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:0.0:1789635558.948557:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+6:15003:x1876568411597568:12345-192.168.203.20@tcp:900:mount.lustre.0 00000100:00100000:0.0:1789635558.948696:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+6:15003:x1876568411597568:12345-192.168.203.20@tcp:900:mount.lustre.0 Request processed in 144us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635558.948703:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:1.0:1789635558.948981:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635558.949564:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411597312 00000100:00100000:3.0:1789635558.949574:0:18602:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411597312 00000100:00100000:3.0:1789635558.949635:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411597440 00000100:00100000:3.0:1789635558.949639:0:18602:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411597440 00000100:00100000:3.0:1789635558.949659:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:3.0:1789635558.949666:0:18602:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2395:x1876568411597312:12345-192.168.203.20@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789635558.949715:0:18602:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 1dd3fc4f-a707-4c13-a2d4-7afae80fdb16@192.168.203.20@tcp t0 exp 0000000000000000 cur 577 last 0 00000020:00000080:3.0:1789635558.949758:0:18602:0:(genops.c:1384:class_connect()) connect: client 1dd3fc4f-a707-4c13-a2d4-7afae80fdb16, cookie 0xb0c3a59caa410571 00002000:00100000:3.0:1789635558.949786:0:18602:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1dd3fc4f-a707-4c13-a2d4-7afae80fdb16/ffff8d0544681000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789635558.949800:0:18602:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789635558.949925:0:18602:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789635558.949963:0:18602:0:(import.c:65:import_set_state_nolock()) ffff8d0544682800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789635558.950028:0:18602:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+6:2395:x1876568411597312:12345-192.168.203.20@tcp:8:mount.lustre.0 Request processed in 360us (1696us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635558.950035:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:3.0:1789635558.950058:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:3.0:1789635558.950063:0:18602:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2395:x1876568411597440:12345-192.168.203.20@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789635558.950082:0:18602:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 1dd3fc4f-a707-4c13-a2d4-7afae80fdb16@192.168.203.20@tcp t0 exp 0000000000000000 cur 577 last 0 00000020:00000080:3.0:1789635558.950102:0:18602:0:(genops.c:1384:class_connect()) connect: client 1dd3fc4f-a707-4c13-a2d4-7afae80fdb16, cookie 0xb0c3a59caa410578 00002000:00100000:3.0:1789635558.950108:0:18602:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1dd3fc4f-a707-4c13-a2d4-7afae80fdb16/ffff8d0544680800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789635558.950114:0:18602:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789635558.950161:0:18602:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789635558.950177:0:18602:0:(import.c:65:import_set_state_nolock()) ffff8d0544684800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789635558.950205:0:18602:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+6:2395:x1876568411597440:12345-192.168.203.20@tcp:8:mount.lustre.0 Request processed in 140us (1225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635558.950212:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:2.0:1789635558.953707:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635558.953941:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411597696 00000100:00100000:0.0:1789635558.953953:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411597696 00000100:00100000:0.0:1789635558.954018:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:0.0:1789635558.954030:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+6:15003:x1876568411597696:12345-192.168.203.20@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789635558.954154:0:17100:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789635558.954344:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+6:15003:x1876568411597696:12345-192.168.203.20@tcp:33:mount.lustre.0 Request processed in 316us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635558.954353:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:2.0:1789635559.104737:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635559.104891:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411597824 00000100:00100000:3.0:1789635559.104904:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411597824 00000100:00100000:3.0:1789635559.104983:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:3.0:1789635559.104994:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+6:15036:x1876568411597824:12345-192.168.203.20@tcp:101:mkdir.0 00010000:00010000:3.0:1789635559.105038:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635559.105066:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff800/0xb0c3a59caa41057f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74474 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635559.105161:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa410586 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635559.105178:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa410586 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635559.105191:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa410586 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635559.105246:0:17097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789635559.105251:0:17097:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789635559.105272:0:17097:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa410586 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635559.105304:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff800/0xb0c3a59caa41057f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74474 expref: 8 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635559.105326:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa410586 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74474 expref: 7 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635559.105336:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d05446d0700) 00010000:00010000:3.0:1789635559.105339:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789635559.105343:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05488ff000, rc 0) 00000100:00100000:3.0:1789635559.105443:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+7:15036:x1876568411597824:12345-192.168.203.20@tcp:101:mkdir.0 Request processed in 449us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635559.105451:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:2.0:1789635559.331933:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427412736:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789635559.332030:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635559.332164:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427412736 00000100:00100000:2.0:1789635559.332175:0:18606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427412736 00000100:00100000:2.0:1789635559.332244:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789635559.332256:0:18606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550663800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427412736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789635559.332286:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789635559.332338:0:18606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550663800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427412736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635559.332345:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1789635559.332370:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789635559.332421:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427412736:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789635559.332691:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789635559.332700:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427412864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789635559.332734:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635559.332766:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427412864 00000100:00100000:2.0:1789635559.332777:0:18606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427412864 00000100:00100000:2.0:1789635559.332804:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789635559.332812:0:18606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550663b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1876568427412864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789635559.332823:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789635559.332852:0:18606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550663b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1876568427412864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635559.332857:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1789635559.332872:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789635559.332891:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427412864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635559.333838:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3642:1876568427412992:0@lo:400:kworker.0 00000100:00100000:2.0:1789635559.333856:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876568427413376:0@lo:400:kworker.0 00000100:00100000:3.0:1789635559.334042:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427413248:0@lo:400:kworker.0 00000100:00100000:1.0:1789635559.334407:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635559.335070:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635559.335106:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427413760:0@lo:400:kworker.0 00000100:00100000:3.0:1789635559.335136:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635559.335155:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1876568427414272:0@lo:400:kworker.0 00000100:00100000:3.0:1789635559.335176:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635559.335223:0:19724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427413248 00000100:00100000:3.0:1789635559.335230:0:19724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427413248 00000100:00100000:3.0:1789635559.335295:0:19724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789635559.335305:0:19724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427413248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635559.335361:0:19724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427413248:12345-0@lo:400:kworker.0 Request processed in 58us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635559.335368:0:19724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1789635559.335405:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789635559.335566:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427413248:0@lo:400:kworker.0 00000100:00100000:3.0:1789635559.335616:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427413760 00000100:00100000:3.0:1789635559.335621:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427413760 00000100:00100000:1.0:1789635559.335649:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427413504:0@lo:400:kworker.0 00000100:00100000:3.0:1789635559.335653:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427414272 00000100:00100000:3.0:1789635559.335657:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427414272 00000100:00100000:1.0:1789635559.335691:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635559.335692:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789635559.335702:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427413760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635559.335721:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427414016:0@lo:400:kworker.0 00000100:00100000:3.0:1789635559.335753:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876568427413760:12345-0@lo:400:kworker.0 Request processed in 52us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635559.335760:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635559.335767:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789635559.335783:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789635559.335784:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427414016 00000100:00100000:3.0:1789635559.335790:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427414016 00000100:00100000:1.0:1789635559.335794:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427413120:0@lo:400:kworker.0 00000100:00100000:3.0:1789635559.335811:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789635559.335830:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876568427414272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635559.335837:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635559.335869:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876568427414272:12345-0@lo:400:kworker.0 Request processed in 41us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635559.335874:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789635559.335885:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789635559.335889:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427414016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635559.335911:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876568427414016:12345-0@lo:400:kworker.0 Request processed in 21us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635559.335917:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1789635559.335930:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789635559.335947:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876568427413760:0@lo:400:kworker.0 00010000:00080000:3.0:1789635559.335961:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04467b9c00 x1876568427414272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635559.335972:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1876568427414272:0@lo:400:kworker.0 00000100:00100000:1.0:1789635559.336116:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427413632:0@lo:400:kworker.0 00000100:00100000:2.0:1789635559.336133:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635559.336149:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635559.336164:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1876568427413888:0@lo:400:kworker.0 00000100:00100000:2.0:1789635559.336191:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635559.336220:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427413376 00000100:00100000:2.0:1789635559.336224:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427413376 00000100:00100000:2.0:1789635559.336246:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427413888 00000100:00100000:2.0:1789635559.336248:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427413888 00000100:00100000:2.0:1789635559.336266:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789635559.336272:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876568427413376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635559.336316:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876568427413376:12345-0@lo:400:kworker.0 Request processed in 44us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635559.336322:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789635559.336335:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789635559.336342:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876568427413888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635559.336370:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876568427413888:12345-0@lo:400:kworker.0 Request processed in 29us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635559.336397:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1789635559.336412:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635559.336434:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876568427413376:0@lo:400:kworker.0 00000100:00100000:2.0:1789635559.336649:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1876568427413888:0@lo:400:kworker.0 00000100:00100000:3.0:1789635559.336811:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427412992 00000100:00100000:3.0:1789635559.336817:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427412992 00000100:00100000:3.0:1789635559.336853:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789635559.336860:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+24:3642:x1876568427412992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635559.336900:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+24:3642:x1876568427412992:12345-0@lo:400:kworker.0 Request processed in 40us (2494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635559.336906:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789635559.336950:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427413504 00000100:00100000:3.0:1789635559.336954:0:18189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427413504 00000100:00100000:3.0:1789635559.336977:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427413120 00000100:00100000:3.0:1789635559.336979:0:18189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427413120 00000100:00100000:3.0:1789635559.336992:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789635559.337008:0:18189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427413504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635559.337043:0:18189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427413504:12345-0@lo:400:kworker.0 Request processed in 36us (1357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635559.337050:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789635559.337063:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789635559.337069:0:18189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427413120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635559.337096:0:18189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427413120:12345-0@lo:400:kworker.0 Request processed in 27us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635559.337102:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789635559.337747:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427413632 00000100:00100000:2.0:1789635559.337754:0:18696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427413632 00000100:00100000:1.0:1789635559.337776:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1876568427414144:0@lo:400:kworker.0 00000100:00100000:1.0:1789635559.337815:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635559.337888:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3642:1876568427412992:0@lo:400:kworker.0 00000100:00100000:1.0:1789635559.337902:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427413504:0@lo:400:kworker.0 00010000:00080000:1.0:1789635559.337917:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d04467b9180 x1876568427414016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635559.337927:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1876568427414016:0@lo:400:kworker.0 00000100:00100000:1.0:1789635559.337955:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427413120:0@lo:400:kworker.0 00000100:00100000:0.0:1789635559.337999:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427414144 00000100:00100000:0.0:1789635559.338004:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427414144 00000100:00100000:2.0:1789635559.340543:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789635559.340563:0:18696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427413632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635559.340722:0:18696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427413632:12345-0@lo:400:kworker.0 Request processed in 165us (4573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635559.340729:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789635559.340946:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427413632:0@lo:400:kworker.0 00000100:00100000:0.0:1789635559.341106:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789635559.341117:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876568427414144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635559.341176:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876568427414144:12345-0@lo:400:kworker.0 Request processed in 57us (3356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635559.341183:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789635559.341217:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1876568427414144:0@lo:400:kworker.0 00000100:00080000:3.0:1789635559.341258:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789635559.341266:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789635559.459957:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789635560.361930:0:19416:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1dd3fc4f-a707-4c13-a2d4-7afae80fdb16 00000001:00100000:0.0:1789635560.361955:0:19416:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e93c6359-edaa-4c8b-af3f-bf6e406e4e94 00000001:00080000:0.0:1789635560.361965:0:19416:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:2.0:1789635560.484001:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789635561.500418:0:19973:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789635561.512863:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635561.892727:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427414400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789635561.893169:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635561.895059:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427414400 00000100:00100000:0.0:1789635561.895077:0:18606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427414400 00000100:00100000:0.0:1789635561.895189:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789635561.895203:0:18606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550661880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427414400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789635561.895248:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789635561.895344:0:18606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550661880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427414400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (2179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635561.895352:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1789635561.895481:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789635561.895652:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427414400:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1789635562.405921:0:17076:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1dd3fc4f-a707-4c13-a2d4-7afae80fdb16 00000001:00100000:3.0:1789635562.405935:0:17076:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e93c6359-edaa-4c8b-af3f-bf6e406e4e94 00000001:00100000:2.0:1789635562.406744:0:17828:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1dd3fc4f-a707-4c13-a2d4-7afae80fdb16 00000001:00100000:2.0:1789635562.406756:0:17828:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e93c6359-edaa-4c8b-af3f-bf6e406e4e94 00000001:00100000:0.0:1789635562.407453:0:18599:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1dd3fc4f-a707-4c13-a2d4-7afae80fdb16 00000001:00100000:0.0:1789635562.407464:0:18599:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e93c6359-edaa-4c8b-af3f-bf6e406e4e94 00010000:00010000:3.0:1789635562.538349:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789635562.852336:0:17130:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789635562.915774:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427414528:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789635562.915850:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635562.915954:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427414528 00000100:00100000:3.0:1789635562.915964:0:18606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427414528 00000100:00100000:3.0:1789635562.916030:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789635562.916041:0:18606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427414528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789635562.916065:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789635562.921765:0:18606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427414528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5718us (5905us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635562.921781:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1789635562.921820:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789635562.922480:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427414528:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789635563.427981:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427414656:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789635563.428055:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635563.428319:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427414784:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789635563.428358:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635563.428476:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427414656 00000100:00100000:2.0:1789635563.428485:0:18189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427414656 00000100:00100000:2.0:1789635563.428534:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427414784 00000100:00100000:2.0:1789635563.428538:0:18189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427414784 00000100:00100000:2.0:1789635563.428553:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789635563.428562:0:18189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427414656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789635563.428633:0:18189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789635563.428734:0:18189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427414656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 172us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635563.428742:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789635563.428758:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789635563.428765:0:18189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427414784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789635563.428780:0:18189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789635563.428815:0:18189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427414784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635563.428820:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789635563.428859:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427414784:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789635563.429082:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427414656:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789635563.556648:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635563.966084:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635563.966123:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635563.966154:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635563.966183:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635563.966207:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635563.966225:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635563.966244:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635563.966261:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635563.966284:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635563.966316:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411598080 00000100:00100000:2.0:1789635563.966325:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411598080 00000100:00100000:2.0:1789635563.966384:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411598592 00000100:00100000:2.0:1789635563.966388:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411598592 00000100:00100000:2.0:1789635563.966400:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411598208 00000100:00100000:2.0:1789635563.966402:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411598208 00000100:00100000:2.0:1789635563.966427:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411598720 00000100:00100000:2.0:1789635563.966429:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411598720 00000100:00100000:2.0:1789635563.966444:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 43 00000100:00100000:2.0:1789635563.966454:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+6:2397:x1876568411598080:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635563.966522:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+6:2397:x1876568411598080:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 69us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635563.966528:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 43 00000100:00100000:2.0:1789635563.966542:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 44 00000100:00100000:2.0:1789635563.966547:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+6:2397:x1876568411598592:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635563.966567:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+6:2397:x1876568411598592:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 20us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635563.966573:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 44 00000100:00100000:2.0:1789635563.966583:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 45 00000100:00100000:2.0:1789635563.966588:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+5:2396:x1876568411598208:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635563.966661:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+5:2396:x1876568411598208:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 72us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635563.966667:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 45 00000100:00100000:2.0:1789635563.966676:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 46 00000100:00100000:2.0:1789635563.966682:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+5:2396:x1876568411598720:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635563.966699:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+5:2396:x1876568411598720:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 18us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635563.966704:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 46 00000100:00100000:2.0:1789635563.966719:0:19724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411598336 00000100:00100000:2.0:1789635563.966722:0:19724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411598336 00000100:00100000:2.0:1789635563.966753:0:19724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411598464 00000100:00100000:2.0:1789635563.966756:0:19724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411598464 00000100:00100000:2.0:1789635563.966769:0:19724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411598976 00000100:00100000:2.0:1789635563.966771:0:19724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411598976 00000100:00100000:2.0:1789635563.966780:0:19724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411598848 00000100:00100000:2.0:1789635563.966782:0:19724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411598848 00000100:00100000:2.0:1789635563.966794:0:19724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:2.0:1789635563.966800:0:19724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550662d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+5:2397:x1876568411598336:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635563.966823:0:19724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550662d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+5:2397:x1876568411598336:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 24us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635563.966828:0:19724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:2.0:1789635563.966837:0:19724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:2.0:1789635563.966842:0:19724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+5:2396:x1876568411598464:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635563.966858:0:19724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+5:2396:x1876568411598464:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 17us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635563.966863:0:19724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:2.0:1789635563.966870:0:19724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:2.0:1789635563.966874:0:19724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550660e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+5:2396:x1876568411598976:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635563.966890:0:19724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550660e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+5:2396:x1876568411598976:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 15us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635563.966894:0:19724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:2.0:1789635563.966902:0:19724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:2.0:1789635563.966907:0:19724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550661180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+5:2397:x1876568411598848:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635563.966925:0:19724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550661180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+5:2397:x1876568411598848:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 18us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635563.966938:0:19724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00080000:2.0:1789635563.966962:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789635563.966965:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789635563.966968:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789635563.966970:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635563.967257:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411597952 00000100:00100000:1.0:1789635563.967263:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411597952 00000100:00100000:1.0:1789635563.967303:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 145 00000100:00100000:1.0:1789635563.967311:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+13:2396:x1876568411597952:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1789635563.967355:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+13:2396:x1876568411597952:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 45us (1281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635563.967367:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 145 00000040:00080000:1.0:1789635564.324528:0:17847:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789635564.451855:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789635564.451878:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550662300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427414912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789635564.451944:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635564.452006:0:18607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427414912 00000100:00100000:2.0:1789635564.452014:0:18607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427414912 00000100:00100000:2.0:1789635564.452063:0:18607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789635564.452073:0:18607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550663480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427414912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789635564.452102:0:18607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789635564.452142:0:18607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550663480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427414912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635564.452149:0:18607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1789635564.452168:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789635564.452194:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1789635564.452216:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550662300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427414912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635564.452402:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789635564.452414:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427415040:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789635564.452446:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635564.452475:0:18607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427415040 00000100:00100000:1.0:1789635564.452479:0:18607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427415040 00000100:00100000:1.0:1789635564.452507:0:18607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789635564.452514:0:18607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427415040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789635564.452524:0:18607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789635564.452554:0:18607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427415040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635564.452560:0:18607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1789635564.452583:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789635564.452620:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427415040:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789635564.452824:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427415424:0@lo:400:kworker.0 00000100:00100000:1.0:1789635564.452853:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635564.452882:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876568427415936:0@lo:400:kworker.0 00000100:00100000:1.0:1789635564.452903:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635564.452920:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1876568427416448:0@lo:400:kworker.0 00000100:00100000:1.0:1789635564.452937:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635564.452957:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789635564.452961:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427415296:0@lo:400:kworker.0 00000100:00100000:1.0:1789635564.452982:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635564.453007:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427415808:0@lo:400:kworker.0 00000100:00100000:1.0:1789635564.453047:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635564.453065:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1876568427416320:0@lo:400:kworker.0 00000100:00100000:1.0:1789635564.453085:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635564.453111:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427415936 00000100:00100000:1.0:1789635564.453115:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427415936 00000100:00100000:1.0:1789635564.453142:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427416448 00000100:00100000:1.0:1789635564.453146:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427416448 00000100:00100000:1.0:1789635564.453162:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427416320 00000100:00100000:1.0:1789635564.453164:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427416320 00000100:00100000:1.0:1789635564.453177:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789635564.453184:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876568427415936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635564.453222:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876568427415936:12345-0@lo:400:kworker.0 Request processed in 38us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635564.453228:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789635564.453241:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789635564.453247:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876568427416448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635564.453274:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876568427416448:12345-0@lo:400:kworker.0 Request processed in 27us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635564.453279:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789635564.453292:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789635564.453298:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876568427416320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635564.453322:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876568427416320:12345-0@lo:400:kworker.0 Request processed in 25us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635564.453327:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789635564.453359:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427415296 00000100:00100000:1.0:1789635564.453363:0:18189:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427415296 00000100:00100000:1.0:1789635564.453388:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789635564.453402:0:18189:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427415296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635564.453434:0:18189:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427415296:12345-0@lo:400:kworker.0 Request processed in 34us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635564.453440:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789635564.453464:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427415424 00000100:00100000:1.0:1789635564.453468:0:18602:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427415424 00000100:00100000:1.0:1789635564.453494:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427415808 00000100:00100000:1.0:1789635564.453497:0:18602:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427415808 00000100:00100000:1.0:1789635564.453518:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789635564.453524:0:18602:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427415424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635564.453555:0:18602:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427415424:12345-0@lo:400:kworker.0 Request processed in 32us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635564.453560:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789635564.453573:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789635564.453579:0:18602:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056c2d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427415808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635564.453628:0:18602:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056c2d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427415808:12345-0@lo:400:kworker.0 Request processed in 49us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635564.453634:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1789635564.453764:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789635564.453768:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789635564.453770:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789635564.453779:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3643:1876568427415168:0@lo:400:kworker.0 00000100:00100000:1.0:1789635564.453808:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635564.453848:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427415680:0@lo:400:kworker.0 00000100:00100000:1.0:1789635564.453870:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635564.453887:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427416192:0@lo:400:kworker.0 00000100:00100000:1.0:1789635564.453916:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635564.453934:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789635564.453939:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876568427415552:0@lo:400:kworker.0 00000100:00100000:1.0:1789635564.453958:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635564.453972:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1876568427416064:0@lo:400:kworker.0 00000100:00100000:1.0:1789635564.453988:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635564.454011:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427415168 00000100:00100000:1.0:1789635564.454014:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427415168 00000100:00100000:1.0:1789635564.454040:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789635564.454046:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+24:3643:x1876568427415168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635564.454081:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+24:3643:x1876568427415168:12345-0@lo:400:kworker.0 Request processed in 35us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635564.454087:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789635564.454111:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427415680 00000100:00100000:1.0:1789635564.454114:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427415680 00000100:00100000:1.0:1789635564.454143:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789635564.454148:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427415680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635564.454176:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876568427415680:12345-0@lo:400:kworker.0 Request processed in 28us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635564.454181:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789635564.454200:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427416192 00000100:00100000:1.0:1789635564.454204:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427416192 00000100:00100000:1.0:1789635564.454229:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427415552 00000100:00100000:1.0:1789635564.454232:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427415552 00000100:00100000:1.0:1789635564.454242:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427416064 00000100:00100000:1.0:1789635564.454244:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427416064 00000100:00100000:1.0:1789635564.454256:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789635564.454262:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876568427416192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635564.454298:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876568427416192:12345-0@lo:400:kworker.0 Request processed in 37us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635564.454304:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789635564.454316:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789635564.454321:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876568427415552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635564.454357:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876568427415552:12345-0@lo:400:kworker.0 Request processed in 36us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635564.454363:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789635564.454375:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789635564.454381:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876568427416064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635564.454409:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876568427416064:12345-0@lo:400:kworker.0 Request processed in 28us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635564.454414:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1789635564.454434:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789635564.454437:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789635564.454465:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427415296:0@lo:400:kworker.0 00000100:00100000:1.0:1789635564.454476:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427415808:0@lo:400:kworker.0 00000100:00100000:1.0:1789635564.454486:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1876568427416320:0@lo:400:kworker.0 00000100:00100000:1.0:1789635564.454495:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427415424:0@lo:400:kworker.0 00000100:00100000:1.0:1789635564.454505:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876568427415936:0@lo:400:kworker.0 00010000:00080000:1.0:1789635564.454515:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447b5f480 x1876568427416448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635564.454525:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1876568427416448:0@lo:400:kworker.0 00000100:00100000:1.0:1789635564.454566:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876568427415552:0@lo:400:kworker.0 00000100:00100000:1.0:1789635564.454575:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1876568427416064:0@lo:400:kworker.0 00000100:00100000:1.0:1789635564.454581:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3643:1876568427415168:0@lo:400:kworker.0 00000100:00100000:1.0:1789635564.454589:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1876568427415680:0@lo:400:kworker.0 00010000:00080000:1.0:1789635564.454622:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0447b5f100 x1876568427416192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635564.454630:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1876568427416192:0@lo:400:kworker.0 00010000:00010000:2.0:1789635564.582861:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789635564.702970:0:20121:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd1e06ad80 20000000:00000080:0.0:1789635564.702986:0:20121:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d0574329800 uarg=0000000000000000 20000000:01000000:0.0:1789635564.703140:0:20121:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789635564.703146:0:20121:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789635564.703151:0:20121:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789635564.704068:0:20122:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1789635564.704220:0:20121:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789635564.711243:0:20121:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789635564.711272:0:20121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d056e1a2000/0xb0c3a59caa41058d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635564.711487:0:20121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0446d1b000/0xb0c3a59caa410222 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa41021b expref: 23 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635564.711518:0:20121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d056e1a3400/0xb0c3a59caa410230 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa410229 expref: 23 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635564.711525:0:20121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d056e152a00/0xb0c3a59caa41026f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa410268 expref: 23 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635564.711530:0:20121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d056e152c00/0xb0c3a59caa4103d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa4103cd expref: 23 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635564.711539:0:20121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa41051d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab743d3 expref: 12 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635564.711545:0:20121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d056e1a3a00/0xb0c3a59caa41055c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74443 expref: 12 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635564.711552:0:20121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d056e1a2000/0xb0c3a59caa41058d lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635564.711593:0:20121:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d056e1a3a00/0xb0c3a59caa41055c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74443 expref: 12 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635564.712349:0:20121:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d056e1a3a00/0xb0c3a59caa41055c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74443 expref: 12 pid: 17089 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635564.712364:0:20121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550662300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20121:1876568427416576:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789635564.712466:0:20121:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa41051d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab743d3 expref: 12 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635564.712475:0:20121:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa41051d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab743d3 expref: 12 pid: 17090 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635564.712492:0:20121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550661f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20121:1876568427416704:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789635564.712528:0:20121:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d056e152c00/0xb0c3a59caa4103d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa4103cd expref: 23 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635564.712535:0:20121:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d056e152c00/0xb0c3a59caa4103d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa4103cd expref: 23 pid: 17090 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635564.712544:0:20121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550662d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20121:1876568427416832:0@lo:104: 00000100:00100000:2.0:1789635564.712579:0:20121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635564.713537:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427416832 00000100:00100000:0.0:1789635564.713545:0:17080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427416832 00000100:00100000:0.0:1789635564.713612:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789635564.713622:0:17080:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550661500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+3:20121:x1876568427416832:12345-0@lo:104: 00010000:00010000:0.0:1789635564.713636:0:17080:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d05488ff400/0xb0c3a59caa4103cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa4103d4 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635564.713690:0:17080:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789635564.713695:0:17080:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550661500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+3:20121:x1876568427416832:12345-0@lo:104: Request processed in 76us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635564.713702:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1789635564.713724:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635564.713729:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d05488ff400/0xb0c3a59caa4103cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa4103d4 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635564.713744:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488ff400 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:0.0:1789635564.713748:0:17084:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d05488ff400/0xb0c3a59caa4103cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa4103d4 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635564.713755:0:17084:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d05488ff400/0xb0c3a59caa4103cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa4103d4 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789635564.713762:0:17084:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d05488ff400/0xb0c3a59caa4103cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa4103d4 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635564.713768:0:17084:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789635564.713799:0:17084:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d05488ff400/0xb0c3a59caa4103cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa4103d4 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635564.713806:0:17084:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789635564.713827:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d05488ff400/0xb0c3a59caa4103cd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa4103d4 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635564.713835:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d05488ff400/0xb0c3a59caa4103cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa4103d4 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635564.713849:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635564.713851:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635564.713852:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635564.713870:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3642:1876568427416960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789635564.714016:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635564.714065:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427416960 00000100:00100000:0.0:1789635564.714069:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427416960 00010000:00010000:0.0:1789635564.714085:0:17082:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d056e152c00/0xb0c3a59caa4103d4 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa4103cd expref: 24 pid: 17090 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635564.714114:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789635564.714121:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+24:3642:x1876568427416960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789635564.714132:0:17082:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635564.714137:0:17082:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d056e152c00/0xb0c3a59caa4103d4 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa4103cd expref: 24 pid: 17090 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635564.714146:0:17082:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d056e152c00/0xb0c3a59caa4103d4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa4103cd expref: 24 pid: 17090 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635564.714163:0:17082:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635564.714193:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+24:3642:x1876568427416960:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635564.714200:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789635564.714235:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3642:1876568427416960:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789635564.720660:0:20121:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d056e152a00/0xb0c3a59caa41026f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa410268 expref: 23 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635564.720678:0:20121:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d056e152a00/0xb0c3a59caa41026f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa410268 expref: 23 pid: 17089 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635564.720693:0:20121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550660e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20121:1876568427417088:0@lo:104: 00000100:00100000:2.0:1789635564.720748:0:20121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789635564.720790:0:20121:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d056e1a3400/0xb0c3a59caa410230 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa410229 expref: 23 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635564.720798:0:20121:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d056e1a3400/0xb0c3a59caa410230 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa410229 expref: 23 pid: 17089 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635564.720806:0:20121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044791a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20121:1876568427417216:0@lo:104: 00000100:00100000:2.0:1789635564.720827:0:20121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789635564.720855:0:20121:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0446d1b000/0xb0c3a59caa410222 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb0c3a59caa41021b expref: 23 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635564.720882:0:20121:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d0446d1b000/0xb0c3a59caa410222 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb0c3a59caa41021b expref: 23 pid: 17090 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635564.720890:0:20121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044791ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20121:1876568427417344:0@lo:104: 00000100:00100000:0.0:1789635564.720977:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427417088 00000100:00100000:0.0:1789635564.720986:0:17080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427417088 00000100:00100000:0.0:1789635564.721022:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427417216 00000100:00100000:0.0:1789635564.721026:0:17080:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427417216 00000100:00100000:3.0:1789635564.721036:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789635564.721052:0:17079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550661180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+4:20121:x1876568427417088:12345-0@lo:104: 00010000:00010000:3.0:1789635564.721072:0:17079:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d05488fe200/0xb0c3a59caa410268 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa41026f expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635564.721130:0:17079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789635564.721136:0:17079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550661180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+4:20121:x1876568427417088:12345-0@lo:104: Request processed in 92us (388us total) trans 0 rc 0/0 00010000:00010000:1.0:1789635564.721171:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635564.721178:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d05488fe200/0xb0c3a59caa410268 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa41026f expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635564.721185:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488fe200 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:1.0:1789635564.721190:0:17085:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d05488fe200/0xb0c3a59caa410268 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa41026f expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635564.721199:0:17085:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d05488fe200/0xb0c3a59caa410268 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa41026f expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789635564.721206:0:17085:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d05488fe200/0xb0c3a59caa410268 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa41026f expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635564.721213:0:17085:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789635564.721245:0:17085:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d05488fe200/0xb0c3a59caa410268 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa41026f expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635564.721252:0:17085:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789635564.721278:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d05488fe200/0xb0c3a59caa410268 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa41026f expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635564.721297:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d05488fe200/0xb0c3a59caa410268 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa41026f expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635564.721313:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635564.721315:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635564.721317:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635564.721330:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3643:1876568427417472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789635564.721372:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635564.721409:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427417472 00000100:00100000:1.0:1789635564.721413:0:17081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427417472 00010000:00010000:1.0:1789635564.721432:0:17081:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d056e152a00/0xb0c3a59caa41026f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa410268 expref: 24 pid: 17089 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635564.721469:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789635564.721476:0:17081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+24:3643:x1876568427417472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789635564.721486:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635564.721491:0:17081:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d056e152a00/0xb0c3a59caa41026f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa410268 expref: 24 pid: 17089 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635564.721499:0:17081:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d056e152a00/0xb0c3a59caa41026f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa410268 expref: 24 pid: 17089 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635564.721514:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635564.721541:0:17081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+24:3643:x1876568427417472:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635564.721547:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789635564.721617:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3643:1876568427417472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789635564.721788:0:20121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635564.721812:0:20121:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05742e5900 going to sleep for 11 seconds 00000100:00100000:2.0:1789635564.721827:0:20121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550662300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20121:1876568427416576:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789635564.721836:0:20121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550661f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20121:1876568427416704:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789635564.721845:0:20121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056e152c00/0xb0c3a59caa4103d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa4103cd expref: 23 pid: 17090 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635564.721856:0:20121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550662d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20121:1876568427416832:0@lo:104: 00010000:00010000:2.0:1789635564.721864:0:20121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056e152a00/0xb0c3a59caa41026f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa410268 expref: 22 pid: 17089 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635564.721871:0:20121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550660e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20121:1876568427417088:0@lo:104: 00000100:00100000:2.0:1789635564.722590:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635564.722707:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635564.723430:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411599104 00000100:00100000:1.0:1789635564.723439:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411599104 00010000:00010000:1.0:1789635564.723470:0:17083:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d056e1a3a00/0xb0c3a59caa41055c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74443 expref: 13 pid: 17089 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635564.723507:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411599232 00000100:00100000:1.0:1789635564.723510:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411599232 00010000:00010000:1.0:1789635564.723522:0:17083:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa41051d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab743d3 expref: 14 pid: 17090 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635564.723537:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:1.0:1789635564.723545:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+14:2397:x1876568411599104:12345-192.168.203.20@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789635564.723613:0:17082:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789635564.723622:0:17082:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1789635564.723893:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635564.723911:0:17083:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d056e1a3a00/0xb0c3a59caa41055c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74443 expref: 14 pid: 17089 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635564.723924:0:17083:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d056e1a3a00/0xb0c3a59caa41055c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74443 expref: 14 pid: 17089 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635564.723941:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056e1a3a00/0xb0c3a59caa41055c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74443 expref: 14 pid: 17089 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635564.723956:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635564.724008:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+13:2397:x1876568411599104:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 463us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635564.724016:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:1.0:1789635564.724042:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:1.0:1789635564.724049:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ada680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+12:2397:x1876568411599232:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635564.724074:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635564.724079:0:17083:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa41051d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab743d3 expref: 12 pid: 17090 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635564.724088:0:17083:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa41051d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab743d3 expref: 12 pid: 17090 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635564.724098:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056e1a2800/0xb0c3a59caa41051d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab743d3 expref: 12 pid: 17090 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635564.724119:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635564.724138:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ada680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+11:2397:x1876568411599232:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 90us (1431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635564.724144:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:3.0:1789635564.727919:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789635564.727923:0:17080:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1789635564.727934:0:17080:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1789635564.728064:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427417344 00000100:00100000:3.0:1789635564.728073:0:17079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427417344 00000100:00100000:3.0:1789635564.728102:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789635564.728110:0:17079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447918e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+4:20121:x1876568427417216:12345-0@lo:104: 00010000:00010000:3.0:1789635564.728128:0:17079:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d056e153c00/0xb0c3a59caa410229 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa410230 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635564.728211:0:17079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789635564.728217:0:17079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447918e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+4:20121:x1876568427417216:12345-0@lo:104: Request processed in 108us (7390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635564.728223:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789635564.728234:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789635564.728240:0:17079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044791b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+3:20121:x1876568427417344:12345-0@lo:104: 00010000:00010000:3.0:1789635564.728247:0:17079:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff8d05488ffc00/0xb0c3a59caa41021b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa410222 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635564.728275:0:17079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789635564.728279:0:17079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044791b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+3:20121:x1876568427417344:12345-0@lo:104: Request processed in 41us (7132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635564.728285:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1789635564.728368:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789635564.728567:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d056e153c00/0xb0c3a59caa410229 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa410230 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635564.728577:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e153c00 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:3.0:1789635564.728581:0:17084:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d056e153c00/0xb0c3a59caa410229 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa410230 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635564.728589:0:17084:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d056e153c00/0xb0c3a59caa410229 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa410230 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789635564.728618:0:17084:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d056e153c00/0xb0c3a59caa410229 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa410230 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635564.728624:0:17084:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789635564.728660:0:17084:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d056e153c00/0xb0c3a59caa410229 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa410230 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635564.728667:0:17084:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789635564.728688:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d056e153c00/0xb0c3a59caa410229 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa410230 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635564.728695:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d056e153c00/0xb0c3a59caa410229 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa410230 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635564.728705:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635564.728708:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff8d05488ffc00/0xb0c3a59caa41021b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb0c3a59caa410222 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635564.728714:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488ffc00 already unused, calling callback (ffffffffc1537c20) 10000000:00010000:3.0:1789635564.728716:0:17084:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff8d05488ffc00/0xb0c3a59caa41021b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb0c3a59caa410222 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635564.728734:0:17084:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff8d05488ffc00/0xb0c3a59caa41021b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb0c3a59caa410222 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789635564.728741:0:17084:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff8d05488ffc00/0xb0c3a59caa41021b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb0c3a59caa410222 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635564.728746:0:17084:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789635564.728761:0:17084:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff8d05488ffc00/0xb0c3a59caa41021b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa410222 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635564.728766:0:17084:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789635564.728773:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff8d05488ffc00/0xb0c3a59caa41021b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa410222 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635564.728779:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff8d05488ffc00/0xb0c3a59caa41021b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb0c3a59caa410222 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635564.728978:0:20121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044791a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20121:1876568427417216:0@lo:104: 00000100:00100000:2.0:1789635564.728993:0:20121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044791ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20121:1876568427417344:0@lo:104: 00010000:00010000:2.0:1789635564.729027:0:20121:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d056e1a2000/0xb0c3a59caa41058d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635564.729072:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635564.729074:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635564.729077:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635564.729093:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3640:1876568427417600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789635564.729152:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635564.729198:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427417600 00000100:00100000:1.0:1789635564.729203:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427417600 00000100:00100000:3.0:1789635564.729214:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789635564.729220:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3640:1876568427417728:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789635564.729222:0:17083:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d056e1a3400/0xb0c3a59caa410230 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa410229 expref: 22 pid: 17089 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635564.729242:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635564.729378:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427417728 00010000:00010000:3.0:1789635564.729401:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635564.729433:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789635564.729443:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447afb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+22:3640:x1876568427417600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789635564.729508:0:17082:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635564.729515:0:17082:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d056e1a3400/0xb0c3a59caa410230 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa410229 expref: 22 pid: 17089 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635564.729528:0:17082:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d056e1a3400/0xb0c3a59caa410230 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa410229 expref: 22 pid: 17089 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635564.729548:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056e1a3400/0xb0c3a59caa410230 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa410229 expref: 22 pid: 17089 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635564.729561:0:17082:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635564.729562:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427417728 00010000:00010000:1.0:1789635564.729576:0:17083:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0446d1b000/0xb0c3a59caa410222 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa41021b expref: 22 pid: 17090 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635564.729613:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789635564.729620:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+22:3640:x1876568427417728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789635564.729628:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789635564.729629:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447afb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+22:3640:x1876568427417600:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (477us total) trans 0 rc 0/0 00010000:00010000:1.0:1789635564.729632:0:17083:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0446d1b000/0xb0c3a59caa410222 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb0c3a59caa41021b expref: 22 pid: 17090 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635564.729636:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1789635564.729651:0:17083:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0446d1b000/0xb0c3a59caa410222 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb0c3a59caa41021b expref: 22 pid: 17090 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635564.729660:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0446d1b000/0xb0c3a59caa410222 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb0c3a59caa41021b expref: 21 pid: 17090 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635564.729671:0:17083:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d056e1a2000/0xb0c3a59caa41058d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635564.729679:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d056e1a2000/0xb0c3a59caa41058d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635564.729692:0:17083:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d056e1a2000/0xb0c3a59caa41058d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635564.729699:0:17083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d056e1a2000/0xb0c3a59caa41058d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635564.729706:0:17083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d056e1a2000/0xb0c3a59caa41058d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635564.729713:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d056e1a2000/0xb0c3a59caa41058d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635564.729719:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a2000 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:1.0:1789635564.729723:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d056e1a2000/0xb0c3a59caa41058d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635564.729730:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d056e1a2000/0xb0c3a59caa41058d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635564.729743:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3640:1876568427417600:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789635564.729761:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d056e1a2000/0xb0c3a59caa41058d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635564.729771:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789635564.729783:0:20121:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d056e1a2000/0xb0c3a59caa41058d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635564.729791:0:20121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d056e1a2000/0xb0c3a59caa41058d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635564.729798:0:20121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d056e1a2000/0xb0c3a59caa41058d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635564.731046:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+20:3640:x1876568427417728:12345-0@lo:103:ldlm_bl.0 Request processed in 1422us (1798us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635564.731062:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789635564.731488:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3640:1876568427417728:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789635565.606436:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635565.885823:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635565.885922:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411599360 00000100:00100000:0.0:1789635565.885940:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411599360 00000100:00100000:0.0:1789635565.885998:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 147 00000100:00100000:0.0:1789635565.886008:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+11:14886:x1876568411599360:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789635565.886025:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635565.886044:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0549f43800/0xb0c3a59caa410594 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7447b expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635565.886072:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0549f43800/0xb0c3a59caa410594 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7447b expref: 12 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635565.886096:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0549f43800/0xb0c3a59caa410594 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7447b expref: 12 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635565.886105:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0549f43800, rc 0) 00000100:00100000:0.0:1789635565.886159:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+12:14886:x1876568411599360:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 Request processed in 152us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635565.886167:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 147 00000100:00100000:1.0:1789635565.900810:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635565.900872:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411599488 00000100:00100000:3.0:1789635565.900903:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411599488 00000100:00100000:3.0:1789635565.900959:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 148 00000100:00100000:3.0:1789635565.900968:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+12:14886:x1876568411599488:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635565.901119:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+12:14886:x1876568411599488:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 Request processed in 151us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635565.901127:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 148 00000100:00100000:0.0:1789635565.920914:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635565.921123:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411599616 00000100:00100000:3.0:1789635565.921135:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411599616 00000100:00100000:3.0:1789635565.921192:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 149 00000100:00100000:3.0:1789635565.921202:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+12:14886:x1876568411599616:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789635565.921354:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+12:14886:x1876568411599616:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 Request processed in 152us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635565.921362:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 149 00000100:00100000:0.0:1789635565.935975:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635565.936205:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411599744 00000100:00100000:3.0:1789635565.936216:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411599744 00000100:00100000:3.0:1789635565.936270:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 150 00000100:00100000:3.0:1789635565.936278:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575d58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+12:14886:x1876568411599744:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789635565.936301:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635565.936320:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d05488ffc00/0xb0c3a59caa41059b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74482 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635565.936357:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d05488ffc00/0xb0c3a59caa41059b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74482 expref: 13 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635565.936368:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d05488ffc00/0xb0c3a59caa41059b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74482 expref: 13 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635565.936390:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05488ffc00, rc 0) 00000100:00100000:3.0:1789635565.936459:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575d58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+13:14886:x1876568411599744:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 Request processed in 181us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635565.936466:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 150 00000100:00100000:2.0:1789635565.948450:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635565.952462:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411599872 00000100:00100000:0.0:1789635565.952476:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411599872 00000100:00100000:0.0:1789635565.952536:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 151 00000100:00100000:0.0:1789635565.952546:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+13:14886:x1876568411599872:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789635565.952718:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+13:14886:x1876568411599872:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 Request processed in 173us (6132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635565.952726:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 151 00000100:00100000:3.0:1789635565.957821:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635565.958029:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411600000 00000100:00100000:1.0:1789635565.958040:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411600000 00000100:00100000:1.0:1789635565.958091:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 152 00000100:00100000:1.0:1789635565.958100:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+13:14886:x1876568411600000:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789635565.958238:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+13:14886:x1876568411600000:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 Request processed in 137us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635565.958246:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 152 10000000:01000000:0.0:1789635566.307876:0:17094:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789635566.307883:0:17094:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d04410af800 from 13 10000000:01000000:0.0:1789635566.307888:0:17094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789635566.307997:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d0549f43000/0xb0c3a59caa4105a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635566.308009:0:17094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d0549f43000/0xb0c3a59caa4105a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635566.308021:0:17094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d0549f43000/0xb0c3a59caa4105a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635566.308055:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427417856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789635566.308119:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635566.308200:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0551531480 going to sleep for 11 seconds 00000100:00100000:3.0:1789635566.309556:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427417856 00000100:00100000:3.0:1789635566.309568:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427417856 00000100:00100000:3.0:1789635566.309628:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789635566.309639:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+20:17094:x1876568427417856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789635566.309654:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635566.309751:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d05488ff200/0xb0c3a59caa4105a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa4105a2 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635566.309781:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d05488ff200/0xb0c3a59caa4105a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa4105a2 expref: 21 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635566.309792:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d05488ff200/0xb0c3a59caa4105a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa4105a2 expref: 21 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635566.309802:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05488ff200, rc 0) 00000100:00100000:3.0:1789635566.309868:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+21:17094:x1876568427417856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 231us (1748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635566.309876:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789635566.310607:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427417856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789635566.310630:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d0549f43000/0xb0c3a59caa4105a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4105a9 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635566.310641:0:17094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d0549f43000/0xb0c3a59caa4105a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa4105a9 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635566.310719:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427417984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789635566.310758:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635566.310799:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0551531480 going to sleep for 11 seconds 00000100:00100000:3.0:1789635566.311061:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427417984 00000100:00100000:3.0:1789635566.311068:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427417984 00000100:00100000:3.0:1789635566.311114:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789635566.311123:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+21:17094:x1876568427417984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635566.311250:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+21:17094:x1876568427417984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635566.311257:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789635566.311353:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427417984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789635566.311395:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427418112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789635566.311441:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635566.311464:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0551531480 going to sleep for 11 seconds 00000100:00100000:0.0:1789635566.311477:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427418112 00000100:00100000:0.0:1789635566.311481:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427418112 00000100:00100000:0.0:1789635566.311506:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789635566.311512:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+21:17094:x1876568427418112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789635566.311588:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+21:17094:x1876568427418112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635566.311622:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789635566.311669:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427418112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789635566.312771:0:20199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789635566.313079:0:17094:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789635566.313106:0:17094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789635566.313116:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d0549f43000/0xb0c3a59caa4105a2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4105a9 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635566.313141:0:17094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d0549f43000/0xb0c3a59caa4105a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4105a9 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635566.313153:0:17094:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789635566.313175:0:17094:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0447985000 from 13 10000000:01000000:3.0:1789635566.313179:0:17094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789635566.313219:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05488ff800/0xb0c3a59caa4105b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635566.313228:0:17094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d05488ff800/0xb0c3a59caa4105b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635566.313239:0:17094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d05488ff800/0xb0c3a59caa4105b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635566.313264:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427418240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789635566.313322:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635566.313356:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d056e0136c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635566.313374:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427418240 00000100:00100000:3.0:1789635566.313671:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427418240 00000100:00100000:3.0:1789635566.313718:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789635566.313727:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+21:17094:x1876568427418240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789635566.313768:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635566.313782:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d05488ff400/0xb0c3a59caa4105b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa4105b0 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635566.313804:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d05488ff400/0xb0c3a59caa4105b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa4105b0 expref: 22 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635566.313815:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d05488ff400/0xb0c3a59caa4105b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa4105b0 expref: 22 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635566.313824:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05488ff400, rc 0) 00000100:00100000:3.0:1789635566.313865:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+22:17094:x1876568427418240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635566.313872:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789635566.313915:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427418240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789635566.314039:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d05488ff800/0xb0c3a59caa4105b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4105b7 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635566.314050:0:17094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d05488ff800/0xb0c3a59caa4105b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa4105b7 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635566.314111:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427418368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635566.314140:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635566.315913:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d056e0136c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635566.316257:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427418368 00000100:00100000:0.0:1789635566.316266:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427418368 00000100:00100000:0.0:1789635566.316317:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789635566.316338:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+22:17094:x1876568427418368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789635566.316789:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+22:17094:x1876568427418368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 446us (2631us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635566.316797:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789635566.316968:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427418368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635566.317072:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427418496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789635566.317160:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635566.317206:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d056e0136c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635566.317356:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427418496 00000100:00100000:0.0:1789635566.317362:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427418496 00000100:00100000:0.0:1789635566.317541:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789635566.317578:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+22:17094:x1876568427418496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789635566.317757:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+22:17094:x1876568427418496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 192us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635566.317764:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789635566.317846:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427418496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789635566.325513:0:20200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789635566.328962:0:17094:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789635566.329007:0:17094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789635566.329019:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d05488ff800/0xb0c3a59caa4105b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4105b7 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635566.329032:0:17094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d05488ff800/0xb0c3a59caa4105b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4105b7 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635566.329043:0:17094:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789635566.329046:0:17094:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0550104800 from 13 10000000:01000000:0.0:1789635566.329058:0:17094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789635566.329095:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d0549f43200/0xb0c3a59caa4105be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635566.329103:0:17094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d0549f43200/0xb0c3a59caa4105be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635566.329113:0:17094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d0549f43200/0xb0c3a59caa4105be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635566.329136:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427418624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789635566.329201:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635566.329246:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0551531cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635566.329369:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427418624 00000100:00100000:3.0:1789635566.329378:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427418624 00000100:00100000:3.0:1789635566.329448:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789635566.329458:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+22:17094:x1876568427418624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789635566.329471:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635566.329484:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d05488fe200/0xb0c3a59caa4105c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa4105be expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635566.329506:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d05488fe200/0xb0c3a59caa4105c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa4105be expref: 23 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635566.329516:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d05488fe200/0xb0c3a59caa4105c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa4105be expref: 23 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635566.329525:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05488fe200, rc 0) 00000100:00100000:3.0:1789635566.329568:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+23:17094:x1876568427418624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635566.329575:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789635566.330262:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427418624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635566.330281:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d0549f43200/0xb0c3a59caa4105be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4105c5 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635566.330291:0:17094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d0549f43200/0xb0c3a59caa4105be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa4105c5 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635566.331183:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427418752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635566.331239:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635566.331280:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05655fed80 going to sleep for 11 seconds 00000100:00100000:1.0:1789635566.332523:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427418752 00000100:00100000:1.0:1789635566.332535:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427418752 00000100:00100000:1.0:1789635566.332610:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789635566.332621:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+23:17094:x1876568427418752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635566.332762:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+23:17094:x1876568427418752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (1522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635566.332769:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789635566.332823:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427418752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635566.332865:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427418880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789635566.332917:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635566.332958:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05655b9000 going to sleep for 11 seconds 00000100:00100000:1.0:1789635566.332971:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427418880 00000100:00100000:1.0:1789635566.332975:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427418880 00000100:00100000:1.0:1789635566.332997:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789635566.333004:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+23:17094:x1876568427418880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789635566.333087:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+23:17094:x1876568427418880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635566.333094:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789635566.333134:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427418880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789635566.334826:0:20203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789635566.335053:0:17094:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789635566.335075:0:17094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789635566.335086:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d0549f43200/0xb0c3a59caa4105be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4105c5 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635566.335098:0:17094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d0549f43200/0xb0c3a59caa4105be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4105c5 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635566.335109:0:17094:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789635566.335112:0:17094:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d054b800800 from 13 10000000:01000000:2.0:1789635566.335114:0:17094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789635566.335146:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3800/0xb0c3a59caa4105cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635566.335153:0:17094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3800/0xb0c3a59caa4105cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635566.335161:0:17094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3800/0xb0c3a59caa4105cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635566.335194:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575adb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427419008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789635566.335249:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635566.335291:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05655fe840 going to sleep for 11 seconds 00000100:00100000:1.0:1789635566.335405:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427419008 00000100:00100000:1.0:1789635566.335421:0:17089:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427419008 00000100:00100000:1.0:1789635566.335464:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789635566.335474:0:17089:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+23:17094:x1876568427419008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789635566.335487:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635566.335499:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d05820d2a00/0xb0c3a59caa4105d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb0c3a59caa4105cc expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635566.335521:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d05820d2a00/0xb0c3a59caa4105d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb0c3a59caa4105cc expref: 24 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635566.335531:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d05820d2a00/0xb0c3a59caa4105d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb0c3a59caa4105cc expref: 24 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635566.335538:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05820d2a00, rc 0) 00000100:00100000:1.0:1789635566.335577:0:17089:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3d8f284-7347-44bd-9697-6e3097b3c5ae+24:17094:x1876568427419008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635566.335590:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789635566.335714:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575adb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427419008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789635566.335727:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3800/0xb0c3a59caa4105cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4105d3 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635566.335736:0:17094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3800/0xb0c3a59caa4105cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb0c3a59caa4105d3 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635566.335790:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427419136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635566.335815:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635566.335831:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05655b93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635566.335844:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427419136 00000100:00100000:1.0:1789635566.335848:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427419136 00000100:00100000:1.0:1789635566.335871:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789635566.335877:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+24:17094:x1876568427419136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635566.335991:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+24:17094:x1876568427419136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635566.335998:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789635566.336029:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427419136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635566.336054:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427419264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789635566.336089:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635566.336101:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05655b93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635566.336112:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427419264 00000100:00100000:1.0:1789635566.336115:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427419264 00000100:00100000:1.0:1789635566.336134:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789635566.336146:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+24:17094:x1876568427419264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789635566.336215:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3d8f284-7347-44bd-9697-6e3097b3c5ae+24:17094:x1876568427419264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635566.336222:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789635566.336261:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e3d8f284-7347-44bd-9697-6e3097b3c5ae:17094:1876568427419264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789635566.336947:0:20204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789635566.336993:0:17094:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789635566.337008:0:17094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789635566.337015:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3800/0xb0c3a59caa4105cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4105d3 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635566.337025:0:17094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff8d056e1a3800/0xb0c3a59caa4105cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb0c3a59caa4105d3 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635566.629565:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635567.012099:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789635567.012123:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04467b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427419392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789635567.012195:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635567.012302:0:18607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427419392 00000100:00100000:1.0:1789635567.012311:0:18607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427419392 00000100:00080000:2.0:1789635567.012540:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789635567.012579:0:18607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789635567.012590:0:18607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427419392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789635567.012660:0:18607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789635567.012716:0:18607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427419392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635567.012724:0:18607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789635567.013398:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04467b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427419392:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789635567.658675:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635568.035839:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789635568.035862:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d04459e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427419520:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789635568.035930:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635568.037507:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427419520 00000100:00100000:3.0:1789635568.037519:0:18606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427419520 00000100:00100000:3.0:1789635568.037591:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789635568.037614:0:18606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427419520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789635568.037637:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00080000:2.0:1789635568.037675:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789635568.037715:0:18606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427419520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (1785us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635568.037722:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789635568.037897:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d04459e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427419520:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789635568.052378:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635568.052467:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411600128 00000100:00100000:1.0:1789635568.052478:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411600128 00000100:00100000:1.0:1789635568.052570:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:1.0:1789635568.052582:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+6:15552:x1876568411600128:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789635568.052636:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635568.052663:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d2000/0xb0c3a59caa4105da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74489 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.052731:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3c00/0xb0c3a59caa4105e1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.052745:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3c00/0xb0c3a59caa4105e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.052759:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3c00/0xb0c3a59caa4105e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.052773:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d2600/0xb0c3a59caa4105e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.052781:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d2600/0xb0c3a59caa4105e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.052788:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d2600/0xb0c3a59caa4105e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.052876:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d2c00/0xb0c3a59caa4105ef lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.052884:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d2c00/0xb0c3a59caa4105ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.052909:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d2c00/0xb0c3a59caa4105ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635568.052943:0:17096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789635568.052946:0:17096:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789635568.052983:0:17096:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d2c00/0xb0c3a59caa4105ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.053187:0:17096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3c00/0xb0c3a59caa4105e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.053196:0:17096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3c00/0xb0c3a59caa4105e1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.053202:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3c00/0xb0c3a59caa4105e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.053208:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05820d3c00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635568.053213:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3c00/0xb0c3a59caa4105e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.053220:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3c00/0xb0c3a59caa4105e1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.053232:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d05446d0700) 00010000:00010000:1.0:1789635568.053235:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635568.053240:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3c00/0xb0c3a59caa4105e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.053258:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3c00/0xb0c3a59caa4105e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.053284:0:17096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d2600/0xb0c3a59caa4105e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.053290:0:17096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d2600/0xb0c3a59caa4105e8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.053296:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d2600/0xb0c3a59caa4105e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.053301:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05820d2600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635568.053304:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d2600/0xb0c3a59caa4105e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.053321:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d2600/0xb0c3a59caa4105e8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.053330:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8d054d47f200) 00010000:00010000:1.0:1789635568.053333:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635568.053336:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d2600/0xb0c3a59caa4105e8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.053341:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d2600/0xb0c3a59caa4105e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.053385:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d2000/0xb0c3a59caa4105da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74489 expref: 8 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.053398:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d2c00/0xb0c3a59caa4105ef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74489 expref: 7 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.053418:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d054d47ff00) 00010000:00010000:1.0:1789635568.053421:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789635568.053424:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05820d2c00, rc 0) 00000100:00100000:1.0:1789635568.053498:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+7:15552:x1876568411600128:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 917us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635568.053506:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00080000:2.0:1789635568.054256:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635568.062370:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635568.063415:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411600256 00000100:00100000:0.0:1789635568.063430:0:17107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411600256 00000100:00100000:0.0:1789635568.063505:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:0.0:1789635568.063516:0:17107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+7:15552:x1876568411600256:12345-192.168.203.20@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789635568.063662:0:17107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+7:15552:x1876568411600256:12345-192.168.203.20@tcp:900:lhsmtool_posix.0 Request processed in 147us (1305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635568.063670:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:0.0:1789635568.078155:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635568.081406:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411600512 00000100:00100000:1.0:1789635568.081421:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411600512 00000100:00100000:1.0:1789635568.082017:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:1.0:1789635568.082030:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+7:15552:x1876568411600512:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789635568.082049:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635568.082067:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d2600/0xb0c3a59caa4105f6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74490 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.082136:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3c00/0xb0c3a59caa4105fd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.082149:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3c00/0xb0c3a59caa4105fd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.082160:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3c00/0xb0c3a59caa4105fd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.082201:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3800/0xb0c3a59caa410604 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.082208:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3800/0xb0c3a59caa410604 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.082226:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3800/0xb0c3a59caa410604 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.082350:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d2000/0xb0c3a59caa41060b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.082359:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d2000/0xb0c3a59caa41060b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.082365:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d2000/0xb0c3a59caa41060b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635568.082374:0:17097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1789635568.082509:0:17097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3c00/0xb0c3a59caa4105fd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.082517:0:17097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3c00/0xb0c3a59caa4105fd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.082523:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3c00/0xb0c3a59caa4105fd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.082529:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05820d3c00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635568.082532:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3c00/0xb0c3a59caa4105fd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.082550:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3c00/0xb0c3a59caa4105fd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.082561:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d054d47ff00) 00010000:00010000:1.0:1789635568.082564:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635568.082574:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3c00/0xb0c3a59caa4105fd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.082580:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3c00/0xb0c3a59caa4105fd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.082594:0:17097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3800/0xb0c3a59caa410604 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.082645:0:17097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3800/0xb0c3a59caa410604 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.082651:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3800/0xb0c3a59caa410604 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.082656:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05820d3800 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635568.082659:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3800/0xb0c3a59caa410604 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.082664:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3800/0xb0c3a59caa410604 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.082672:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d054d47f200) 00010000:00010000:1.0:1789635568.082674:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635568.082677:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3800/0xb0c3a59caa410604 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.082682:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3800/0xb0c3a59caa410604 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.087195:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d2600/0xb0c3a59caa4105f6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74490 expref: 10 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.087241:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d2000/0xb0c3a59caa41060b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74490 expref: 9 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.087250:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d054d47fb00) 00010000:00010000:1.0:1789635568.087253:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635568.087257:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05820d2000, rc 0) 00000100:00100000:1.0:1789635568.087544:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+9:15552:x1876568411600512:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 5308us (9187us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789635568.087556:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:1.0:1789635568.103467:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635568.105900:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411600640 00000100:00100000:2.0:1789635568.105915:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411600640 00000100:00100000:2.0:1789635568.105986:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:2.0:1789635568.105997:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+9:15552:x1876568411600640:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789635568.106163:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+9:15552:x1876568411600640:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 Request processed in 167us (2703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635568.106172:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:2.0:1789635568.109150:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635568.109255:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411600768 00000100:00100000:1.0:1789635568.109265:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411600768 00000100:00100000:1.0:1789635568.109364:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 26 00000100:00100000:1.0:1789635568.109376:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+5:15552:x1876568411600768:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1789635568.115652:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1789635568.116522:0:17098:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 7098us 00000100:00100000:1.0:1789635568.124941:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635568.125443:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411600896 00000100:00100000:3.0:1789635568.125453:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411600896 00000100:00100000:3.0:1789635568.125507:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:3.0:1789635568.125516:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+9:15558:x1876568411600896:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789635568.125710:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635568.125732:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa410619 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74497 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.125803:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa410620 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.125817:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa410620 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.125828:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa410620 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.125840:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa410627 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.125847:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa410627 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.125853:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa410627 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.125892:0:17096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa410620 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.125912:0:17096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa410620 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.125919:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa410620 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.125924:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e153c00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635568.125928:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa410620 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.125935:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa410620 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.125947:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d05446d0700) 00010000:00010000:3.0:1789635568.125950:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635568.125954:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa410620 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.125960:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa410620 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.125972:0:17096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa410627 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.125977:0:17096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa410627 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.125983:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa410627 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.125987:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152a00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635568.125993:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa410627 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.126000:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa410627 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.126006:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d05446d0400) 00010000:00010000:3.0:1789635568.126009:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635568.126011:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa410627 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.126016:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa410627 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.126044:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa410619 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74497 expref: 10 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.126052:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d05446d0700) 00010000:00010000:3.0:1789635568.126054:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635568.126057:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa410619 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74497 expref: 10 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.126065:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05488ffe00, rc 0) 00000100:00100000:3.0:1789635568.126176:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+9:15558:x1876568411600896:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 660us (1243us total) trans 0 rc 301/301 00000100:00100000:3.0:1789635568.126184:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:3.0:1789635568.133450:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635568.133887:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411601024 00000100:00100000:0.0:1789635568.133897:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411601024 00000100:00100000:0.0:1789635568.133950:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:0.0:1789635568.133959:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+9:15558:x1876568411601024:12345-192.168.203.20@tcp:700:lfs.0 00000100:00100000:0.0:1789635568.134036:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+9:15558:x1876568411601024:12345-192.168.203.20@tcp:700:lfs.0 Request processed in 77us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635568.134055:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:0.0:1789635568.136404:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635568.136469:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411601280 00000100:00100000:3.0:1789635568.136477:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411601280 00000100:00100000:3.0:1789635568.136537:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:3.0:1789635568.136566:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+9:15558:x1876568411601280:12345-192.168.203.20@tcp:36:lfs.0 00010000:00010000:3.0:1789635568.136642:0:17097:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635568.136667:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa410547 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74404 expref: 9 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.136685:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d05446d0700) 00010000:00010000:3.0:1789635568.136690:0:17097:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789635568.136742:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152c00/0xb0c3a59caa41062e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.136756:0:17097:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa410586 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74474 expref: 5 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.136764:0:17097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152c00/0xb0c3a59caa41062e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.136796:0:17097:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa410586 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74474 expref: 5 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.136809:0:17097:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa410586 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74474 expref: 5 pid: 17097 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635568.136825:0:17097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17097:1876568427419648:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789635568.136904:0:17097:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0447552180 going to sleep for 11 seconds 00000100:00100000:2.0:1789635568.145903:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+5:15552:x1876568411600768:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 Request processed in 36517us (36751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635568.145918:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 26 00000100:00100000:3.0:1789635568.147287:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635568.147379:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411601408 00000100:00100000:2.0:1789635568.147389:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411601408 00010000:00010000:2.0:1789635568.147459:0:17082:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa410586 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74474 expref: 6 pid: 17097 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635568.147493:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00100000:2.0:1789635568.147503:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+6:2396:x1876568411601408:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635568.147515:0:17082:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635568.147522:0:17082:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa410586 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74474 expref: 6 pid: 17097 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.147551:0:17082:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa410586 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74474 expref: 6 pid: 17097 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.147576:0:17082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d05446d0700) 00010000:00010000:2.0:1789635568.147581:0:17082:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152c00/0xb0c3a59caa41062e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.147590:0:17082:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152c00/0xb0c3a59caa41062e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.147619:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152c00/0xb0c3a59caa41062e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.147639:0:17082:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635568.147685:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+6:2396:x1876568411601408:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 183us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635568.147692:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00080000:3.0:1789635568.148278:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789635568.149213:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa410586 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74474 expref: 5 pid: 17097 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635568.149236:0:17097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17097:1876568427419648:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789635568.149258:0:17097:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152c00/0xb0c3a59caa41062e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.149268:0:17097:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152c00/0xb0c3a59caa41062e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.149274:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152c00/0xb0c3a59caa41062e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.149321:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3800/0xb0c3a59caa410635 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.149333:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3800/0xb0c3a59caa410635 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.149341:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3800/0xb0c3a59caa410635 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.165060:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3c00/0xb0c3a59caa41063c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.165084:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3c00/0xb0c3a59caa41063c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.165095:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3c00/0xb0c3a59caa41063c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789635568.165113:0:17097:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ff15cfd reply state 000000000fa2c001 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3c00/0xb0c3a59caa41063c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.165125:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3c00/0xb0c3a59caa41063c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.165131:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d054d47f100) 00010000:00010000:1.0:1789635568.165133:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789635568.165137:0:17097:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789635568.165143:0:17097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789635568.165150:0:17097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152c00/0xb0c3a59caa41062e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.165171:0:17097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152c00/0xb0c3a59caa41062e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.165185:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152c00/0xb0c3a59caa41062e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.165192:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152c00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635568.165196:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152c00/0xb0c3a59caa41062e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.165205:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152c00/0xb0c3a59caa41062e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.165215:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d05446d0700) 00010000:00010000:1.0:1789635568.165218:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635568.165222:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152c00/0xb0c3a59caa41062e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.165228:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152c00/0xb0c3a59caa41062e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789635568.165244:0:17097:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ff15cfd reply state 000000000fa2c001 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3800/0xb0c3a59caa410635 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.165253:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3800/0xb0c3a59caa410635 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.165259:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d054d47f200) 00010000:00010000:1.0:1789635568.165261:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789635568.165263:0:17097:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789635568.165364:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+10:15558:x1876568411601280:12345-192.168.203.20@tcp:36:lfs.0 Request processed in 28796us (28975us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789635568.165383:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:0.0:1789635568.262885:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635568.267849:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411601536 00000100:00100000:1.0:1789635568.267866:0:17848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411601536 00000100:00100000:1.0:1789635568.267930:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:1.0:1789635568.267950:0:17848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+10:15566:x1876568411601536:12345-192.168.203.20@tcp:101:lctl.0 00010000:00010000:1.0:1789635568.267974:0:17848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635568.267998:0:17848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3200/0xb0c3a59caa410643 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7449e expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.268062:0:17848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3600/0xb0c3a59caa41064a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.268075:0:17848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3600/0xb0c3a59caa41064a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.268085:0:17848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3600/0xb0c3a59caa41064a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635568.268126:0:17848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789635568.268130:0:17848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789635568.268186:0:17848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3600/0xb0c3a59caa41064a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.268211:0:17848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3200/0xb0c3a59caa410643 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7449e expref: 12 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.268229:0:17848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3600/0xb0c3a59caa41064a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7449e expref: 11 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.268237:0:17848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d054d47f700) 00010000:00010000:1.0:1789635568.268240:0:17848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789635568.268256:0:17848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05820d3600, rc 0) 00000100:00100000:1.0:1789635568.268338:0:17848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+11:15566:x1876568411601536:12345-192.168.203.20@tcp:101:lctl.0 Request processed in 399us (5462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635568.268345:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:3.0:1789635568.294738:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635568.294906:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411601664 00000100:00100000:2.0:1789635568.294916:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411601664 00000100:00100000:2.0:1789635568.294989:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:2.0:1789635568.295017:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+5:15567:x1876568411601664:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1789635568.295036:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635568.295057:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2200/0xb0c3a59caa410651 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab744a5 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.295117:0:17098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa410658 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.295130:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa410658 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.295140:0:17098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa410658 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635568.295185:0:17098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789635568.295189:0:17098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789635568.295208:0:17098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa410658 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.295229:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2200/0xb0c3a59caa410651 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744a5 expref: 7 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.295256:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3000/0xb0c3a59caa410658 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744a5 expref: 6 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.295264:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d054d47f700) 00010000:00010000:2.0:1789635568.295266:0:17098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789635568.295269:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a3000, rc 0) 00000100:00100000:2.0:1789635568.295337:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+6:15567:x1876568411601664:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 326us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635568.295352:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:2.0:1789635568.298673:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635568.299879:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411601792 00000100:00100000:1.0:1789635568.299891:0:17848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411601792 00000100:00100000:1.0:1789635568.299970:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 31 00000100:00100000:1.0:1789635568.299980:0:17848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575adaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+6:15567:x1876568411601792:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789635568.300001:0:17848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635568.300020:0:17848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3200/0xb0c3a59caa41065f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab744ac expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.300101:0:17848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3000/0xb0c3a59caa410666 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.300116:0:17848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3000/0xb0c3a59caa410666 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.300127:0:17848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3000/0xb0c3a59caa410666 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.300137:0:17848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d2600/0xb0c3a59caa41066d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.300145:0:17848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d2600/0xb0c3a59caa41066d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.300151:0:17848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d2600/0xb0c3a59caa41066d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.300235:0:17848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531200/0xb0c3a59caa410674 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.300249:0:17848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531200/0xb0c3a59caa410674 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.300257:0:17848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531200/0xb0c3a59caa410674 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635568.300292:0:17848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789635568.300296:0:17848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789635568.300323:0:17848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531200/0xb0c3a59caa410674 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.300336:0:17848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3000/0xb0c3a59caa410666 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.300343:0:17848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3000/0xb0c3a59caa410666 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.300349:0:17848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3000/0xb0c3a59caa410666 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.300355:0:17848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05820d3000 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635568.300359:0:17848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3000/0xb0c3a59caa410666 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.302118:0:17848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3000/0xb0c3a59caa410666 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.302145:0:17848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d054d47f700) 00010000:00010000:1.0:1789635568.302149:0:17848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635568.302154:0:17848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3000/0xb0c3a59caa410666 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.302183:0:17848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3000/0xb0c3a59caa410666 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.302201:0:17848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d2600/0xb0c3a59caa41066d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.302208:0:17848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d2600/0xb0c3a59caa41066d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.302214:0:17848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d2600/0xb0c3a59caa41066d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.302220:0:17848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05820d2600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635568.302223:0:17848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d2600/0xb0c3a59caa41066d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.302229:0:17848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d2600/0xb0c3a59caa41066d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.302238:0:17848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d054d47f200) 00010000:00010000:1.0:1789635568.302240:0:17848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635568.302243:0:17848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d2600/0xb0c3a59caa41066d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.302248:0:17848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d2600/0xb0c3a59caa41066d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.302287:0:17848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3200/0xb0c3a59caa41065f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744ac expref: 8 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.302324:0:17848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531200/0xb0c3a59caa410674 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744ac expref: 7 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.302332:0:17848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d054d47f100) 00010000:00010000:1.0:1789635568.302334:0:17848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789635568.302336:0:17848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0565531200, rc 0) 00000100:00100000:2.0:1789635568.302625:0:17848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575adaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+7:15567:x1876568411601792:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 2643us (3958us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635568.302634:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 31 00000100:00100000:0.0:1789635568.314697:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635568.314985:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411601920 00000100:00100000:2.0:1789635568.314995:0:17107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411601920 00000100:00100000:2.0:1789635568.315057:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:2.0:1789635568.315067:0:17107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+5:15567:x1876568411601920:12345-192.168.203.20@tcp:900:lfs.0 00000100:00100000:2.0:1789635568.315154:0:17107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+5:15567:x1876568411601920:12345-192.168.203.20@tcp:900:lfs.0 Request processed in 87us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635568.315161:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00080000:3.0:1789635568.317462:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789635568.319508:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635568.319721:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411602176 00000100:00100000:2.0:1789635568.319731:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411602176 00000100:00100000:2.0:1789635568.319783:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 32 00000100:00100000:2.0:1789635568.319793:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+7:15567:x1876568411602176:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1789635568.319813:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635568.319832:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2200/0xb0c3a59caa41067b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab744b3 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635568.320000:0:17098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789635568.320091:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2200/0xb0c3a59caa41067b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744b3 expref: 9 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.320106:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d054d47f700) 00010000:00010000:2.0:1789635568.320109:0:17098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789635568.320127:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2200/0xb0c3a59caa41067b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744b3 expref: 9 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.320162:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a2200, rc 0) 00000100:00100000:2.0:1789635568.320264:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+8:15567:x1876568411602176:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 472us (763us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1789635568.320272:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 32 00000100:00100000:1.0:1789635568.323801:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635568.323866:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411602432 00000100:00100000:0.0:1789635568.323877:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411602432 00000100:00100000:0.0:1789635568.324096:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:0.0:1789635568.324107:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04467b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+8:15567:x1876568411602432:12345-192.168.203.20@tcp:36:lfs.0 00010000:00010000:0.0:1789635568.324159:0:17096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635568.324187:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531200/0xb0c3a59caa410674 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744ac expref: 8 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635568.324208:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d054d47f100) 00010000:00010000:0.0:1789635568.324225:0:17096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789635568.324247:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42e00/0xb0c3a59caa410689 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635568.324260:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42e00/0xb0c3a59caa410689 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635568.324270:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42e00/0xb0c3a59caa410689 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789635568.324470:0:17096:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e48a2c37 reply state 00000000b4b778df transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42e00/0xb0c3a59caa410689 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635568.324483:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42e00/0xb0c3a59caa410689 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635568.324504:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d054d47f100) 00010000:00010000:0.0:1789635568.324506:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1789635568.324509:0:17096:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789635568.324517:0:17096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789635568.324714:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04467b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+9:15567:x1876568411602432:12345-192.168.203.20@tcp:36:lfs.0 Request processed in 536us (850us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789635568.324723:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:0.0:1789635568.330182:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635568.330345:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411602688 00000100:00100000:1.0:1789635568.330356:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411602688 00000100:00100000:1.0:1789635568.330415:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:1.0:1789635568.330426:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+9:15567:x1876568411602688:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:1.0:1789635568.330696:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+10:15567:x1876568411602688:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 271us (523us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789635568.330705:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:3.0:1789635568.335477:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635568.335751:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411602944 00000100:00100000:1.0:1789635568.335762:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411602944 00000100:00100000:1.0:1789635568.335826:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 34 00000100:00100000:1.0:1789635568.335836:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+10:15567:x1876568411602944:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1789635568.335863:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635568.335884:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530800/0xb0c3a59caa410690 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab744ba expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.336094:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531a00/0xb0c3a59caa410697 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.336108:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531a00/0xb0c3a59caa410697 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.336132:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531a00/0xb0c3a59caa410697 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.336145:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531000/0xb0c3a59caa41069e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.336153:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531000/0xb0c3a59caa41069e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.336160:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531000/0xb0c3a59caa41069e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635568.337834:0:17097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789635568.337916:0:17097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531a00/0xb0c3a59caa410697 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.337927:0:17097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531a00/0xb0c3a59caa410697 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.337934:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531a00/0xb0c3a59caa410697 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.337940:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0565531a00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635568.337944:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531a00/0xb0c3a59caa410697 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.337952:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531a00/0xb0c3a59caa410697 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.337967:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d054d47f700) 00010000:00010000:1.0:1789635568.337970:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635568.337986:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531a00/0xb0c3a59caa410697 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.337992:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531a00/0xb0c3a59caa410697 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.338007:0:17097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531000/0xb0c3a59caa41069e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.338013:0:17097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531000/0xb0c3a59caa41069e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.338018:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531000/0xb0c3a59caa41069e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.338023:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0565531000 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635568.338026:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531000/0xb0c3a59caa41069e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.338032:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531000/0xb0c3a59caa41069e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.338040:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d054d47f200) 00010000:00010000:1.0:1789635568.338042:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635568.338045:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531000/0xb0c3a59caa41069e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.338051:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531000/0xb0c3a59caa41069e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.338089:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530800/0xb0c3a59caa410690 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744ba expref: 12 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.338110:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d054d47f700) 00010000:00010000:1.0:1789635568.338113:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789635568.338117:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530800/0xb0c3a59caa410690 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744ba expref: 12 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.338126:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0565530800, rc 0) 00000100:00100000:1.0:1789635568.338184:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+11:15567:x1876568411602944:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 2349us (2717us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1789635568.338193:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 34 00000100:00100000:2.0:1789635568.345393:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635568.346476:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411603072 00000100:00100000:3.0:1789635568.346488:0:17848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411603072 00000100:00100000:3.0:1789635568.346549:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 35 00000100:00100000:3.0:1789635568.346558:0:17848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+11:15567:x1876568411603072:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789635568.346581:0:17848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635568.346629:0:17848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa4106ac lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab744c1 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.346733:0:17848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa4106b3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.346748:0:17848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa4106b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.346759:0:17848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa4106b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635568.346781:0:17848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789635568.346784:0:17848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789635568.346803:0:17848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa4106b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.346826:0:17848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa4106ac lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744c1 expref: 13 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.346843:0:17848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa4106b3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744c1 expref: 12 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.346852:0:17848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d054d47f100) 00010000:00010000:3.0:1789635568.346865:0:17848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789635568.346869:0:17848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e153c00, rc 0) 00000100:00100000:3.0:1789635568.346919:0:17848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+12:15567:x1876568411603072:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 362us (1537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635568.346926:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 35 00000100:00100000:0.0:1789635568.351849:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635568.352221:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411603200 00000100:00100000:1.0:1789635568.352231:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411603200 00000100:00100000:1.0:1789635568.352284:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:1.0:1789635568.352293:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+12:15567:x1876568411603200:12345-192.168.203.20@tcp:37:lfs.0 00000100:00100000:1.0:1789635568.358008:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+12:15567:x1876568411603200:12345-192.168.203.20@tcp:37:lfs.0 Request processed in 5705us (6158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635568.358022:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:2.0:1789635568.366876:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635568.366999:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411603456 00000100:00100000:0.0:1789635568.367009:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411603456 00000100:00100000:0.0:1789635568.367118:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:0.0:1789635568.367130:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05541c6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+12:15567:x1876568411603456:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:0.0:1789635568.367363:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05541c6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+13:15567:x1876568411603456:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 234us (495us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1789635568.367377:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 4 00000040:00080000:3.0:1789635568.420500:0:17847:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789635568.442642:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635568.442785:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411603584 00000100:00100000:2.0:1789635568.442796:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411603584 00000100:00100000:2.0:1789635568.442845:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 36 00000100:00100000:2.0:1789635568.442855:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+11:15573:x1876568411603584:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1789635568.442874:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635568.442893:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2000/0xb0c3a59caa4106ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab744c8 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.442956:0:17098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa4106c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.442971:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa4106c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.442998:0:17098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa4106c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.443009:0:17098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2800/0xb0c3a59caa4106c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.443016:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2800/0xb0c3a59caa4106c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.443037:0:17098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2800/0xb0c3a59caa4106c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.443116:0:17098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa4106cf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.443125:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa4106cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.443133:0:17098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa4106cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635568.443163:0:17098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789635568.443167:0:17098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789635568.443203:0:17098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa4106cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.443214:0:17098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa4106c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.443220:0:17098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa4106c1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.443227:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa4106c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.443233:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3400 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635568.443237:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa4106c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.443245:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa4106c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.443264:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d054d47f700) 00010000:00010000:2.0:1789635568.443267:0:17098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635568.443272:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa4106c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.443279:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3400/0xb0c3a59caa4106c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.443290:0:17098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2800/0xb0c3a59caa4106c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.443296:0:17098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2800/0xb0c3a59caa4106c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.443302:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2800/0xb0c3a59caa4106c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.443317:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a2800 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635568.443320:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2800/0xb0c3a59caa4106c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.443326:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2800/0xb0c3a59caa4106c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.443333:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d054d47f200) 00010000:00010000:2.0:1789635568.443336:0:17098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635568.443338:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2800/0xb0c3a59caa4106c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.443345:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2800/0xb0c3a59caa4106c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.443388:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2000/0xb0c3a59caa4106ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744c8 expref: 13 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.443412:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3a00/0xb0c3a59caa4106cf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744c8 expref: 12 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.443420:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d054d47f100) 00010000:00010000:2.0:1789635568.443422:0:17098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789635568.443425:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a3a00, rc 0) 00000100:00100000:2.0:1789635568.443488:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+12:15573:x1876568411603584:12345-192.168.203.20@tcp:101:bash.0 Request processed in 634us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635568.443495:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 36 00000100:00100000:2.0:1789635568.451010:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635568.451163:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411603712 00000100:00100000:0.0:1789635568.451174:0:17107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411603712 00000100:00100000:0.0:1789635568.451233:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:0.0:1789635568.451243:0:17107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575adad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+5:15573:x1876568411603712:12345-192.168.203.20@tcp:900:bash.0 00000100:00100000:0.0:1789635568.451325:0:17107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575adad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+5:15573:x1876568411603712:12345-192.168.203.20@tcp:900:bash.0 Request processed in 84us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635568.451332:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:3.0:1789635568.455062:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635568.455217:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411603968 00000100:00100000:2.0:1789635568.455227:0:17848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411603968 00000100:00100000:2.0:1789635568.455286:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 37 00000100:00100000:2.0:1789635568.455295:0:17848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+12:15573:x1876568411603968:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1789635568.455324:0:17848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635568.455344:0:17848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2c00/0xb0c3a59caa4106d6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab744cf expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.455448:0:17848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa4106dd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.455463:0:17848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa4106b3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744c1 expref: 12 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.455489:0:17848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa4106dd lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.455520:0:17848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa4106b3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744c1 expref: 12 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.455532:0:17848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa4106b3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744c1 expref: 12 pid: 17848 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635568.455545:0:17848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575adbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17848:1876568427419776:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789635568.455635:0:17848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05655fe240 going to sleep for 11 seconds 00000100:00100000:2.0:1789635568.459472:0:17848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575adbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17848:1876568427419776:192.168.203.20@tcp:104: 00010000:00010000:2.0:1789635568.459502:0:17848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa4106dd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635568.462067:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635568.462284:0:20123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411604096 00000100:00100000:1.0:1789635568.462293:0:20123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411604096 00010000:00010000:1.0:1789635568.462345:0:20123:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa4106b3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744c1 expref: 13 pid: 17848 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635568.462396:0:20123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:1.0:1789635568.462406:0:20123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+13:2397:x1876568411604096:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635568.462422:0:20123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635568.462429:0:20123:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa4106b3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744c1 expref: 13 pid: 17848 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.462454:0:20123:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa4106b3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744c1 expref: 13 pid: 17848 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.462475:0:20123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa4106b3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744c1 expref: 13 pid: 17848 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.462490:0:20123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d054d47f100) 00010000:00010000:1.0:1789635568.462495:0:20123:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa4106dd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.462504:0:20123:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa4106dd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.462512:0:20123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa4106dd lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.462538:0:20123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635568.462633:0:20123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+12:2397:x1876568411604096:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 229us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635568.462641:0:20123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 16 00010000:00010000:3.0:1789635568.463242:0:17848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa4106dd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.463251:0:17848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa4106dd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.463273:0:17848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa4106e4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.463283:0:17848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa4106e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.463291:0:17848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa4106e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.463885:0:17848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa4106eb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.463896:0:17848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa4106eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.463903:0:17848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa4106eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635568.463926:0:17848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789635568.463951:0:17848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa4106dd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.463958:0:17848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa4106dd lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.463965:0:17848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa4106dd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.463970:0:17848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a2600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635568.464362:0:17848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa4106dd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.464373:0:17848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa4106dd lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.464385:0:17848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d054d47f100) 00010000:00010000:3.0:1789635568.464396:0:17848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635568.464401:0:17848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa4106dd lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.464408:0:17848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa4106dd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789635568.464434:0:17848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000720c52b9 reply state 00000000050e1480 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa4106e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.464446:0:17848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa4106e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.464465:0:17848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d05446d0400) 00010000:00010000:3.0:1789635568.464468:0:17848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789635568.464471:0:17848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789635568.464511:0:17848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2c00/0xb0c3a59caa4106d6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744cf expref: 15 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.464528:0:17848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa4106eb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744cf expref: 14 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.464535:0:17848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d05446d0e00) 00010000:00010000:3.0:1789635568.464537:0:17848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789635568.464539:0:17848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e153a00, rc 0) 00000100:00100000:3.0:1789635568.464624:0:17848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+15:15573:x1876568411603968:12345-192.168.203.20@tcp:101:bash.0 Request processed in 9330us (9570us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789635568.464632:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 37 00000100:00100000:3.0:1789635568.479569:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635568.479692:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411604224 00000100:00100000:2.0:1789635568.479703:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411604224 00000100:00100000:2.0:1789635568.479765:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 38 00000100:00100000:2.0:1789635568.479775:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+15:15573:x1876568411604224:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1789635568.479801:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635568.479822:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2000/0xb0c3a59caa4106f9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab744d6 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.479888:0:17098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2800/0xb0c3a59caa410700 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.479919:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2800/0xb0c3a59caa410700 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.479930:0:17098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2800/0xb0c3a59caa410700 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635568.479985:0:17098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789635568.479989:0:17098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789635568.480008:0:17098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2800/0xb0c3a59caa410700 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.480018:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2800/0xb0c3a59caa410700 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.480043:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2000/0xb0c3a59caa4106f9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744d6 expref: 17 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.480072:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2800/0xb0c3a59caa410700 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744d6 expref: 16 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.480080:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d05446d0e00) 00010000:00010000:2.0:1789635568.480082:0:17098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789635568.480086:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a2800, rc 0) 00000100:00100000:2.0:1789635568.480136:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+16:15573:x1876568411604224:12345-192.168.203.20@tcp:101:bash.0 Request processed in 363us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635568.480144:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 38 00000100:00100000:1.0:1789635568.484747:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635568.485176:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411604480 00000100:00100000:3.0:1789635568.485186:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411604480 00000100:00100000:3.0:1789635568.485287:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:3.0:1789635568.485299:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+16:15573:x1876568411604480:12345-192.168.203.20@tcp:35:bash.0 00000100:00100000:3.0:1789635568.485627:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+17:15573:x1876568411604480:12345-192.168.203.20@tcp:35:bash.0 Request processed in 330us (889us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1789635568.485635:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:0.0:1789635568.548244:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575adbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427419904:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789635568.548303:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0447b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427420032:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789635568.548345:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635568.548376:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427420032 00000100:00100000:0.0:1789635568.548384:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427420032 00000100:00100000:0.0:1789635568.548445:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789635568.548446:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635568.548454:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427420032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789635568.548487:0:17101:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789635568.548519:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427419904 00000100:00100000:1.0:1789635568.548523:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427419904 00000100:00100000:0.0:1789635568.548538:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427420032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635568.548546:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789635568.548551:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789635568.548557:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427419904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789635568.548583:0:17102:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789635568.548648:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427419904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635568.548654:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789635568.548745:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0447b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427420032:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789635568.548773:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575adbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427419904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789635568.570145:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635568.570230:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411604736 00000100:00100000:3.0:1789635568.570252:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411604736 00000100:00100000:3.0:1789635568.570317:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 39 00000100:00100000:3.0:1789635568.570328:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+17:15583:x1876568411604736:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1789635568.570350:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635568.570379:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa410707 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab744dd expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635568.570476:0:17096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789635568.570583:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa410707 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744dd expref: 19 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.570632:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d054d47f700) 00010000:00010000:3.0:1789635568.570636:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789635568.570641:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa410707 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744dd expref: 19 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.570654:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e153c00, rc 0) 00000100:00100000:3.0:1789635568.570712:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+18:15583:x1876568411604736:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 386us (577us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1789635568.570718:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 39 00000100:00100000:2.0:1789635568.574931:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635568.575073:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411604992 00000100:00100000:0.0:1789635568.575084:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411604992 00000100:00100000:0.0:1789635568.575139:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:0.0:1789635568.575150:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+18:15583:x1876568411604992:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:0.0:1789635568.575365:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+19:15583:x1876568411604992:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 216us (441us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1789635568.575372:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:1.0:1789635568.615858:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635568.616008:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411605248 00000100:00100000:2.0:1789635568.616018:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411605248 00000100:00100000:2.0:1789635568.616088:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00100000:2.0:1789635568.616099:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+19:15586:x1876568411605248:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1789635568.616123:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635568.616144:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2000/0xb0c3a59caa410715 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab744e4 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.616252:0:17098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa41071c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.616266:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa41071c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.616276:0:17098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa41071c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635568.616287:0:17098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789635568.616521:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2000/0xb0c3a59caa410715 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744e4 expref: 22 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.616551:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa41071c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744e4 expref: 21 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.616559:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d05446d0e00) 00010000:00010000:2.0:1789635568.616562:0:17098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789635568.616565:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a2e00, rc 0) 00000100:00100000:2.0:1789635568.616695:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+21:15586:x1876568411605248:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 598us (846us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789635568.616703:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00100000:0.0:1789635568.620565:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635568.620642:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635568.620717:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411605376 00000100:00100000:3.0:1789635568.620728:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411605376 00000100:00100000:3.0:1789635568.620803:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 41 00000100:00100000:3.0:1789635568.620813:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+21:15586:x1876568411605376:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:3.0:1789635568.620889:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa41072a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.620905:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa41072a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.620928:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa41072a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.620964:0:17096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa41072a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.620972:0:17096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa41072a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.620978:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa41072a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.620984:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e153c00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:3.0:1789635568.620988:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa41072a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.620995:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa41072a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.621007:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d05446d0e00) 00010000:00010000:3.0:1789635568.621009:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789635568.621013:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa41072a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635568.621018:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa41072a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635568.621093:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+21:15586:x1876568411605376:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 282us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635568.621101:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 41 00000100:00100000:2.0:1789635568.623084:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411605504 00000100:00100000:2.0:1789635568.623111:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411605504 00000100:00100000:2.0:1789635568.623174:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:2.0:1789635568.623183:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d04459ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+21:2396:x1876568411605504:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635568.623195:0:17082:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635568.623214:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2e00/0xb0c3a59caa41071c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744e4 expref: 21 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635568.623244:0:17082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d05446d0e00) 00010000:00010000:2.0:1789635568.623248:0:17082:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635568.623300:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d04459ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+20:2396:x1876568411605504:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 119us (2658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635568.623315:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:0.0:1789635568.624564:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635568.624695:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411605760 00000100:00100000:3.0:1789635568.624702:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411605760 00000100:00100000:3.0:1789635568.624740:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:3.0:1789635568.624747:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+20:15586:x1876568411605760:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:3.0:1789635568.624934:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+21:15586:x1876568411605760:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 187us (375us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1789635568.624941:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00010000:00010000:3.0:1789635568.675843:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635568.983708:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635568.983831:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411606016 00000100:00100000:1.0:1789635568.983840:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411606016 00000100:00100000:1.0:1789635568.983906:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 42 00000100:00100000:1.0:1789635568.983917:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+21:15617:x1876568411606016:12345-192.168.203.20@tcp:101:cat.0 00010000:00010000:1.0:1789635568.983940:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635568.983959:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531e00/0xb0c3a59caa410731 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab744eb expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.984068:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531600/0xb0c3a59caa410738 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.984083:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531600/0xb0c3a59caa410738 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.984095:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531600/0xb0c3a59caa410738 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635568.984105:0:17097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789635568.984212:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531e00/0xb0c3a59caa410731 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744eb expref: 24 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.984230:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531600/0xb0c3a59caa410738 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744eb expref: 23 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.984257:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d05446d0e00) 00010000:00010000:1.0:1789635568.984259:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789635568.984262:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0565531600, rc 0) 00000100:00100000:1.0:1789635568.984335:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+23:15617:x1876568411606016:12345-192.168.203.20@tcp:101:cat.0 Request processed in 419us (635us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1789635568.984342:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 42 00000100:00100000:2.0:1789635568.987551:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635568.987812:0:20123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411606144 00000100:00100000:1.0:1789635568.987822:0:20123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411606144 00000100:00100000:1.0:1789635568.987879:0:20123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:1.0:1789635568.987888:0:20123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575adb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+23:2398:x1876568411606144:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635568.987904:0:20123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635568.987925:0:20123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531600/0xb0c3a59caa410738 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744eb expref: 23 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635568.987944:0:20123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d05446d0e00) 00010000:00010000:1.0:1789635568.987948:0:20123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635568.987999:0:20123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575adb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+22:2398:x1876568411606144:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 113us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635568.988005:0:20123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:0.0:1789635568.988926:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635568.988975:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411606400 00000100:00100000:3.0:1789635568.988982:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411606400 00000100:00100000:3.0:1789635568.989027:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:3.0:1789635568.989035:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+22:15617:x1876568411606400:12345-192.168.203.20@tcp:35:cat.0 00000100:00100000:3.0:1789635568.989314:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+23:15617:x1876568411606400:12345-192.168.203.20@tcp:35:cat.0 Request processed in 271us (384us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1789635568.989322:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 8 00000040:00080000:0.0:1789635568.997285:0:17130:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789635569.080374:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635569.080437:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635569.080471:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635569.080503:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635569.080535:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635569.080551:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411606912 00000100:00100000:2.0:1789635569.080563:0:18604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411606912 00000100:00100000:3.0:1789635569.080583:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635569.080657:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411607424 00000100:00100000:3.0:1789635569.080658:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635569.080662:0:18604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411607424 00000100:00100000:2.0:1789635569.080685:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411606784 00000100:00100000:2.0:1789635569.080688:0:18604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411606784 00000100:00100000:3.0:1789635569.080694:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635569.080706:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411607296 00000100:00100000:2.0:1789635569.080710:0:18604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411607296 00000100:00100000:3.0:1789635569.080726:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:0.0:1789635569.080782:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411606656 00000100:00100000:0.0:1789635569.080788:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411606656 00000100:00100000:0.0:1789635569.080817:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411607168 00000100:00100000:0.0:1789635569.080820:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411607168 00000100:00100000:0.0:1789635569.080841:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411607040 00000100:00100000:0.0:1789635569.080844:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411607040 00000100:00100000:0.0:1789635569.080858:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:0.0:1789635569.080865:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+5:2397:x1876568411606656:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635569.080937:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+5:2397:x1876568411606656:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 72us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635569.080945:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:0.0:1789635569.080962:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 54 00000100:00100000:0.0:1789635569.080969:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+5:2397:x1876568411607168:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635569.080996:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+5:2397:x1876568411607168:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 27us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635569.081002:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 54 00000100:00100000:0.0:1789635569.081014:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:0.0:1789635569.081020:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0574369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+12:2397:x1876568411607040:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635569.081046:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0574369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+12:2397:x1876568411607040:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 26us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635569.081052:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:3.0:1789635569.081211:0:18602:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+5:2397:x1876568411606912:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635569.081255:0:18602:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+5:2397:x1876568411606912:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 520us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635569.083551:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:0.0:1789635569.083564:0:19724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:2.0:1789635569.083580:0:18604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447b5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+5:2397:x1876568411607424:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1789635569.083581:0:19724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0574368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+5:2397:x1876568411606784:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1789635569.083673:0:18604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447b5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+5:2397:x1876568411607424:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 110us (3169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635569.083677:0:19724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0574368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+5:2397:x1876568411606784:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 100us (3091us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635569.083687:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:0.0:1789635569.083694:0:19724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:2.0:1789635569.083720:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:2.0:1789635569.083731:0:18604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057436b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+5:2397:x1876568411607296:12345-192.168.203.20@tcp:400:kworker.0 00000100:00080000:0.0:1789635569.083740:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789635569.083748:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789635569.083779:0:18604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057436b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1dd3fc4f-a707-4c13-a2d4-7afae80fdb16+5:2397:x1876568411607296:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 49us (3083us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635569.083788:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:0.0:1789635569.083848:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411606528 00000100:00100000:0.0:1789635569.083856:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411606528 00000100:00100000:0.0:1789635569.083896:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 165 00000100:00100000:0.0:1789635569.083904:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+13:2397:x1876568411606528:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1789635569.083908:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:0.0:1789635569.087804:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e0fbe02-afe7-4e1d-af83-76bf8fc579b6+13:2397:x1876568411606528:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 3889us (7258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635569.087810:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635569.087818:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 165 00000100:00100000:1.0:1789635569.087944:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411607680 00000100:00100000:1.0:1789635569.087953:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411607680 00000100:00100000:1.0:1789635569.088001:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 43 00000100:00100000:1.0:1789635569.088010:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0574369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+23:15623:x1876568411607680:12345-192.168.203.20@tcp:101:dd.0 00010000:00010000:1.0:1789635569.088031:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635569.088050:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531600/0xb0c3a59caa410746 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab744f2 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635569.088592:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531e00/0xb0c3a59caa41074d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635569.088643:0:17096:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa4106eb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744cf expref: 24 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635569.088651:0:17096:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2800/0xb0c3a59caa410700 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744d6 expref: 24 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635569.088660:0:17096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531e00/0xb0c3a59caa41074d lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635569.088693:0:17096:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2800/0xb0c3a59caa410700 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744d6 expref: 24 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635569.088708:0:17096:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2800/0xb0c3a59caa410700 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744d6 expref: 24 pid: 17098 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635569.088720:0:17096:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543293b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17096:1876568427420160:192.168.203.20@tcp:104: 00010000:00010000:1.0:1789635569.088785:0:17096:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa4106eb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744cf expref: 24 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635569.088794:0:17096:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa4106eb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744cf expref: 24 pid: 17848 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635569.088803:0:17096:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0543292680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17096:1876568427420288:192.168.203.20@tcp:104: 00000100:00100000:1.0:1789635569.088838:0:17096:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d056e013a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789635569.094715:0:17096:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543293b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17096:1876568427420160:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789635569.098049:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635569.098120:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411607808 00000100:00100000:2.0:1789635569.098130:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411607808 00000100:00100000:3.0:1789635569.098136:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00010000:00010000:2.0:1789635569.098173:0:17082:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2800/0xb0c3a59caa410700 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744d6 expref: 25 pid: 17098 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635569.098258:0:17096:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0543292680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17096:1876568427420288:192.168.203.20@tcp:104: 00000100:00100000:2.0:1789635569.098268:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411607936 00000100:00100000:2.0:1789635569.098273:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411607936 00010000:00010000:2.0:1789635569.098289:0:17082:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa4106eb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744cf expref: 26 pid: 17848 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635569.098297:0:17096:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531e00/0xb0c3a59caa41074d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635569.100691:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:0.0:1789635569.100714:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057436aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+26:2397:x1876568411607808:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789635569.100733:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635569.100743:0:17083:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2800/0xb0c3a59caa410700 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744d6 expref: 26 pid: 17098 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635569.100758:0:17083:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2800/0xb0c3a59caa410700 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744d6 expref: 26 pid: 17098 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635569.100780:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2800/0xb0c3a59caa410700 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744d6 expref: 26 pid: 17098 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635569.100807:0:17083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d05446d0e00) 00010000:00010000:0.0:1789635569.100812:0:17083:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531e00/0xb0c3a59caa41074d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635569.100821:0:17083:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531e00/0xb0c3a59caa41074d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635569.100827:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635569.100883:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057436aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+25:2397:x1876568411607808:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 181us (2842us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635569.100902:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:0.0:1789635569.100928:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:0.0:1789635569.100935:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447af8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+24:2397:x1876568411607936:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789635569.100944:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635569.100950:0:17083:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa4106eb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744cf expref: 24 pid: 17848 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635569.100960:0:17083:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa4106eb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744cf expref: 24 pid: 17848 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635569.100974:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa4106eb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744cf expref: 24 pid: 17848 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635569.100984:0:17083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d05446d0e00) 00010000:00010000:0.0:1789635569.100987:0:17083:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531e00/0xb0c3a59caa41074d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635569.100995:0:17083:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531e00/0xb0c3a59caa41074d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635569.101002:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531e00/0xb0c3a59caa41074d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635569.101028:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635569.101048:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447af8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+23:2397:x1876568411607936:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 113us (2914us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635569.101054:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 18 00010000:00010000:1.0:1789635569.101088:0:17096:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531e00/0xb0c3a59caa41074d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635569.101098:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531e00/0xb0c3a59caa41074d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635569.101118:0:17096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789635569.101261:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531600/0xb0c3a59caa410746 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744f2 expref: 24 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635569.101292:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531e00/0xb0c3a59caa41074d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744f2 expref: 23 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635569.101301:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d05446d0e00) 00010000:00010000:1.0:1789635569.101313:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789635569.101315:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0565531e00, rc 0) 00000100:00100000:1.0:1789635569.101355:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0574369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+23:15623:x1876568411607680:12345-192.168.203.20@tcp:101:dd.0 Request processed in 13345us (13544us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1789635569.101363:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 43 00000100:00100000:3.0:1789635569.108795:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635569.110053:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411608064 00000100:00100000:0.0:1789635569.110066:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411608064 00000100:00100000:0.0:1789635569.110129:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 44 00000100:00100000:0.0:1789635569.110140:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057436ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+23:15623:x1876568411608064:12345-192.168.203.20@tcp:101:dd.0 00010000:00010000:0.0:1789635569.110163:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635569.110183:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42800/0xb0c3a59caa41075b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab744f9 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635569.110217:0:17098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f43e00/0xb0c3a59caa410762 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635569.110230:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f43e00/0xb0c3a59caa410762 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635569.110251:0:17098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f43e00/0xb0c3a59caa410762 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635569.110394:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42800/0xb0c3a59caa41075b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744f9 expref: 25 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635569.110412:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f43e00/0xb0c3a59caa410762 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744f9 expref: 24 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635569.110561:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d05446d0e00) 00010000:00010000:0.0:1789635569.110564:0:17098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789635569.110567:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0549f43e00, rc 0) 00000100:00100000:0.0:1789635569.110663:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057436ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+24:15623:x1876568411608064:12345-192.168.203.20@tcp:101:dd.0 Request processed in 525us (1876us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635569.110671:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 44 00000100:00100000:0.0:1789635569.118365:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635569.118589:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411608320 00000100:00100000:1.0:1789635569.121560:0:17848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411608320 00000100:00100000:1.0:1789635569.121735:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 45 00000100:00100000:1.0:1789635569.121756:0:17848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+24:15623:x1876568411608320:12345-192.168.203.20@tcp:36:dd.0 00010000:00010000:1.0:1789635569.122289:0:17848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531600/0xb0c3a59caa410769 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635569.122315:0:17848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531600/0xb0c3a59caa410769 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635569.122327:0:17848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531600/0xb0c3a59caa410769 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789635569.122371:0:17848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1789635569.122464:0:17848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fc47643f reply state 00000000267a4a93 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531600/0xb0c3a59caa410769 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635569.122545:0:17848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531600/0xb0c3a59caa410769 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635569.122553:0:17848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d05446d0e00) 00010000:00010000:1.0:1789635569.122556:0:17848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789635569.122560:0:17848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789635569.122814:0:17848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+27:15623:x1876568411608320:12345-192.168.203.20@tcp:36:dd.0 Request processed in 1057us (4455us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1789635569.122822:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 45 00000020:00080000:1.0:1789635569.122827:0:17848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789635569.130255:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635569.130592:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411608448 00000100:00100000:3.0:1789635569.130821:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411608448 00000100:00100000:3.0:1789635569.130992:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 46 00000100:00100000:3.0:1789635569.131003:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+27:15623:x1876568411608448:12345-192.168.203.20@tcp:101:dd.0 00010000:00010000:3.0:1789635569.131028:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635569.131050:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa410770 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74500 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635569.131103:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa410770 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74500 expref: 28 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635569.131118:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa410770 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74500 expref: 28 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635569.131138:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d05446d0e00) 00010000:00010000:3.0:1789635569.131141:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789635569.131145:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05488ff000, rc 0) 00000100:00100000:3.0:1789635569.131216:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+28:15623:x1876568411608448:12345-192.168.203.20@tcp:101:dd.0 Request processed in 216us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635569.131223:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 46 00000100:00100000:3.0:1789635569.157237:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635569.157696:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411608704 00000100:00100000:0.0:1789635569.157706:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411608704 00000100:00100000:0.0:1789635569.157828:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:0.0:1789635569.157839:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0574368a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+28:15623:x1876568411608704:12345-192.168.203.20@tcp:103:dd.0 00010000:00010000:0.0:1789635569.157867:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635569.157904:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa410770 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74500 expref: 28 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635569.157923:0:17083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d05446d0e00) 00010000:00010000:0.0:1789635569.157927:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635569.157981:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0574368a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+27:15623:x1876568411608704:12345-192.168.203.20@tcp:103:dd.0 Request processed in 143us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635569.157988:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:1.0:1789635569.161973:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635569.162070:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411608832 00000100:00100000:3.0:1789635569.162141:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411608832 00000100:00100000:3.0:1789635569.162233:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 47 00000100:00100000:3.0:1789635569.162245:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+27:15623:x1876568411608832:12345-192.168.203.20@tcp:58:dd.0 00010000:00010000:3.0:1789635569.162368:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa410777 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635569.162393:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa410777 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635569.162404:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa410777 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789635569.163482:0:17096:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789635569.163510:0:17096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1789635569.163718:0:17096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1789635569.163815:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+27:15623:x1876568411608832:12345-192.168.203.20@tcp:58:dd.0 Request processed in 1569us (1847us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635569.163825:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 47 00000100:00100000:1.0:1789635569.167438:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635569.167564:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411608960 00000100:00100000:0.0:1789635569.167573:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411608960 00000100:00100000:0.0:1789635569.167646:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 48 00000100:00100000:0.0:1789635569.167656:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+27:15623:x1876568411608960:12345-192.168.203.20@tcp:101:dd.0 00010000:00010000:0.0:1789635569.167674:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635569.167693:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42800/0xb0c3a59caa41077e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74507 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635569.167740:0:17098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa410777 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635569.167750:0:17098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42800/0xb0c3a59caa41077e lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74507 expref: 28 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635569.167782:0:17098:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa410777 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635569.167796:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42800/0xb0c3a59caa41077e lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74507 expref: 28 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635569.167808:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d05446d0e00) 00010000:00010000:0.0:1789635569.167811:0:17098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789635569.167814:0:17098:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42800/0xb0c3a59caa41077e lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74507 expref: 28 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635569.167821:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0549f42800, rc 0) 00000100:00100000:0.0:1789635569.167873:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+28:15623:x1876568411608960:12345-192.168.203.20@tcp:101:dd.0 Request processed in 218us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635569.167879:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 48 00000100:00100000:1.0:1789635569.572034:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427420416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635569.572108:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635569.572180:0:18607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427420416 00000100:00100000:1.0:1789635569.572188:0:18607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427420416 00000100:00100000:1.0:1789635569.572285:0:18607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789635569.572294:0:18607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d056e017b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427420416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789635569.572332:0:18607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789635569.572376:0:18607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d056e017b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427420416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635569.572384:0:18607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789635569.572446:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427420416:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789635569.572481:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789635569.573219:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789635569.573230:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427420544:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789635569.573277:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635569.573361:0:18607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427420544 00000100:00100000:2.0:1789635569.573368:0:18607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427420544 00000100:00100000:2.0:1789635569.573410:0:18607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789635569.573418:0:18607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543296a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427420544:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789635569.573499:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1789635569.574722:0:18607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789635569.574872:0:18607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543296a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876568427420544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1452us (1592us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635569.574882:0:18607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789635569.579823:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1876568427420544:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789635569.580237:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427420928:0@lo:400:kworker.0 00000100:00100000:2.0:1789635569.580449:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575adb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3640:1876568427420672:0@lo:400:kworker.0 00000100:00100000:2.0:1789635569.580502:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635569.580622:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427421184:0@lo:400:kworker.0 00000100:00100000:2.0:1789635569.580646:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635569.580664:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1876568427421696:0@lo:400:kworker.0 00000100:00100000:2.0:1789635569.580686:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635569.580705:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789635569.580710:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427420800:0@lo:400:kworker.0 00000100:00100000:2.0:1789635569.580727:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635569.580743:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575adbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427421312:0@lo:400:kworker.0 00000100:00100000:2.0:1789635569.580762:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635569.580784:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427421824:0@lo:400:kworker.0 00000100:00100000:2.0:1789635569.580802:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635569.580828:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427420672 00000100:00100000:2.0:1789635569.580834:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427420672 00000100:00100000:2.0:1789635569.580872:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789635569.580879:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575bb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+24:3640:x1876568427420672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635569.580922:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575bb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3d8f284-7347-44bd-9697-6e3097b3c5ae+24:3640:x1876568427420672:12345-0@lo:400:kworker.0 Request processed in 42us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635569.580928:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789635569.581221:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635569.581247:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575adb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876568427421440:0@lo:400:kworker.0 00000100:00100000:1.0:1789635569.581274:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635569.582075:0:19724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427421312 00000100:00100000:0.0:1789635569.582084:0:19724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427421312 00000100:00100000:3.0:1789635569.582086:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876568427421056:0@lo:400:kworker.0 00000100:00100000:0.0:1789635569.582123:0:19724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427420928 00000100:00100000:0.0:1789635569.582127:0:19724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427420928 00000100:00100000:0.0:1789635569.582163:0:19724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789635569.582172:0:19724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550662d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427421312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635569.582191:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427421184 00000100:00100000:3.0:1789635569.582197:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427421184 00000100:00100000:3.0:1789635569.582223:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427420800 00000100:00100000:3.0:1789635569.582227:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427420800 00000100:00100000:3.0:1789635569.582241:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789635569.582247:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044791a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427421184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635569.582288:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044791a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427421184:12345-0@lo:400:kworker.0 Request processed in 41us (1640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635569.582294:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789635569.582369:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789635569.582380:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427420800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635569.582415:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876568427420800:12345-0@lo:400:kworker.0 Request processed in 38us (1686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635569.582421:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789635569.582465:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1876568427420800:0@lo:400:kworker.0 00000100:00100000:2.0:1789635569.582493:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575adb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e3d8f284-7347-44bd-9697-6e3097b3c5ae:3640:1876568427420672:0@lo:400:kworker.0 00000100:00100000:1.0:1789635569.582501:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d044791ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1876568427421952:0@lo:400:kworker.0 00000100:00100000:2.0:1789635569.582506:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427421184:0@lo:400:kworker.0 00000100:00100000:1.0:1789635569.582532:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635569.582557:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635569.582570:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1876568427421568:0@lo:400:kworker.0 00000100:00100000:1.0:1789635569.582591:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635569.582638:0:19724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550662d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1876568427421312:12345-0@lo:400:kworker.0 Request processed in 466us (1873us total) trans 0 rc 0/0 00000100:00080000:1.0:1789635569.582641:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789635569.582648:0:19724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789635569.582655:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427421696 00000100:00100000:1.0:1789635569.582660:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427421696 00000100:00100000:0.0:1789635569.582665:0:19724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789635569.582673:0:19724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0543294e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427420928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635569.582691:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427421824 00000100:00100000:1.0:1789635569.582702:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427421824 00000100:00100000:0.0:1789635569.582720:0:19724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0543294e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1876568427420928:12345-0@lo:400:kworker.0 Request processed in 47us (1499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635569.582728:0:19724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789635569.582737:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427421440 00000100:00100000:1.0:1789635569.582740:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427421440 00000100:00100000:1.0:1789635569.582755:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427421952 00000100:00100000:1.0:1789635569.582758:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427421952 00000100:00100000:1.0:1789635569.582767:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427421056 00000100:00100000:1.0:1789635569.582769:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427421056 00000100:00100000:1.0:1789635569.582776:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427421568 00000100:00100000:1.0:1789635569.582778:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427421568 00000100:00100000:1.0:1789635569.582791:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789635569.582796:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876568427421696:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789635569.582833:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789635569.582838:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789635569.582844:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876568427421696:12345-0@lo:400:kworker.0 Request processed in 47us (2156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635569.582851:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789635569.582913:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789635569.582939:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789635569.582947:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876568427421440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635569.582980:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876568427421440:12345-0@lo:400:kworker.0 Request processed in 36us (1707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635569.582986:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789635569.582999:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789635569.583005:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876568427421952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635569.583048:0:17848:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789635569.583055:0:17848:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1789635569.583143:0:17096:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789635569.583151:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789635569.583164:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05759d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876568427421056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635569.583247:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575adbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1876568427421312:0@lo:400:kworker.0 00000100:00100000:0.0:1789635569.583350:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427421824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635569.583386:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876568427421952:12345-0@lo:400:kworker.0 Request processed in 380us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635569.583395:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789635569.583407:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05759d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876568427421056:12345-0@lo:400:kworker.0 Request processed in 242us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635569.583411:0:17097:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789635569.583417:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789635569.583424:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1789635569.583435:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d0575ad8380 x1876568427421696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635569.583436:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876568427421568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635569.583452:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1876568427421696:0@lo:400:kworker.0 00000100:00100000:1.0:1789635569.583483:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876568427421568:12345-0@lo:400:kworker.0 Request processed in 50us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635569.583496:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789635569.583528:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876568427421056:0@lo:400:kworker.0 00000100:00100000:1.0:1789635569.583537:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1876568427421568:0@lo:400:kworker.0 00010000:00080000:1.0:1789635569.583559:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d044791ad80 x1876568427421952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635569.583568:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d044791ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1876568427421952:0@lo:400:kworker.0 00000100:00100000:1.0:1789635569.583578:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1876568427420928:0@lo:400:kworker.0 00000100:00100000:1.0:1789635569.583587:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575adb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876568427421440:0@lo:400:kworker.0 00000100:00100000:0.0:1789635569.584120:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876568427421824:12345-0@lo:400:kworker.0 Request processed in 1259us (3314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635569.584128:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789635569.584266:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1876568427421824:0@lo:400:kworker.0 00010000:00010000:3.0:1789635569.703030:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789635570.019826:0:17130:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789635570.019844:0:17130:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789635570.019875:0:17130:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789635570.019884:0:17130:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789635570.020011:0:17130:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bfa300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17130:1876568427422080:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789635570.020100:0:17130:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549cf40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635570.027515:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635570.027931:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411609088 00000100:00100000:2.0:1789635570.027945:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411609088 00000100:00100000:2.0:1789635570.028040:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 49 00000100:00100000:2.0:1789635570.028054:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+29:15624:x1876568411609088:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789635570.028091:0:17096:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789635570.028233:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+29:15624:x1876568411609088:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 182us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635570.028242:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 49 00000100:00080000:1.0:1789635570.028798:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635570.029937:0:17130:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bfa300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17130:1876568427422080:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789635570.034312:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635570.034629:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411609216 00000100:00100000:1.0:1789635570.034642:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411609216 00000100:00100000:1.0:1789635570.034722:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 50 00000100:00100000:1.0:1789635570.034734:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057436b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+28:15624:x1876568411609216:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789635570.034831:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530000/0xb0c3a59caa410785 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.034854:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530000/0xb0c3a59caa410785 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.034867:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530000/0xb0c3a59caa410785 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.035545:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530e00/0xb0c3a59caa41078c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.035587:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530e00/0xb0c3a59caa41078c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.035651:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530e00/0xb0c3a59caa41078c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.035684:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530400/0xb0c3a59caa410793 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.035694:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530400/0xb0c3a59caa410793 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.035701:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530400/0xb0c3a59caa410793 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635570.035897:0:17097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789635570.035903:0:17097:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789635570.035917:0:17097:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530400/0xb0c3a59caa410793 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.035929:0:17097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530000/0xb0c3a59caa410785 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.035935:0:17097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530000/0xb0c3a59caa410785 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.035941:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530000/0xb0c3a59caa410785 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.035947:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0565530000 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635570.035951:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530000/0xb0c3a59caa410785 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.035965:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530000/0xb0c3a59caa410785 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.035978:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d054d47fb00) 00010000:00010000:1.0:1789635570.035981:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635570.035987:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530000/0xb0c3a59caa410785 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.035993:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530000/0xb0c3a59caa410785 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.036080:0:17097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530e00/0xb0c3a59caa41078c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.036087:0:17097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530e00/0xb0c3a59caa41078c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.036092:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530e00/0xb0c3a59caa41078c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.036097:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0565530e00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635570.036100:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530e00/0xb0c3a59caa41078c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.036106:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530e00/0xb0c3a59caa41078c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.036113:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8d054d47f600) 00010000:00010000:1.0:1789635570.036116:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635570.036119:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530e00/0xb0c3a59caa41078c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.036136:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530e00/0xb0c3a59caa41078c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.036151:0:17097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530400/0xb0c3a59caa410793 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.036157:0:17097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530400/0xb0c3a59caa410793 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.036162:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530400/0xb0c3a59caa410793 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.036167:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0565530400 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635570.036170:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530400/0xb0c3a59caa410793 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.036176:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530400/0xb0c3a59caa410793 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.036184:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d05446d0e00) 00010000:00010000:1.0:1789635570.036187:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635570.036190:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530400/0xb0c3a59caa410793 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.036195:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530400/0xb0c3a59caa410793 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635570.036291:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057436b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+28:15624:x1876568411609216:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 Request processed in 1556us (1999us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635570.036310:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 50 00000100:00100000:1.0:1789635570.040245:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635570.040865:0:20238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411609472 00000100:00100000:3.0:1789635570.040908:0:20238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411609472 00000100:00100000:2.0:1789635570.041789:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00100000:2.0:1789635570.041811:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+28:15624:x1876568411609472:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789635570.041840:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635570.041868:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2800/0xb0c3a59caa41079a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7450e expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.042006:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa4107a1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.042048:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa4107a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.042063:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa4107a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635570.042080:0:17096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789635570.042183:0:17096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa4107a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.042192:0:17096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa4107a1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.042199:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa4107a1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.042206:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3e00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635570.042212:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa4107a1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.042221:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa4107a1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.042235:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d05446d0e00) 00010000:00010000:2.0:1789635570.042238:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789635570.042243:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa4107a1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.042250:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa4107a1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.042310:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2800/0xb0c3a59caa41079a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7450e expref: 30 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.042328:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d054d47fb00) 00010000:00010000:2.0:1789635570.042330:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789635570.042335:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2800/0xb0c3a59caa41079a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7450e expref: 30 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.042360:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e1a2800, rc 0) 00000100:00100000:2.0:1789635570.042444:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+29:15624:x1876568411609472:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 643us (2214us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1789635570.042451:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00100000:2.0:1789635570.045757:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635570.045860:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411609600 00000100:00100000:3.0:1789635570.045873:0:17848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411609600 00000100:00100000:3.0:1789635570.045946:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 52 00000100:00100000:3.0:1789635570.045958:0:17848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550662300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+29:15624:x1876568411609600:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789635570.046004:0:17848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789635570.046190:0:17848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550662300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+29:15624:x1876568411609600:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 234us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635570.046199:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 52 00000100:00100000:3.0:1789635570.052869:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635570.053750:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411609856 00000100:00100000:1.0:1789635570.053766:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411609856 00000100:00100000:1.0:1789635570.053839:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:1.0:1789635570.053850:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0574369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+29:15624:x1876568411609856:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789635570.053876:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635570.053901:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530e00/0xb0c3a59caa4107af lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74515 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789635570.054567:0:17097:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =28 00000004:00080000:1.0:1789635570.054577:0:17097:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+28 in llog 00000004:00080000:1.0:1789635570.054639:0:17097:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:1.0:1789635570.055574:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530000/0xb0c3a59caa4107b6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.055838:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530000/0xb0c3a59caa4107b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.055863:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530000/0xb0c3a59caa4107b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.056224:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530e00/0xb0c3a59caa4107af lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74515 expref: 32 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.056246:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530000/0xb0c3a59caa4107b6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74515 expref: 31 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.056255:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d054d47f600) 00010000:00010000:1.0:1789635570.056258:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789635570.056276:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0565530000, rc 0) 00000100:00100000:1.0:1789635570.056370:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0574369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+31:15624:x1876568411609856:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 2520us (3515us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1789635570.056380:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:1.0:1789635570.062480:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635570.062766:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411610112 00000100:00100000:2.0:1789635570.062776:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411610112 00000100:00100000:2.0:1789635570.062879:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 54 00000100:00100000:2.0:1789635570.062889:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+31:15624:x1876568411610112:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789635570.062966:0:17096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635570.062992:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530000/0xb0c3a59caa4107b6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74515 expref: 31 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.063011:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d054d47f600) 00010000:00010000:2.0:1789635570.063021:0:17096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789635570.063043:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa4107c4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.063055:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa4107c4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.063085:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa4107c4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.063100:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2000/0xb0c3a59caa4107cb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xbf265761 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.063107:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2000/0xb0c3a59caa4107cb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xbf265761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.063114:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2000/0xb0c3a59caa4107cb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xbf265761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.063156:0:17096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa4107c4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.063163:0:17096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa4107c4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.063170:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa4107c4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.063177:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a3e00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635570.063181:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa4107c4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.063188:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa4107c4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.063197:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d054d47f100) 00010000:00010000:2.0:1789635570.063200:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635570.063203:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa4107c4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.063215:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a3e00/0xb0c3a59caa4107c4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.063225:0:17096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2000/0xb0c3a59caa4107cb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xbf265761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.063232:0:17096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2000/0xb0c3a59caa4107cb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xbf265761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.063238:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2000/0xb0c3a59caa4107cb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xbf265761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.063243:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a2000 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635570.063246:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2000/0xb0c3a59caa4107cb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xbf265761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.063252:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2000/0xb0c3a59caa4107cb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xbf265761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.063259:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xbf265761 (ffff8d0544e2e400) 00010000:00010000:2.0:1789635570.063261:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635570.063264:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2000/0xb0c3a59caa4107cb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xbf265761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.063270:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2000/0xb0c3a59caa4107cb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xbf265761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635570.063369:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+30:15624:x1876568411610112:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 481us (896us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789635570.063377:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 54 00000100:00100000:2.0:1789635570.066882:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635570.067432:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411610240 00000100:00100000:3.0:1789635570.067443:0:17848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411610240 00000100:00100000:3.0:1789635570.067558:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:3.0:1789635570.067569:0:17848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+30:15624:x1876568411610240:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789635570.067589:0:17848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635570.067661:0:17848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa4107d2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7451c expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.067708:0:17848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa4107d9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.067740:0:17848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa4107d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.067751:0:17848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa4107d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.067875:0:17848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa4107d2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7451c expref: 32 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.067902:0:17848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ff000/0xb0c3a59caa4107d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7451c expref: 31 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.067911:0:17848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d05446d0b00) 00010000:00010000:3.0:1789635570.067914:0:17848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789635570.067917:0:17848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d05488ff000, rc 0) 00000100:00100000:3.0:1789635570.067978:0:17848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+31:15624:x1876568411610240:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 410us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635570.067984:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:3.0:1789635570.071522:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635570.071801:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411610496 00000100:00100000:1.0:1789635570.071817:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411610496 00000100:00100000:1.0:1789635570.072303:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 56 00000100:00100000:1.0:1789635570.072317:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d057436a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+31:15624:x1876568411610496:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789635570.072452:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530200/0xb0c3a59caa4107e0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.072469:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530200/0xb0c3a59caa4107e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.072482:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530200/0xb0c3a59caa4107e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789635570.072983:0:17097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1789635570.072994:0:17097:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 588756397047ns, next at 589756394527ns, rc = 0 00000004:00010000:1.0:1789635570.073042:0:17097:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2de1b13 reply state 00000000fc6b8704 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530200/0xb0c3a59caa4107e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.073056:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530200/0xb0c3a59caa4107e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.073063:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d05446d0b00) 00010000:00010000:1.0:1789635570.073066:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789635570.073070:0:17097:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789635570.073179:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d057436a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+33:15624:x1876568411610496:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 864us (1670us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1789635570.073200:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 56 00000100:00100000:1.0:1789635570.084162:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635570.084376:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411610624 00000100:00100000:0.0:1789635570.084386:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411610624 00000100:00100000:0.0:1789635570.084444:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 57 00000100:00100000:0.0:1789635570.084453:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+33:15624:x1876568411610624:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789635570.084477:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635570.084497:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42c00/0xb0c3a59caa4107e7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74523 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.084551:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42c00/0xb0c3a59caa4107e7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74523 expref: 34 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.084579:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42c00/0xb0c3a59caa4107e7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74523 expref: 34 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.084628:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d05446d0b00) 00010000:00010000:0.0:1789635570.084631:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789635570.084635:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0549f42c00, rc 0) 00000100:00100000:0.0:1789635570.084724:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+34:15624:x1876568411610624:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 270us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635570.084732:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 57 00000100:00100000:2.0:1789635570.088790:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635570.089700:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411610752 00000100:00100000:1.0:1789635570.089716:0:18696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411610752 00000100:00100000:1.0:1789635570.089792:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:1.0:1789635570.089806:0:18696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575adb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+5:2397:x1876568411610752:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789635570.091524:0:18696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575adb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+6:2397:x1876568411610752:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 1546us (2568us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1789635570.091540:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:0.0:1789635570.093756:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635570.093894:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411611008 00000100:00100000:3.0:1789635570.093911:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411611008 00000100:00100000:3.0:1789635570.094000:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:3.0:1789635570.094131:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+34:15624:x1876568411611008:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789635570.095020:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+35:15624:x1876568411611008:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 996us (1258us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1789635570.095040:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:2.0:1789635570.097871:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635570.098286:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411611264 00000100:00100000:3.0:1789635570.098309:0:17848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411611264 00000100:00100000:3.0:1789635570.098689:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 58 00000100:00100000:3.0:1789635570.098704:0:17848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+35:15624:x1876568411611264:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789635570.099098:0:17848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+35:15624:x1876568411611264:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 396us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635570.099109:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 58 00000100:00100000:1.0:1789635570.102087:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635570.102233:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411611392 00000100:00100000:3.0:1789635570.102248:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411611392 00000100:00100000:3.0:1789635570.102552:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00100000:3.0:1789635570.102565:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044859a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+35:15624:x1876568411611392:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789635570.102593:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635570.102641:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa4107ee lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7452a expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.102732:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa4107f5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.102751:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa4107f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.102764:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa4107f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635570.102823:0:17097:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789635570.102847:0:17097:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa4107f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.102880:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488ffe00/0xb0c3a59caa4107ee lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7452a expref: 37 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.102901:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa4107f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7452a expref: 36 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.102911:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d05446d0b00) 00010000:00010000:3.0:1789635570.102914:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789635570.102933:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d056e153a00, rc 0) 00000100:00100000:3.0:1789635570.103083:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044859a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+36:15624:x1876568411611392:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 520us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635570.103091:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00100000:3.0:1789635570.108163:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635570.108250:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411611520 00000100:00100000:0.0:1789635570.108264:0:18602:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411611520 00000100:00100000:0.0:1789635570.108359:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 26 00000100:00100000:0.0:1789635570.108372:0:18602:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0574368380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+6:2398:x1876568411611520:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789635570.108406:0:18602:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635570.108434:0:18602:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073d840cd/0xb0c3a59caa4107fc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74531 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789635570.108478:0:18602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aababf2, blocks: 0x0 00010000:00010000:0.0:1789635570.108503:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=588s v=(0 0) 00010000:00010000:0.0:1789635570.108509:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635570.108522:0:18602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073d840cd/0xb0c3a59caa4107fc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74531 expref: 7 pid: 18602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.108545:0:18602:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000073d840cd/0xb0c3a59caa4107fc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74531 expref: 7 pid: 18602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.108580:0:18602:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0549f42600, rc 0) 00000100:00100000:0.0:1789635570.108713:0:18602:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0574368380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+7:2398:x1876568411611520:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 343us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635570.108722:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 26 00000100:00100000:2.0:1789635570.114467:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635570.115466:0:20238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411611776 00000100:00100000:1.0:1789635570.115483:0:20238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411611776 00000100:00100000:1.0:1789635570.115825:0:20238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:1.0:1789635570.115839:0:20238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+36:15624:x1876568411611776:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789635570.116003:0:20238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+36:15624:x1876568411611776:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 166us (1555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635570.116011:0:20238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:1.0:1789635570.123768:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635570.123888:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411611904 00000100:00100000:2.0:1789635570.123901:0:17848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411611904 00000100:00100000:2.0:1789635570.123979:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 61 00000100:00100000:2.0:1789635570.123991:0:17848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0448599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+36:15624:x1876568411611904:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789635570.134158:0:17076:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1789635570.134187:0:17076:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1789635570.134246:0:17076:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:0.0:1789635570.135231:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42e00/0xb0c3a59caa410689 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.135247:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42e00/0xb0c3a59caa410689 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.135256:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42e00/0xb0c3a59caa410689 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.135263:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0549f42e00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635570.135268:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42e00/0xb0c3a59caa410689 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.135277:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42e00/0xb0c3a59caa410689 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.135370:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d054d47f100) 00010000:00010000:0.0:1789635570.135375:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1789635570.135504:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42e00/0xb0c3a59caa410689 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.135513:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42e00/0xb0c3a59caa410689 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.135655:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3800/0xb0c3a59caa410635 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.135664:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3800/0xb0c3a59caa410635 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.135670:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3800/0xb0c3a59caa410635 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.135675:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05820d3800 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635570.135678:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3800/0xb0c3a59caa410635 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.135684:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3800/0xb0c3a59caa410635 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.135702:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d054d47f200) 00010000:00010000:2.0:1789635570.135705:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635570.135708:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3800/0xb0c3a59caa410635 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.135714:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3800/0xb0c3a59caa410635 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.135746:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3c00/0xb0c3a59caa41063c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.135752:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3c00/0xb0c3a59caa41063c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.135757:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3c00/0xb0c3a59caa41063c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.135761:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05820d3c00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635570.135764:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3c00/0xb0c3a59caa41063c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.135770:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3c00/0xb0c3a59caa41063c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.135777:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d054d47f100) 00010000:00010000:2.0:1789635570.135779:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789635570.136390:0:17848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0448599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+19:15624:x1876568411611904:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 Request processed in 12383us (12616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635570.136410:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 61 00000100:00100000:1.0:1789635570.136650:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d057436a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427422208:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789635570.136737:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789635570.136948:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3c00/0xb0c3a59caa41063c lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.136963:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05820d3c00/0xb0c3a59caa41063c lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.136997:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa4106e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.137005:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa4106e4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.137013:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa4106e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.137033:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e152a00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635570.137037:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa4106e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.137044:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa4106e4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.137059:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d05446d0400) 00010000:00010000:2.0:1789635570.137063:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635570.137066:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa4106e4 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.137073:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e152a00/0xb0c3a59caa4106e4 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.137094:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531600/0xb0c3a59caa410769 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.137101:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531600/0xb0c3a59caa410769 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.137107:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531600/0xb0c3a59caa410769 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.137120:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0565531600 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635570.137124:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531600/0xb0c3a59caa410769 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.137131:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531600/0xb0c3a59caa410769 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.137141:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d05446d0e00) 00010000:00010000:2.0:1789635570.137143:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635570.137146:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531600/0xb0c3a59caa410769 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.137152:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565531600/0xb0c3a59caa410769 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.137167:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530200/0xb0c3a59caa4107e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.137173:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530200/0xb0c3a59caa4107e0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.137179:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530200/0xb0c3a59caa4107e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.137184:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0565530200 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:2.0:1789635570.137187:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530200/0xb0c3a59caa4107e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.137207:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530200/0xb0c3a59caa4107e0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.137230:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d05446d0b00) 00010000:00010000:2.0:1789635570.137232:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789635570.137236:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530200/0xb0c3a59caa4107e0 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.137243:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0565530200/0xb0c3a59caa4107e0 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635570.138233:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427422208 00000100:00100000:0.0:1789635570.138249:0:18604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427422208 00000100:00100000:0.0:1789635570.138327:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789635570.138339:0:18604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d044791ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876568427422208:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789635570.138710:0:18604:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789635570.138714:0:18604:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1789635570.138717:0:18604:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789635570.138719:0:18604:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789635570 -> 1789635570 00002000:00010000:0.0:1789635570.138721:0:18604:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1789635570.139160:0:18604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d044791ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1876568427422208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 821us (2421us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789635570.139170:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000004:00080000:1.0:1789635570.140051:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d057436a680/2, rc 0, transno 8589934596 00000100:00100000:1.0:1789635570.140065:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d057436a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1876568427422208:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789635570.141740:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635570.142913:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411612032 00000100:00100000:2.0:1789635570.142931:0:18696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411612032 00000100:00100000:2.0:1789635570.143027:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:2.0:1789635570.143040:0:18696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+7:2398:x1876568411612032:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789635570.143180:0:18696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+7:2398:x1876568411612032:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 Request processed in 143us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635570.143188:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:2.0:1789635570.152093:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635570.154469:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411612288 00000100:00100000:3.0:1789635570.154493:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411612288 00000100:00100000:3.0:1789635570.154584:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 62 00000100:00100000:3.0:1789635570.154625:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+15:15624:x1876568411612288:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789635570.154700:0:17097:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635570.154735:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153a00/0xb0c3a59caa4107f5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7452a expref: 15 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.154759:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d05446d0b00) 00010000:00010000:3.0:1789635570.154766:0:17097:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789635570.154820:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa410803 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.155156:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa410803 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.155169:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa410803 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789635570.155350:0:17097:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011126a1a reply state 000000001424772b transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa410803 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.155364:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e153c00/0xb0c3a59caa410803 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.155395:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d05446d0b00) 00010000:00010000:3.0:1789635570.155398:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789635570.155401:0:17097:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789635570.155733:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+16:15624:x1876568411612288:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 1135us (3716us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1789635570.155742:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 62 00000100:00100000:1.0:1789635570.168215:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635570.170847:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411612416 00000100:00100000:0.0:1789635570.170869:0:18602:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411612416 00000100:00100000:0.0:1789635570.171042:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:0.0:1789635570.171056:0:18602:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0447ac0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+7:15624:x1876568411612416:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789635570.171081:0:18602:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635570.171107:0:18602:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053b7c2d0/0xb0c3a59caa41080a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab74538 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.171150:0:18602:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000073d840cd/0xb0c3a59caa4107fc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74531 expref: 8 pid: 18602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.171161:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635570.171167:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635570.171190:0:18602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053b7c2d0/0xb0c3a59caa41080a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74538 expref: 8 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.171238:0:18602:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000073d840cd/0xb0c3a59caa4107fc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74531 expref: 8 pid: 18602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.171253:0:18602:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000073d840cd/0xb0c3a59caa4107fc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74531 expref: 8 pid: 18602 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635570.171270:0:18602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bf9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18602:1876568427422336:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789635570.171401:0:18602:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549cf40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635570.174851:0:18602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bf9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18602:1876568427422336:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789635570.174900:0:18602:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000053b7c2d0/0xb0c3a59caa41080a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74538 expref: 8 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.174929:0:18602:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0549f42e00, rc 0) 00000100:00100000:0.0:1789635570.175005:0:18602:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0447ac0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+8:15624:x1876568411612416:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 3953us (6805us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635570.175574:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:1.0:1789635570.178524:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1789635570.178865:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411612544 00000100:00100000:2.0:1789635570.178880:0:17081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411612544 00010000:00010000:2.0:1789635570.178936:0:17081:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000073d840cd/0xb0c3a59caa4107fc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74531 expref: 8 pid: 18602 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635570.178988:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:2.0:1789635570.178999:0:17081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+8:2396:x1876568411612544:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635570.179137:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635570.179167:0:17081:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000073d840cd/0xb0c3a59caa4107fc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74531 expref: 8 pid: 18602 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.179210:0:17081:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000073d840cd/0xb0c3a59caa4107fc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74531 expref: 8 pid: 18602 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.179240:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073d840cd/0xb0c3a59caa4107fc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74531 expref: 8 pid: 18602 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.179260:0:17081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635570.179266:0:17081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635570.179273:0:17081:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000053b7c2d0/0xb0c3a59caa41080a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74538 expref: 7 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.179286:0:17081:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053b7c2d0/0xb0c3a59caa41080a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74538 expref: 7 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.179344:0:17081:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000053b7c2d0/0xb0c3a59caa41080a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74538 expref: 7 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635570.179362:0:17081:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0575ad8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:17081:1876568427422464:192.168.203.20@tcp:105: 00000100:00100000:2.0:1789635570.179704:0:17081:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d05655feb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789635570.182863:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635570.183075:0:19724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411612672 00000100:00100000:2.0:1789635570.183079:0:17081:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0575ad8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:17081:1876568427422464:192.168.203.20@tcp:105: 00000100:00100000:0.0:1789635570.183084:0:19724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411612672 00010000:00010000:2.0:1789635570.183109:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635570.183159:0:19724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:0.0:1789635570.183170:0:19724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+8:2397:x1876568411612672:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789635570.183176:0:17081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+8:2396:x1876568411612544:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 4180us (4735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635570.183383:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 19 00002000:00010000:0.0:1789635570.183574:0:19724:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789635570.183579:0:19724:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1789635569 00002000:00010000:0.0:1789635570.183589:0:19724:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1789635568 00002000:00010000:0.0:1789635570.183592:0:19724:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789635570 -> 1789635569 00002000:00010000:0.0:1789635570.183622:0:19724:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1789635570.183656:0:19724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+8:2397:x1876568411612672:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 487us (807us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789635570.183665:0:19724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:1.0:1789635570.187376:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635570.187530:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411612800 00000100:00100000:3.0:1789635570.187543:0:18603:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411612800 00000100:00100000:3.0:1789635570.187709:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 31 00000100:00100000:3.0:1789635570.187722:0:18603:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+8:2397:x1876568411612800:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789635570.187778:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000070c933e6/0xb0c3a59caa410811 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.187802:0:18603:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000053b7c2d0/0xb0c3a59caa41080a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74538 expref: 8 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.187813:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635570.187818:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789635570.187823:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070c933e6/0xb0c3a59caa410811 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.187866:0:18603:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000053b7c2d0/0xb0c3a59caa41080a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74538 expref: 8 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.187883:0:18603:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000053b7c2d0/0xb0c3a59caa41080a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74538 expref: 8 pid: 18602 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635570.187925:0:18603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0574369180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18603:1876568427422592:192.168.203.20@tcp:104: 00000100:00100000:3.0:1789635570.188046:0:18603:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0447552600 going to sleep for 11 seconds 00000100:00100000:2.0:1789635570.191375:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635570.191705:0:18603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0574369180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18603:1876568427422592:192.168.203.20@tcp:104: 00010000:00010000:3.0:1789635570.191737:0:18603:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000070c933e6/0xb0c3a59caa410811 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635570.192676:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411612928 00000100:00100000:0.0:1789635570.192690:0:17082:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411612928 00010000:00010000:0.0:1789635570.192746:0:17082:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000053b7c2d0/0xb0c3a59caa41080a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74538 expref: 9 pid: 18602 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635570.192795:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:0.0:1789635570.192806:0:17082:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0575ad8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+9:2397:x1876568411612928:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789635570.192830:0:17082:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635570.192858:0:17082:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000053b7c2d0/0xb0c3a59caa41080a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74538 expref: 9 pid: 18602 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.192873:0:17082:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000053b7c2d0/0xb0c3a59caa41080a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74538 expref: 9 pid: 18602 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.192900:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053b7c2d0/0xb0c3a59caa41080a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74538 expref: 9 pid: 18602 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.192920:0:17082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789635570.192925:0:17082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789635570.192931:0:17082:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000070c933e6/0xb0c3a59caa410811 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.192960:0:17082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070c933e6/0xb0c3a59caa410811 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.192999:0:17082:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635570.193121:0:17082:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0575ad8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+8:2397:x1876568411612928:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 316us (1759us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635570.193130:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 20 00010000:00010000:3.0:1789635570.193185:0:18603:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000070c933e6/0xb0c3a59caa410811 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.193196:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070c933e6/0xb0c3a59caa410811 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.193219:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000070c933e6/0xb0c3a59caa410811 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.193228:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070c933e6/0xb0c3a59caa410811 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.193237:0:18603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070c933e6/0xb0c3a59caa410811 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.193245:0:18603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e153a00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:3.0:1789635570.193250:0:18603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070c933e6/0xb0c3a59caa410811 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.193269:0:18603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070c933e6/0xb0c3a59caa410811 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.193283:0:18603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070c933e6/0xb0c3a59caa410811 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.193291:0:18603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070c933e6/0xb0c3a59caa410811 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635570.193370:0:18603:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+7:2397:x1876568411612800:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 Request processed in 5652us (6016us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635570.193386:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 31 00000100:00100000:1.0:1789635570.195784:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635570.195851:0:20238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411613184 00000100:00100000:0.0:1789635570.195863:0:20238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411613184 00000100:00100000:0.0:1789635570.195963:0:20238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00100000:0.0:1789635570.195974:0:20238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0546df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+16:15624:x1876568411613184:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789635570.196089:0:20238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42400/0xb0c3a59caa410818 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.196108:0:20238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f43e00/0xb0c3a59caa410762 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744f9 expref: 16 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.196119:0:20238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42400/0xb0c3a59caa410818 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.196163:0:20238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f43e00/0xb0c3a59caa410762 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744f9 expref: 16 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.196178:0:20238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f43e00/0xb0c3a59caa410762 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744f9 expref: 16 pid: 17098 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635570.196222:0:20238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bf9500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20238:1876568427422720:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789635570.196329:0:20238:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549cf40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635570.199038:0:20238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bf9500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20238:1876568427422720:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789635570.199084:0:20238:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42400/0xb0c3a59caa410818 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635570.199430:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1789635570.199685:0:20123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411613312 00000100:00100000:3.0:1789635570.199697:0:20123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411613312 00010000:00010000:3.0:1789635570.199844:0:20123:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f43e00/0xb0c3a59caa410762 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744f9 expref: 17 pid: 17098 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635570.199895:0:20123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:3.0:1789635570.199907:0:20123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0574372a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+17:2396:x1876568411613312:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635570.199928:0:20123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635570.199936:0:20123:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f43e00/0xb0c3a59caa410762 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744f9 expref: 17 pid: 17098 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.199950:0:20123:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f43e00/0xb0c3a59caa410762 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744f9 expref: 17 pid: 17098 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.199993:0:20123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f43e00/0xb0c3a59caa410762 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab744f9 expref: 17 pid: 17098 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.200154:0:20123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d05446d0e00) 00010000:00010000:3.0:1789635570.200162:0:20123:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42800/0xb0c3a59caa41077e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74507 expref: 16 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.200173:0:20123:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42400/0xb0c3a59caa410818 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.200182:0:20123:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42400/0xb0c3a59caa410818 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.200195:0:20123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42400/0xb0c3a59caa410818 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.200224:0:20123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789635570.200255:0:20238:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42400/0xb0c3a59caa410818 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.200263:0:20238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42400/0xb0c3a59caa410818 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635570.200370:0:20123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0574372a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+16:2396:x1876568411613312:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 464us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635570.200390:0:20123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 21 00010000:00010000:0.0:1789635570.200672:0:20238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42e00/0xb0c3a59caa41081f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.200686:0:20238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42c00/0xb0c3a59caa4107e7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74523 expref: 16 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.200695:0:20238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42e00/0xb0c3a59caa41081f lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.200726:0:20238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42c00/0xb0c3a59caa4107e7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74523 expref: 16 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.200736:0:20238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42c00/0xb0c3a59caa4107e7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74523 expref: 16 pid: 17096 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635570.200749:0:20238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bf9500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20238:1876568427422848:192.168.203.20@tcp:104: 00000100:00100000:0.0:1789635570.200931:0:20238:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d0549cf49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635570.205722:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635570.205879:0:20238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bf9500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20238:1876568427422848:192.168.203.20@tcp:104: 00010000:00010000:0.0:1789635570.205917:0:20238:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42e00/0xb0c3a59caa41081f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635570.207793:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411613440 00000100:00100000:2.0:1789635570.207811:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411613440 00010000:00010000:2.0:1789635570.207872:0:17083:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42c00/0xb0c3a59caa4107e7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74523 expref: 17 pid: 17096 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635570.207930:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:2.0:1789635570.207940:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0574372d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+17:2396:x1876568411613440:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635570.207959:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635570.207966:0:17083:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42c00/0xb0c3a59caa4107e7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74523 expref: 17 pid: 17096 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.207981:0:17083:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42c00/0xb0c3a59caa4107e7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74523 expref: 17 pid: 17096 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.208007:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42c00/0xb0c3a59caa4107e7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74523 expref: 17 pid: 17096 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.208035:0:17083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d05446d0b00) 00010000:00010000:2.0:1789635570.208040:0:17083:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42e00/0xb0c3a59caa41081f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.208051:0:17083:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42e00/0xb0c3a59caa41081f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.208060:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42e00/0xb0c3a59caa41081f lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.208118:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789635570.208259:0:20238:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42e00/0xb0c3a59caa41081f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.208279:0:20238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42e00/0xb0c3a59caa41081f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635570.208830:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0574372d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+16:2396:x1876568411613440:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 887us (3118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635570.208840:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 22 00000001:00080000:1.0:1789635570.208912:0:20238:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1789635570.209190:0:20238:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1789635570.209233:0:20238:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1789635570.209554:0:20238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0574370a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:20238:1876568427422976:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789635570.209651:0:20238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635570.209689:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427422976 00000100:00100000:1.0:1789635570.209691:0:20238:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d056e013600 going to sleep for 11 seconds 00000100:00100000:2.0:1789635570.209699:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427422976 00000100:00100000:2.0:1789635570.209751:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789635570.209761:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0574373100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:20238:x1876568427422976:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789635570.209873:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0574373100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:20238:x1876568427422976:12345-0@lo:1000:mdt00_004.0 Request processed in 114us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635570.209881:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789635570.210649:0:20238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0574370a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:20238:1876568427422976:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1789635570.211373:0:20238:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1789635570.211888:0:20238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0574370a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:20238:1876568427423104:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789635570.211967:0:20238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635570.212009:0:20238:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d056e013a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789635570.212078:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427423104 00000100:00100000:3.0:1789635570.212087:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427423104 00000100:00100000:3.0:1789635570.212156:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789635570.212169:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0574371c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:20238:x1876568427423104:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789635570.212345:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0574371c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:20238:x1876568427423104:12345-0@lo:1000:mdt00_004.0 Request processed in 179us (378us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1789635570.212354:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789635570.212394:0:20238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0574370a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:20238:1876568427423104:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1789635570.212568:0:20238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42e00/0xb0c3a59caa41081f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.212588:0:20238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42e00/0xb0c3a59caa41081f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.212622:0:20238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42e00/0xb0c3a59caa41081f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.212630:0:20238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0549f42e00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635570.212635:0:20238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42e00/0xb0c3a59caa41081f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.212644:0:20238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42e00/0xb0c3a59caa41081f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.212664:0:20238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d05446d0b00) 00010000:00010000:1.0:1789635570.212668:0:20238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789635570.212673:0:20238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42e00/0xb0c3a59caa41081f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.212679:0:20238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42e00/0xb0c3a59caa41081f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.212727:0:20238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa410777 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.212734:0:20238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa410777 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.212740:0:20238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa410777 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.212744:0:20238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d05488fea00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:1.0:1789635570.212754:0:20238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa410777 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.212831:0:20238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa410777 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.212844:0:20238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d05446d0e00) 00010000:00010000:1.0:1789635570.212846:0:20238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789635570.212854:0:20238:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42800/0xb0c3a59caa41077e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74507 expref: 19 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.212866:0:20238:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42800/0xb0c3a59caa41077e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74507 expref: 19 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.212876:0:20238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42800/0xb0c3a59caa41077e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74507 expref: 19 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635570.212943:0:20238:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42800/0xb0c3a59caa41077e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab74507 expref: 19 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635570.213150:0:20238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0574372300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20238:1876568427423232:192.168.203.20@tcp:105: 00000100:00100000:1.0:1789635570.213248:0:20238:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d056e013a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789635570.219136:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635570.219140:0:20238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0574372300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20238:1876568427423232:192.168.203.20@tcp:105: 00010000:00010000:0.0:1789635570.219179:0:20238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa410777 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.219192:0:20238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d05488fea00/0xb0c3a59caa410777 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.219238:0:20238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f43c00/0xb0c3a59caa410826 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635570.219249:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411613568 00010000:00010000:0.0:1789635570.219255:0:20238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f43c00/0xb0c3a59caa410826 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635570.219260:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411613568 00010000:00010000:0.0:1789635570.219267:0:20238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f43c00/0xb0c3a59caa410826 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.219280:0:20238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f43c00/0xb0c3a59caa410826 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.219286:0:20238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f43c00/0xb0c3a59caa410826 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.219292:0:20238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f43c00/0xb0c3a59caa410826 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.219310:0:20238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0549f43c00 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635570.219334:0:20238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f43c00/0xb0c3a59caa410826 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.219343:0:20238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f43c00/0xb0c3a59caa410826 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.219357:0:20238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d05446d0e00) 00010000:00010000:0.0:1789635570.219370:0:20238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635570.219374:0:20238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f43c00/0xb0c3a59caa410826 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.219380:0:20238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f43c00/0xb0c3a59caa410826 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.219392:0:20238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42400/0xb0c3a59caa410818 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.219397:0:20238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42400/0xb0c3a59caa410818 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.219403:0:20238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42400/0xb0c3a59caa410818 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635570.219405:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:3.0:1789635570.219416:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d05541c6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+20:15623:x1876568411613568:12345-192.168.203.20@tcp:49:dd.0 00010000:00010000:0.0:1789635570.219419:0:20238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0549f42400 already unused, calling callback (ffffffffc1b494f0) 00010000:00010000:0.0:1789635570.219422:0:20238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42400/0xb0c3a59caa410818 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.219438:0:20238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42400/0xb0c3a59caa410818 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.219445:0:20238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d05446d0e00) 00010000:00010000:0.0:1789635570.219448:0:20238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789635570.219457:0:20238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42400/0xb0c3a59caa410818 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.219462:0:20238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42400/0xb0c3a59caa410818 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635570.219584:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d05541c6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+20:15623:x1876568411613568:12345-192.168.203.20@tcp:49:dd.0 Request processed in 169us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635570.219591:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 10 00000040:00080000:0.0:1789635570.219730:0:17130:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789635570.219735:0:17130:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789635570.219751:0:17130:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789635570.219757:0:17130:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789635570.219854:0:20238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0546df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+19:15624:x1876568411613184:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 23880us (24083us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1789635570.219863:0:20238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 63 00000020:00080000:0.0:1789635570.219867:0:20238:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1789635570.224471:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635570.224528:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635570.224656:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411613696 00000100:00100000:0.0:1789635570.224669:0:17848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411613696 00000100:00100000:2.0:1789635570.224735:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411613952 00000100:00100000:2.0:1789635570.224740:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411613952 00000100:00100000:0.0:1789635570.224743:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 64 00000100:00100000:0.0:1789635570.224753:0:17848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0574370380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+20:15623:x1876568411613696:12345-192.168.203.20@tcp:101:dd.0 00010000:00010000:0.0:1789635570.224780:0:17848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635570.224808:0:17848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42a00/0xb0c3a59caa41082d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86d3de4d4ab7453f expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.224854:0:17848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42e00/0xb0c3a59caa410834 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.224871:0:17848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42e00/0xb0c3a59caa410834 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.224885:0:17848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42e00/0xb0c3a59caa410834 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635570.224964:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:2.0:1789635570.224973:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0574372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+21:15624:x1876568411613952:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00010000:00010000:0.0:1789635570.225043:0:17848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42a00/0xb0c3a59caa41082d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7453f expref: 22 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.225064:0:17848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0549f42e00/0xb0c3a59caa410834 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0x86d3de4d4ab7453f expref: 21 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.225073:0:17848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d05446d0e00) 00010000:00010000:0.0:1789635570.225077:0:17848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789635570.225081:0:17848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0549f42e00, rc 0) 00000100:00100000:0.0:1789635570.225155:0:17848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0574370380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+21:15623:x1876568411613696:12345-192.168.203.20@tcp:101:dd.0 Request processed in 402us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635570.225162:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 64 00000004:00080000:2.0:1789635570.225344:0:17100:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789635570.225404:0:17100:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1789635570.225431:0:17100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa41083b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.225442:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa41083b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.225450:0:17100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa41083b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.225458:0:17100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa41083b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.225473:0:17100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa41083b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.225480:0:17100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa41083b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635570.225511:0:17100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789635570.225578:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0574372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+22:15624:x1876568411613952:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 606us (1049us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1789635570.225587:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 11 00000020:00080000:2.0:1789635570.225591:0:17100:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789635570.227097:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635570.227113:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa41083b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.227126:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e1a2600 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:0.0:1789635570.227130:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa41083b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.227142:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa41083b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.227163:0:17085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d05446d0b00) 00010000:00010000:0.0:1789635570.227166:0:17085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789635570.227172:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa41083b lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.227213:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d056e1a2600/0xb0c3a59caa41083b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.227251:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635570.227254:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635570.227257:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635570.378731:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1789635570.378874:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1789635570.379109:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411614208 00000100:00100000:0.0:1789635570.379121:0:18608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411614208 00000100:00100000:0.0:1789635570.379249:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568411614080 00000100:00100000:0.0:1789635570.379253:0:18608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568411614080 00000100:00100000:3.0:1789635570.379303:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:3.0:1789635570.379319:0:18609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0574371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+8:2398:x1876568411614208:12345-192.168.203.20@tcp:4:dd.0 00002000:00010000:3.0:1789635570.379391:0:18609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6aababf1, atime: 0x6aababf0, ctime: 0x6aababf1, blocks: 0x0 00010000:00010000:3.0:1789635570.379403:0:18609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070c933e6/0xb0c3a59caa410842 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.379422:0:18609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=589s v=(0 0) 00010000:00010000:3.0:1789635570.379428:0:18609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635570.379445:0:18609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070c933e6/0xb0c3a59caa410842 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635570.379465:0:18609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070c933e6/0xb0c3a59caa410842 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789635570.438179:0:18599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:2.0:1789635570.438204:0:18599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:0.0:1789635570.438489:0:18609:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:0.0:1789635570.438494:0:18609:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1789635569 -> 1789635570 00002000:00010000:0.0:1789635570.438497:0:18609:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789635569 -> 1789635570 00002000:00010000:0.0:1789635570.438500:0:18609:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:0.0:1789635570.438521:0:18609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070c933e6/0xb0c3a59caa410842 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.438535:0:18609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070c933e6/0xb0c3a59caa410842 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.438546:0:18609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070c933e6/0xb0c3a59caa410842 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.438560:0:18609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d056e153a00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:0.0:1789635570.438566:0:18609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070c933e6/0xb0c3a59caa410842 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.438576:0:18609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070c933e6/0xb0c3a59caa410842 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.438734:0:18609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070c933e6/0xb0c3a59caa410842 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.438742:0:18609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070c933e6/0xb0c3a59caa410842 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635570.438875:0:18609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0574371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+6:2398:x1876568411614208:12345-192.168.203.20@tcp:4:dd.0 Request processed in 59554us (60151us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1789635570.438887:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:0.0:1789635570.438931:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:0.0:1789635570.438944:0:18609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0574371500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+5:2398:x1876568411614080:12345-192.168.203.20@tcp:4:dd.0 00002000:00010000:0.0:1789635570.438994:0:18609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 7654321, mtime: 0x6aababf2, atime: 0x6aababf0, ctime: 0x6aababf2, blocks: 0x1a68 00010000:00010000:0.0:1789635570.439002:0:18609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ac69fe5/0xb0c3a59caa410849 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.439015:0:18609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=589s v=(0 0) 00010000:00010000:0.0:1789635570.439021:0:18609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635570.439027:0:18609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ac69fe5/0xb0c3a59caa410849 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.439041:0:18609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ac69fe5/0xb0c3a59caa410849 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789635570.492651:0:18599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:0.0:1789635570.492927:0:18609:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:0.0:1789635570.492947:0:18609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ac69fe5/0xb0c3a59caa410849 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.492974:0:18609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ac69fe5/0xb0c3a59caa410849 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.492983:0:18609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ac69fe5/0xb0c3a59caa410849 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.492990:0:18609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0549f42a00 already unused, calling callback (ffffffffc0f15f90) 00010000:00010000:0.0:1789635570.492995:0:18609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ac69fe5/0xb0c3a59caa410849 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.493004:0:18609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ac69fe5/0xb0c3a59caa410849 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.493023:0:18609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ac69fe5/0xb0c3a59caa410849 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635570.493031:0:18609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ac69fe5/0xb0c3a59caa410849 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635570.493142:0:18609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0574371500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e93c6359-edaa-4c8b-af3f-bf6e406e4e94+5:2398:x1876568411614080:12345-192.168.203.20@tcp:4:dd.0 Request processed in 54197us (114263us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1789635570.493152:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 1 00010000:00010000:1.0:1789635570.723872:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635571.752781:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789635571.904458:0:20276:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:3.0:1789635572.131954:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789635572.131976:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0574370700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427423360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635572.132054:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635572.132163:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427423360 00000100:00100000:0.0:1789635572.132171:0:18606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427423360 00000100:00100000:0.0:1789635572.132240:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789635572.132250:0:18606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0574369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427423360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789635572.132289:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3923513344 avail 3684286464 00000100:00100000:0.0:1789635572.132334:0:18606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0574369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876568427423360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635572.132342:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1789635572.132397:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789635572.132477:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:3.0:1789635572.132482:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d057436a680, transno 8589934596 00000004:00080000:3.0:1789635572.132504:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:3.0:1789635572.132536:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0574370700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1876568427423360:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1789635572.263743:0:17130:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789635572.263753:0:17130:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789635572.263776:0:17130:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789635572.263783:0:17130:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1789635572.775909:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635573.157126:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d0550bf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427423488:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789635573.157191:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635573.157260:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568427423488 00000100:00100000:0.0:1789635573.157268:0:18606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568427423488 00000100:00100000:0.0:1789635573.158139:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789635573.158153:0:18606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0550bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427423488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789635573.158192:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1789635573.158258:0:18606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0550bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876568427423488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635573.158264:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1789635573.158299:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789635573.158480:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d0550bf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1876568427423488:0@lo:13:osp-pre-0-1.0 Debug log: 43164 lines, 43164 kept, 0 dropped, 0 bad.